-- Logs begin at Thu 2022-07-21 07:47:51 UTC, end at Thu 2022-07-21 08:47:22 UTC. -- Jul 21 08:15:34.563140 dv-cinder-850320-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 08:15:34.571967 dv-cinder-850320-1-smb devstack@keystone.service[80224]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 08:15:34.574653 dv-cinder-850320-1-smb devstack@keystone.service[80224]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 08:15:34 2022] *** Jul 21 08:15:34.574653 dv-cinder-850320-1-smb devstack@keystone.service[80224]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 08:15:34.574653 dv-cinder-850320-1-smb devstack@keystone.service[80224]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 08:15:34.574653 dv-cinder-850320-1-smb devstack@keystone.service[80224]: nodename: dv-cinder-850320-1-smb Jul 21 08:15:34.574653 dv-cinder-850320-1-smb devstack@keystone.service[80224]: machine: x86_64 Jul 21 08:15:34.574653 dv-cinder-850320-1-smb devstack@keystone.service[80224]: clock source: unix Jul 21 08:15:34.574653 dv-cinder-850320-1-smb devstack@keystone.service[80224]: pcre jit disabled Jul 21 08:15:34.574653 dv-cinder-850320-1-smb devstack@keystone.service[80224]: detected number of CPU cores: 4 Jul 21 08:15:34.574653 dv-cinder-850320-1-smb devstack@keystone.service[80224]: current working directory: / Jul 21 08:15:34.574653 dv-cinder-850320-1-smb devstack@keystone.service[80224]: detected binary path: /usr/bin/uwsgi-core Jul 21 08:15:34.574653 dv-cinder-850320-1-smb devstack@keystone.service[80224]: your processes number limit is 47680 Jul 21 08:15:34.574653 dv-cinder-850320-1-smb devstack@keystone.service[80224]: your memory page size is 4096 bytes Jul 21 08:15:34.575321 dv-cinder-850320-1-smb devstack@keystone.service[80224]: detected max file descriptor number: 2048 Jul 21 08:15:34.575321 dv-cinder-850320-1-smb devstack@keystone.service[80224]: lock engine: pthread robust mutexes Jul 21 08:15:34.575321 dv-cinder-850320-1-smb devstack@keystone.service[80224]: thunder lock: enabled Jul 21 08:15:34.575321 dv-cinder-850320-1-smb devstack@keystone.service[80224]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 08:15:34.575321 dv-cinder-850320-1-smb devstack@keystone.service[80224]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 08:15:34.619850 dv-cinder-850320-1-smb devstack@keystone.service[80224]: Python main interpreter initialized at 0x5608be5679c0 Jul 21 08:15:34.619850 dv-cinder-850320-1-smb devstack@keystone.service[80224]: python threads support enabled Jul 21 08:15:34.619850 dv-cinder-850320-1-smb devstack@keystone.service[80224]: your server socket listen backlog is limited to 100 connections Jul 21 08:15:34.619850 dv-cinder-850320-1-smb devstack@keystone.service[80224]: your mercy for graceful operations on workers is 90 seconds Jul 21 08:15:34.620216 dv-cinder-850320-1-smb devstack@keystone.service[80224]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 08:15:34.620291 dv-cinder-850320-1-smb devstack@keystone.service[80224]: *** Operational MODE: preforking *** Jul 21 08:15:34.620544 dv-cinder-850320-1-smb devstack@keystone.service[80224]: *** uWSGI is running in multiple interpreter mode *** Jul 21 08:15:34.620544 dv-cinder-850320-1-smb devstack@keystone.service[80224]: spawned uWSGI master process (pid: 80224) Jul 21 08:15:34.620758 dv-cinder-850320-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 21 08:15:34.622429 dv-cinder-850320-1-smb devstack@keystone.service[80224]: spawned uWSGI worker 1 (pid: 80236, cores: 1) Jul 21 08:15:34.622429 dv-cinder-850320-1-smb devstack@keystone.service[80224]: spawned uWSGI worker 2 (pid: 80237, cores: 1) Jul 21 08:15:34.622429 dv-cinder-850320-1-smb devstack@keystone.service[80224]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 08:15:39.993884 dv-cinder-850320-1-smb devstack@keystone.service[80237]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:15:39.993884 dv-cinder-850320-1-smb devstack@keystone.service[80237]: from cryptography.utils import int_from_bytes Jul 21 08:15:39.994725 dv-cinder-850320-1-smb devstack@keystone.service[80237]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:15:39.994725 dv-cinder-850320-1-smb devstack@keystone.service[80237]: from cryptography.utils import int_from_bytes Jul 21 08:15:40.002737 dv-cinder-850320-1-smb devstack@keystone.service[80236]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:15:40.002737 dv-cinder-850320-1-smb devstack@keystone.service[80236]: from cryptography.utils import int_from_bytes Jul 21 08:15:40.003250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:15:40.003250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: from cryptography.utils import int_from_bytes Jul 21 08:15:40.043433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 08:15:40.043640 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 08:15:40.043849 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] command line args: [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 08:15:40.044111 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 08:15:40.044303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ================================================================================ {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 08:15:40.044549 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] admin_token = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.044813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] config_dir = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.045021 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.045178 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] config_source = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.045396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] debug = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.045620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.045973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.046172 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.046441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.046693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.046933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.047130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_config_append = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.047313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.047532 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_dir = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.047702 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_file = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.047960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.048224 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.048481 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.048731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.048899 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.049074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.049316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.049573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.049836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.050052 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 08:15:40.050149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.050259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 08:15:40.050335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.050454 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] command line args: [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 08:15:40.050610 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.050732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 08:15:40.050872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.050963 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ================================================================================ {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 08:15:40.051152 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.051248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] admin_token = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.051387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] config_dir = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.051465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.051574 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.051784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] config_source = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.051965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] debug = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.052054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.052179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] publish_errors = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.052265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.052443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.052553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.052623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.052693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.052833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.052924 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.053084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.053177 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.053314 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] list_limit = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.053392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.053494 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] log_config_append = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.053639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] standard_threads = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.053727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.053837 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] log_dir = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.053914 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.054013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] log_file = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.054235 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.054348 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.054505 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.054616 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.054809 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] use_journal = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.054944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.055071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] use_json = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.055151 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.055237 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.055320 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] use_stderr = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.055399 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.055472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] use_syslog = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.055626 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.055721 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.055829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.055970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.056051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.056238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.056333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.056529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.056610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.056772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.056918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.057041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.057177 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.057296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.057375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.057586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.057664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.057854 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.058108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.058194 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.058313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] publish_errors = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.058400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.058530 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.058668 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.058780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.058929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.059007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.059207 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.059286 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.059453 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.059537 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.059726 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] standard_threads = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.059806 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.059969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.060050 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.060235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.060319 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.060424 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.060539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.060626 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] use_journal = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.060794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] use_json = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.060870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.060989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] use_stderr = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.061074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.061176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] use_syslog = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.061326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.061411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:15:40.061602 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.061686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.061893 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.061978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.062171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.062250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.062428 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.062511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.062688 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.062772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.062945 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.063024 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.063199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.063275 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.063453 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.063529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.063735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.063816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.064003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.064091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.064256 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.064333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.064509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.064586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.064768 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.064852 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.065023 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.065101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.065281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.065360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.065546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.065631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.065800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.065876 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.066059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.066148 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.066321 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.066406 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.066583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.066719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.066830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.066978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.067102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.067305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.067385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.067536 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.067671 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.067798 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.067888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.068045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.068123 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.068274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.068353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.068508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.068593 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.068735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.068820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.068970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.069046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.069189 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.069303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.069433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.069557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.069663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.069872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.070141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.070281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.070418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.070527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.070615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.070695 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.070826 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.070911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.071061 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.071140 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.071291 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.071377 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.071539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.071689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.071801 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.071962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.072049 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.072252 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.072329 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.072506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.072586 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.072738 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.072835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.072966 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.073071 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.073198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.073331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.073437 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.073585 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.073691 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.073847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.073955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.074108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.074188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.074372 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.074463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.074607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.074703 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.074842 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.074921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.075076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.075164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.075322 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.075402 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.075558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.075706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.075830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.075919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.076073 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.076173 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.076308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.076444 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.076633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.076725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.076888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.076968 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.077125 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.077250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.077358 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.077447 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.077615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.077695 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.077858 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.077983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.078103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.078240 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.078321 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.078497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.078580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.078762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.078845 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.078994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.079081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.079225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.079304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.079451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.079557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.079713 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.079886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.079967 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.080135 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.080219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.080363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.080452 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.080596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.080675 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.080825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.080903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.081068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.081221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.081298 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.081371 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.081530 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.081608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.081775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.081866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.082010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.082101 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.082237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.external = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.082316 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.082463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.082542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.082697 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.082783 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.082933 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.083012 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.083178 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.password = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.083256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.083404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] auth.token = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.083485 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.083668 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.083753 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.083900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.083980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.084140 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.084219 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.084365 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.084443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.084596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.084673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.084830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.084911 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.085055 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.085133 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.085281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.085573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.085707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.085813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.085883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.086046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.086154 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.086327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.086406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.086577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.086665 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.086810 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.086899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.087058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.087137 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.087297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.087385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.087530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.087660 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.087812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.087892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.088054 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.088144 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.088287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] auth.external = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.088368 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.088518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.088597 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.088794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.088881 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.089032 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.089122 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.089264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] auth.password = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.089351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.089493 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] auth.token = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.089581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.089730 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.089810 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.089964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.090044 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.090188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.090278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.090429 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.090509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.090661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.090741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.090903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.090990 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.091134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.091215 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.091367 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] credential.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.091447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.091616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.091715 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.091863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.091944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.092094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.092174 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.092330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.092417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.092570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.092651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.092799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.092879 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.093031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.093119 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.093292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.093390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.093535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.093615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.093789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.093878 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.094069 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.094149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.094311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.094391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.094550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.094637 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.094780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.094860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.095013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.095097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.095263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.095422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.095500 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.095575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.095750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.095834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.096003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.096096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.096234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.096315 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.096480 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.096560 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.096715 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.096797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.096946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.097025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.097175 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.097256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.097408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.097490 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.097637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.097717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.097875 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.097956 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.098106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.098186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.098339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.098417 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.098582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.098661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.098808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.098888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.099040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.099119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.099282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.099361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.099510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.099590 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.099774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.099855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.100016 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.100127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.100247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.100381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.100481 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.100613 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.100693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.100844 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.100972 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.101217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.101344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.101475 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.101623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.101751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.101842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.101979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.102059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.102226 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.102295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.102471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.102560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.102698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.102779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.102925 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.103004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.103169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.103256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.103412 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.103492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.103665 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.103749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.103898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.103991 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.104129 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.104210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.104364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.104445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.104603 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.104691 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.104860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.104994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.105073 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.105145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.105309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.105398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.105551 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.105631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.105788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.105866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.106019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.106105 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.106245 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.106332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.106476 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.106555 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.106709 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.106798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.106936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.107015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.107161 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.107238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.107394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.107481 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.107688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.107774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.107892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.108032 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.108112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.108283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.108372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.108528 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.108609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.108763 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.108855 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.109007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.109087 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.109241 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.109321 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.109473 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.109560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.109705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.109785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.109936 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.110018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.110176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.110262 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.110415 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.110496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.110647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.110726 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.110896 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.110985 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.111125 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.111204 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.111365 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.111490 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.111659 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.111753 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.111830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.111903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.112058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.112138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.112299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.112387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.112531 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.112610 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.112755 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.112833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.112986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.113073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.113214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.113292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.113456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.113534 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.113698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.113786 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.113931 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.114010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.114176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.114254 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.114420 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.114506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.114652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.114731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.114893 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.114972 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.115124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.115213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.115357 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.115437 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.115586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] role.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.115685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.115842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.115933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] role.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.116069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.116147 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.116313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.116393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.116716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.116863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.116863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.116997 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.117076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.117348 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.117438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.117592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.117674 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.117847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.117927 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.118082 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.118160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.118308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.118385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.118542 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.118621 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.118781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.118860 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.119015 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.119097 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.119251 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.119331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.119491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.119663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.119762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.119884 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.120007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.120133 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.120243 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.120382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.120493 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.120627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.120745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.120872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.120981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.121104 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.121227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.121353 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.121465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.121602 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.121703 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.121835 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.121937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] role.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.122063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.122181 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] role.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.122291 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.122413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.122501 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.122662 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.122742 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.122907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.122987 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.123154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.123243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.123399 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.123537 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.123664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.123817 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.123897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.124047 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.124151 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.124279 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.124398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.124511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.124632 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.124754 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.124878 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.124986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.125125 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.125237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.125371 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.125480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.125617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.125698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.125936 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.126014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.126173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.126261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.126414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.126493 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.126647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.126727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.126879 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.126970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.127108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.127188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.127348 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.127428 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.127591 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.127720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.127841 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.127920 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.128080 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.128160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.128341 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.128421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.128572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.128652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.connection = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.128804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.128895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.129053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.129133 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.129297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.129377 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.129535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.129615 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.129766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.129846 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.129998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.130078 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.130225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.130302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.130455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.130533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.130688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.130768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.130920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.130998 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.131154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.131232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.131385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.131465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.131649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.131732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.131885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.131967 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.132127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.132271 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.132475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.132600 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.132792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.132936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.133081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.133167 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.133265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.133346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 08:15:40.133500 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.133746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.133993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.134224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.134468 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.134774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.135034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.connection = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.135280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.135525 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.135784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.136025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.136258 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.136492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.136725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.136960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.137204 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.137439 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.137683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.137919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.138167 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.138403 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.138653 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.138885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.139126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.139362 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:15:40.139531 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 08:15:40.164495 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.164694 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.164923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.166199 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.166434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.166659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.173287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.174950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.201375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.201575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.202588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.202823 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.350171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.351747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.398647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.398938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.399256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.399496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.463350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.463555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.463693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.463792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.463919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.463995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.464184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.464308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.464390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.464468 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.464576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.464820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.489297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.489475 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.489592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.489705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.489871 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.490008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.490078 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.490170 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.490249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.490312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.490501 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.490629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.490714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.490917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.501700 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.501830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.514530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.514699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.514774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.514894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.514987 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.515102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.515237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.515309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.515372 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.515535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.515649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.515771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.515863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.515986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:15:40.534228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.534228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 08:15:40.534596 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.534596 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 08:15:40.534746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.534812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.534872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 08:15:40.534979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.535199 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.535339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.535419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 08:15:40.535484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.535689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.535948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.536204 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.536461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.546470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.546741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.547008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.547282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.547921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.548198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.548447 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.548724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.555587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.556979 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.558850 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.559124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.559402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.559815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.560098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.560221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.560304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.560535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.560671 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.560822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.560925 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.561116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.561242 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.561349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.561436 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.561616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.561710 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.561960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.562231 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.562486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.562752 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.563026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.588166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.589714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.589842 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.589988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.591319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.591630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.595233 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.595506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.595827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.596870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.597332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.597456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.603105 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.603300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.604730 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.605022 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.608052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.608307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.608589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.608871 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.609142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.609410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.609630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.609750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.609880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.609979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.610194 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.610479 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.610750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.611004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.611268 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.611536 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.628518 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.628759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.630221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.630497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.633470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.635339 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.637089 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.637377 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.638986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.639280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.642351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.644331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.645946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.648369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.649780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.650076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.650351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.650635 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.650918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.651189 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.652038 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.652333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.652634 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.652923 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.653192 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.653467 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.670607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.670975 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.671239 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.671473 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.672747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.673121 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.673396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.673654 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.679519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.681521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.681748 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.681849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.683576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.683871 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.684825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.685099 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.685388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.685666 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.685990 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.686905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.687178 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.687457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.687758 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.688075 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.699551 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.699831 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.700127 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.700411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.700684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.700970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.701240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.701564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.701842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.702128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.702403 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.702664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.702947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.703217 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.720655 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.722634 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.723909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.725938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.727228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.728844 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.729548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.730454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.730735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.731013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.731139 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.732781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.733066 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.733351 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.738597 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.740854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.741289 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.742650 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.744697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.744984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.745263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.745539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.745886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.746177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.746465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.746750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.754705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.754984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.755258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.755991 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.756273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.756549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.763451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.763700 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.764011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.764283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.764412 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:15:40.764562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.764692 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.764877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.764969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.765092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.765216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.765378 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.765529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.765661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.765792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.765937 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.766125 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.766258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.766390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.766520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.766650 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.766787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.766926 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.767056 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.767187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.767318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.767489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.767799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:15:40.805613 dv-cinder-850320-1-smb devstack@keystone.service[80237]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608be5679c0 pid: 80237 (default app) Jul 21 08:15:40.806915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608be5679c0 pid: 80236 (default app) Jul 21 08:15:40.808986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399ec4e-4d78-4380-a183-8fb0692f56c6 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:40.809376 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399ec4e-4d78-4380-a183-8fb0692f56c6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:40.809490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399ec4e-4d78-4380-a183-8fb0692f56c6 None None] PATH_INFO: `/v3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:40.814138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Thu Jul 21 08:15:40 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:48.672313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0f16c-8a10-4506-859c-e8aaef42c89b None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:48.672907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0f16c-8a10-4506-859c-e8aaef42c89b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:48.672907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0f16c-8a10-4506-859c-e8aaef42c89b None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:48.677249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:15:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:15:48.684577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf31589-179b-4bd4-9037-8a3147bb9acd None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:48.685315 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf31589-179b-4bd4-9037-8a3147bb9acd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:48.685460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf31589-179b-4bd4-9037-8a3147bb9acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:48.757410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: INFO dbcounter [None req-bdf31589-179b-4bd4-9037-8a3147bb9acd None None] Registered counter for database keystone Jul 21 08:15:48.782367 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG oslo_db.sqlalchemy.engines [None req-bdf31589-179b-4bd4-9037-8a3147bb9acd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80237) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:15:48.794258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writer thread running {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:15:48.981616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG passlib.handlers.bcrypt [None req-bdf31589-179b-4bd4-9037-8a3147bb9acd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80237) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 08:15:48.981998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG passlib.handlers.bcrypt [None req-bdf31589-179b-4bd4-9037-8a3147bb9acd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80237) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 08:15:49.038227 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-bdf31589-179b-4bd4-9037-8a3147bb9acd None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:49.039898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bdf31589-179b-4bd4-9037-8a3147bb9acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:49.186834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 504 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 08:15:49.386122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0f16c-8a10-4506-859c-e8aaef42c89b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:49.456640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: INFO dbcounter [None req-63b0f16c-8a10-4506-859c-e8aaef42c89b None None] Registered counter for database keystone Jul 21 08:15:49.478213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG oslo_db.sqlalchemy.engines [None req-63b0f16c-8a10-4506-859c-e8aaef42c89b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80236) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:15:49.486633 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writer thread running {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:15:49.606280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0f16c-8a10-4506-859c-e8aaef42c89b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:49.613678 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fbcb8-c391-48b6-bd77-ce39c8ccb0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:49.614689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fbcb8-c391-48b6-bd77-ce39c8ccb0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:49.615108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fbcb8-c391-48b6-bd77-ce39c8ccb0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:49.615512 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fbcb8-c391-48b6-bd77-ce39c8ccb0d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:49.625785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fbcb8-c391-48b6-bd77-ce39c8ccb0d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:49.680319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c06fbcb8-c391-48b6-bd77-ce39c8ccb0d4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 08:15:49.680925 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fbcb8-c391-48b6-bd77-ce39c8ccb0d4 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:49.691592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Jul 21 08:15:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:15:49.698860 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf31589-179b-4bd4-9037-8a3147bb9acd None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:49.719285 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf31589-179b-4bd4-9037-8a3147bb9acd None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:49.726169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a00fe-4172-44e2-8750-ab6d6fd381f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:49.727335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a00fe-4172-44e2-8750-ab6d6fd381f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:49.727631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a00fe-4172-44e2-8750-ab6d6fd381f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:49.727927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a00fe-4172-44e2-8750-ab6d6fd381f6 admin admin] PATH_INFO: `/v3/projects/8dac71dc397d4676b170c1cf9092d9e5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:49.732297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a00fe-4172-44e2-8750-ab6d6fd381f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=8dac71dc397d4676b170c1cf9092d9e5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:49.785059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9a0a00fe-4172-44e2-8750-ab6d6fd381f6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 08:15:49.785401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a00fe-4172-44e2-8750-ab6d6fd381f6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:49.790235 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Jul 21 08:15:49 2022] GET /identity/v3/projects/8dac71dc397d4676b170c1cf9092d9e5 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:51.820724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45926ba-d227-4872-a4ae-eead64cc8a7f None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:51.821521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45926ba-d227-4872-a4ae-eead64cc8a7f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:51.821521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45926ba-d227-4872-a4ae-eead64cc8a7f None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:51.828259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:15:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:51.833936 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfe40f-ab26-4e7a-8e5e-73a8bd0ca3af None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:51.834364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfe40f-ab26-4e7a-8e5e-73a8bd0ca3af None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:51.834454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfe40f-ab26-4e7a-8e5e-73a8bd0ca3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:51.855448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-bebfe40f-ab26-4e7a-8e5e-73a8bd0ca3af None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:51.856994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bebfe40f-ab26-4e7a-8e5e-73a8bd0ca3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:51.866534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 08:15:51.889270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45926ba-d227-4872-a4ae-eead64cc8a7f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:51.909802 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45926ba-d227-4872-a4ae-eead64cc8a7f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:51.914989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198d9c2-6b40-4d0b-96e1-ead97576a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:51.915738 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198d9c2-6b40-4d0b-96e1-ead97576a461 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:51.916033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198d9c2-6b40-4d0b-96e1-ead97576a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:51.916314 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198d9c2-6b40-4d0b-96e1-ead97576a461 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:51.924364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198d9c2-6b40-4d0b-96e1-ead97576a461 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:51.926203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198d9c2-6b40-4d0b-96e1-ead97576a461 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:51.936025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Jul 21 08:15:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:15:51.941904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfe40f-ab26-4e7a-8e5e-73a8bd0ca3af None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:51.953462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfe40f-ab26-4e7a-8e5e-73a8bd0ca3af None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:51.959026 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15d138-3247-4fc2-b776-ac105123a660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:51.960087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15d138-3247-4fc2-b776-ac105123a660 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:51.960481 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15d138-3247-4fc2-b776-ac105123a660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:51.960896 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15d138-3247-4fc2-b776-ac105123a660 admin admin] PATH_INFO: `/v3/users/23d4803e5e4a4ff6aed2456c309e3051` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:51.962885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15d138-3247-4fc2-b776-ac105123a660 admin admin] RBAC: Authorizing `identity:get_user(user_id=23d4803e5e4a4ff6aed2456c309e3051)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:51.964785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15d138-3247-4fc2-b776-ac105123a660 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:51.966388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Jul 21 08:15:51 2022] GET /identity/v3/users/23d4803e5e4a4ff6aed2456c309e3051 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:15:54.048124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2e06c-acd2-4d14-bbe3-5cf245b3f6b6 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:54.048703 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2e06c-acd2-4d14-bbe3-5cf245b3f6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:54.048703 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2e06c-acd2-4d14-bbe3-5cf245b3f6b6 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:54.050040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:54.055558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c846c98-e618-4366-a043-68853c9e512e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:54.056070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c846c98-e618-4366-a043-68853c9e512e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:54.056150 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c846c98-e618-4366-a043-68853c9e512e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:54.073350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3c846c98-e618-4366-a043-68853c9e512e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:54.074531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3c846c98-e618-4366-a043-68853c9e512e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:54.097654 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f5e06-72cd-45e6-bcb3-71460df8efa9 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:54.097945 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f5e06-72cd-45e6-bcb3-71460df8efa9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:54.098225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f5e06-72cd-45e6-bcb3-71460df8efa9 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:54.099621 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:54.107666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638d763-c2f7-4cfd-bbc6-bc5f4099d556 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:54.108293 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638d763-c2f7-4cfd-bbc6-bc5f4099d556 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:54.108549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638d763-c2f7-4cfd-bbc6-bc5f4099d556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:54.148039 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG passlib.handlers.bcrypt [None req-0638d763-c2f7-4cfd-bbc6-bc5f4099d556 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80236) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 08:15:54.148455 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG passlib.handlers.bcrypt [None req-0638d763-c2f7-4cfd-bbc6-bc5f4099d556 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80236) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 08:15:54.160615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:15:54.183361 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c846c98-e618-4366-a043-68853c9e512e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:54.193836 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0638d763-c2f7-4cfd-bbc6-bc5f4099d556 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:54.195478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0638d763-c2f7-4cfd-bbc6-bc5f4099d556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:54.208302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:54.294064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c846c98-e618-4366-a043-68853c9e512e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:54.301678 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:15:54.324417 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638d763-c2f7-4cfd-bbc6-bc5f4099d556 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:54.328438 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40294544-5c87-44b9-9e27-6f97c2a5a94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:54.329258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40294544-5c87-44b9-9e27-6f97c2a5a94d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:54.329520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40294544-5c87-44b9-9e27-6f97c2a5a94d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:54.329791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40294544-5c87-44b9-9e27-6f97c2a5a94d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:54.341555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40294544-5c87-44b9-9e27-6f97c2a5a94d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-40294544-5c87-44b9-9e27-6f97c2a5a94d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:15:54.353196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:15:54.354130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:15:54.354915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:15:54.354915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:15:54.354915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:15:54.354915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:15:54.354915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:15:54.354915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:15:54.354915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:15:54.354915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:15:54.354915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:15:54.354915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:15:54.354915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:54.354915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:15:54.354915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:15:54.360475 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40294544-5c87-44b9-9e27-6f97c2a5a94d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:54.426462 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638d763-c2f7-4cfd-bbc6-bc5f4099d556 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:54.429519 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:54.443445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:54.465204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40294544-5c87-44b9-9e27-6f97c2a5a94d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:54.467095 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710b131-b710-4bfb-affd-8a5e0efc8802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:54.468042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710b131-b710-4bfb-affd-8a5e0efc8802 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:54.468327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710b131-b710-4bfb-affd-8a5e0efc8802 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:54.468602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710b131-b710-4bfb-affd-8a5e0efc8802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:54.499715 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888778-d285-4966-89b2-12cee6c3ead9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:54.500374 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888778-d285-4966-89b2-12cee6c3ead9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:54.500654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888778-d285-4966-89b2-12cee6c3ead9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:54.500928 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888778-d285-4966-89b2-12cee6c3ead9 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:54.501690 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0888778-d285-4966-89b2-12cee6c3ead9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:54.501996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0888778-d285-4966-89b2-12cee6c3ead9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:54.503413 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0888778-d285-4966-89b2-12cee6c3ead9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:54.515446 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:15:54.521319 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888778-d285-4966-89b2-12cee6c3ead9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:54.538716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710b131-b710-4bfb-affd-8a5e0efc8802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:54.540318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710b131-b710-4bfb-affd-8a5e0efc8802 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:54.620063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888778-d285-4966-89b2-12cee6c3ead9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:54.643215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:15:54.649199 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710b131-b710-4bfb-affd-8a5e0efc8802 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:54.652080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:54.654982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d79137-21e8-415b-bb4b-f2d830c0d03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:54.655950 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d79137-21e8-415b-bb4b-f2d830c0d03e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:54.656234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d79137-21e8-415b-bb4b-f2d830c0d03e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:54.656513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d79137-21e8-415b-bb4b-f2d830c0d03e None admin] PATH_INFO: `/v3/users/23d4803e5e4a4ff6aed2456c309e3051` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:54.657784 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d79137-21e8-415b-bb4b-f2d830c0d03e None admin] RBAC: Authorizing `identity:get_user(user_id=23d4803e5e4a4ff6aed2456c309e3051)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:54.659248 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d79137-21e8-415b-bb4b-f2d830c0d03e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:54.660998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:15:54 2022] GET /identity/v3/users/23d4803e5e4a4ff6aed2456c309e3051 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:15:54.666825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d79137-21e8-415b-bb4b-f2d830c0d03e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:54.681604 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:54.749018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710b131-b710-4bfb-affd-8a5e0efc8802 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:54.768433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d79137-21e8-415b-bb4b-f2d830c0d03e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:54.782911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8da479-65b0-442c-a3c9-8ca74131a178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:54.783748 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8da479-65b0-442c-a3c9-8ca74131a178 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:54.784153 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8da479-65b0-442c-a3c9-8ca74131a178 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:54.784431 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8da479-65b0-442c-a3c9-8ca74131a178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:54.802851 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe58088-e74b-4a3e-b549-8a24959c2bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:54.803813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe58088-e74b-4a3e-b549-8a24959c2bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:54.804103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe58088-e74b-4a3e-b549-8a24959c2bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:54.804311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8da479-65b0-442c-a3c9-8ca74131a178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:54.804400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe58088-e74b-4a3e-b549-8a24959c2bf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:54.805576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe58088-e74b-4a3e-b549-8a24959c2bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:54.805889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8da479-65b0-442c-a3c9-8ca74131a178 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:54.807045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe58088-e74b-4a3e-b549-8a24959c2bf2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:54.808709 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 10/18] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:15:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:15:54.814515 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe58088-e74b-4a3e-b549-8a24959c2bf2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:54.826308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ab8da479-65b0-442c-a3c9-8ca74131a178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:15:54.826308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:15:54.826308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:15:54.826308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:15:54.826308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:15:54.826308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:15:54.826308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:15:54.826308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:15:54.826308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:15:54.826308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:15:54.826308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:15:54.826308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:15:54.826308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:15:54.826308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:15:54.826308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:15:54.827193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:15:54.828012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:15:54.828012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:15:54.828012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:15:54.828012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:15:54.828012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 9/19] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:15:54.833200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8da479-65b0-442c-a3c9-8ca74131a178 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:54.890533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:54.896448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:54.917331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe58088-e74b-4a3e-b549-8a24959c2bf2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:54.935274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8da479-65b0-442c-a3c9-8ca74131a178 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:54.952027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a8b0a-0341-4cf6-a002-0664dbbfd30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:54.952700 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a8b0a-0341-4cf6-a002-0664dbbfd30a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:54.952981 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a8b0a-0341-4cf6-a002-0664dbbfd30a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:54.953258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a8b0a-0341-4cf6-a002-0664dbbfd30a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:54.954107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a8b0a-0341-4cf6-a002-0664dbbfd30a None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.domain.id=default, user.id=23d4803e5e4a4ff6aed2456c309e3051) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:54.954418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a8b0a-0341-4cf6-a002-0664dbbfd30a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:54.955904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a8b0a-0341-4cf6-a002-0664dbbfd30a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:54.962656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 11/20] 10.222.0.64 () {56 vars in 1322 bytes} [Thu Jul 21 08:15:54 2022] GET /identity/v3/role_assignments?user.id=23d4803e5e4a4ff6aed2456c309e3051&scope.domain.id=default&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:15:54.969774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7b728-79b2-4380-8764-997fc55b193a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:54.970465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7b728-79b2-4380-8764-997fc55b193a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:54.970749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7b728-79b2-4380-8764-997fc55b193a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:54.971026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7b728-79b2-4380-8764-997fc55b193a None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:54.971820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7b728-79b2-4380-8764-997fc55b193a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:54.972131 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7b728-79b2-4380-8764-997fc55b193a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:54.973580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7b728-79b2-4380-8764-997fc55b193a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:54.994250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 10/21] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:15:57.330211 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6e9a-12d1-40c4-be28-2307c55674d6 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:57.331247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6e9a-12d1-40c4-be28-2307c55674d6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:57.331903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6e9a-12d1-40c4-be28-2307c55674d6 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:57.333841 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 12/22] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:15:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:57.339806 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b81fea-34a6-4f5c-90fb-98cf852cf231 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:57.340260 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b81fea-34a6-4f5c-90fb-98cf852cf231 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:57.340434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b81fea-34a6-4f5c-90fb-98cf852cf231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:57.364923 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-69b81fea-34a6-4f5c-90fb-98cf852cf231 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:57.366321 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-69b81fea-34a6-4f5c-90fb-98cf852cf231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:57.456315 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 11/23] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:15:57.497070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e6e9a-12d1-40c4-be28-2307c55674d6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:57.501787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1176ad3-f3d1-42c8-abe0-ff1923f47419 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:57.502251 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1176ad3-f3d1-42c8-abe0-ff1923f47419 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:57.502739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1176ad3-f3d1-42c8-abe0-ff1923f47419 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:57.504354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 12/24] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:15:57.514716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ff8bd-691d-4604-9dcf-e1b0be9e0fc4 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:57.515295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ff8bd-691d-4604-9dcf-e1b0be9e0fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:57.515818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ff8bd-691d-4604-9dcf-e1b0be9e0fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:57.540606 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-923ff8bd-691d-4604-9dcf-e1b0be9e0fc4 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:57.542138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-923ff8bd-691d-4604-9dcf-e1b0be9e0fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:57.650099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:57.702028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e6e9a-12d1-40c4-be28-2307c55674d6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:57.720957 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 13/25] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:15:57.762197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ff8bd-691d-4604-9dcf-e1b0be9e0fc4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:57.770740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fc22e-dedb-4ff8-81f5-4a9c253ac26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:57.771567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fc22e-dedb-4ff8-81f5-4a9c253ac26b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:57.771891 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fc22e-dedb-4ff8-81f5-4a9c253ac26b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:57.772350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fc22e-dedb-4ff8-81f5-4a9c253ac26b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:57.799206 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fc22e-dedb-4ff8-81f5-4a9c253ac26b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-411fc22e-dedb-4ff8-81f5-4a9c253ac26b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:15:57.808349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:15:57.809236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:15:57.809978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:15:57.809978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:15:57.809978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:15:57.809978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:15:57.809978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:15:57.809978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:15:57.809978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:15:57.809978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:15:57.809978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:15:57.809978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:15:57.809978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:57.809978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:15:57.811887 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 13/26] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:15:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:15:57.819413 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94efae-699f-42d6-96a8-52326f01b300 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:57.819985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94efae-699f-42d6-96a8-52326f01b300 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:57.820579 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94efae-699f-42d6-96a8-52326f01b300 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:57.822944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 14/27] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:15:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:57.825386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94efae-699f-42d6-96a8-52326f01b300 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:57.851999 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:57.979367 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94efae-699f-42d6-96a8-52326f01b300 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:57.993940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ff8bd-691d-4604-9dcf-e1b0be9e0fc4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:58.020930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6550c3-a615-4efe-a5f6-e8425939bd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:58.022697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6550c3-a615-4efe-a5f6-e8425939bd60 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:58.023423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6550c3-a615-4efe-a5f6-e8425939bd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:58.023884 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6550c3-a615-4efe-a5f6-e8425939bd60 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:58.025053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6550c3-a615-4efe-a5f6-e8425939bd60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:58.025894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6550c3-a615-4efe-a5f6-e8425939bd60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:58.027490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6550c3-a615-4efe-a5f6-e8425939bd60 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:58.040650 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 15/28] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:15:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:58.042072 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56ac01-13ca-4f71-b5d8-fabecb63075e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:58.042523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56ac01-13ca-4f71-b5d8-fabecb63075e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:58.042963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56ac01-13ca-4f71-b5d8-fabecb63075e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:58.056440 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae072b78-88b7-4715-bb82-91b00e6b3b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:58.057229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae072b78-88b7-4715-bb82-91b00e6b3b34 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:58.057522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae072b78-88b7-4715-bb82-91b00e6b3b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:58.057795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae072b78-88b7-4715-bb82-91b00e6b3b34 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:58.058571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae072b78-88b7-4715-bb82-91b00e6b3b34 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:58.060080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae072b78-88b7-4715-bb82-91b00e6b3b34 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:58.061769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1a56ac01-13ca-4f71-b5d8-fabecb63075e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:58.063384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1a56ac01-13ca-4f71-b5d8-fabecb63075e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:58.130818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:58.140623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 16/29] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:15:58.148958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c3433-cb5a-49b1-be9b-78e2616b6792 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:58.149326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c3433-cb5a-49b1-be9b-78e2616b6792 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:58.149683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c3433-cb5a-49b1-be9b-78e2616b6792 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:58.151149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 17/30] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:15:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:58.151988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c3433-cb5a-49b1-be9b-78e2616b6792 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:58.210378 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 14/31] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 21 08:15:57 2022] POST /identity/v3/roles => generated 219 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:15:58.212280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867fe81-7f07-421a-8a64-184f0dfa91d0 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:58.212690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867fe81-7f07-421a-8a64-184f0dfa91d0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:58.212983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867fe81-7f07-421a-8a64-184f0dfa91d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:58.242425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9867fe81-7f07-421a-8a64-184f0dfa91d0 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:58.247712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9867fe81-7f07-421a-8a64-184f0dfa91d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:58.274781 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c3433-cb5a-49b1-be9b-78e2616b6792 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:58.303997 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:58.316369 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f57d10-e0fa-4090-8158-1be357ced063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:58.317282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f57d10-e0fa-4090-8158-1be357ced063 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:58.317560 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f57d10-e0fa-4090-8158-1be357ced063 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:58.317834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f57d10-e0fa-4090-8158-1be357ced063 None admin] PATH_INFO: `/v3/users/23d4803e5e4a4ff6aed2456c309e3051` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:58.319176 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f57d10-e0fa-4090-8158-1be357ced063 None admin] RBAC: Authorizing `identity:get_user(user_id=23d4803e5e4a4ff6aed2456c309e3051)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:58.320957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f57d10-e0fa-4090-8158-1be357ced063 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:58.322932 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 18/32] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:15:58 2022] GET /identity/v3/users/23d4803e5e4a4ff6aed2456c309e3051 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:58.323495 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f57d10-e0fa-4090-8158-1be357ced063 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:58.383114 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 15/33] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:15:58.385696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867fe81-7f07-421a-8a64-184f0dfa91d0 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:58.396198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:58.445496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f57d10-e0fa-4090-8158-1be357ced063 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:58.489415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8b951-4db0-4f53-8fd9-00c68bf90916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:58.490113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8b951-4db0-4f53-8fd9-00c68bf90916 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:58.490446 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8b951-4db0-4f53-8fd9-00c68bf90916 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:58.490917 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8b951-4db0-4f53-8fd9-00c68bf90916 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:58.491730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8b951-4db0-4f53-8fd9-00c68bf90916 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:58.493321 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8b951-4db0-4f53-8fd9-00c68bf90916 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:58.574951 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867fe81-7f07-421a-8a64-184f0dfa91d0 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:58.610843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad3663-6b5f-4355-964a-eaa105fd587d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:58.611686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3663-6b5f-4355-964a-eaa105fd587d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:58.611977 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3663-6b5f-4355-964a-eaa105fd587d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:58.612259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3663-6b5f-4355-964a-eaa105fd587d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:58.613714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad3663-6b5f-4355-964a-eaa105fd587d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:58.615925 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad3663-6b5f-4355-964a-eaa105fd587d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:58.617680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 16/34] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:15:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:58.620614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 19/35] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 21 08:15:58 2022] POST /identity/v3/roles => generated 225 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:15:58.621677 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad3663-6b5f-4355-964a-eaa105fd587d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:58.636782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8b951-4db0-4f53-8fd9-00c68bf90916 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:58.666116 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:58.744121 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad3663-6b5f-4355-964a-eaa105fd587d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:58.781115 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd89e3a-1a5c-4eef-8d23-91b7ab4789f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:58.782063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd89e3a-1a5c-4eef-8d23-91b7ab4789f1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:58.782348 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd89e3a-1a5c-4eef-8d23-91b7ab4789f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:58.782624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd89e3a-1a5c-4eef-8d23-91b7ab4789f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:58.790658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8b951-4db0-4f53-8fd9-00c68bf90916 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:58.796343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd89e3a-1a5c-4eef-8d23-91b7ab4789f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:58.797966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd89e3a-1a5c-4eef-8d23-91b7ab4789f1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:58.819557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-1dd89e3a-1a5c-4eef-8d23-91b7ab4789f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:15:58.819557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:15:58.819557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:15:58.819557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:15:58.819557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:15:58.819557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:15:58.819557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:15:58.819557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:15:58.819557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:15:58.819557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:15:58.819557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:15:58.819557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:15:58.819557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:15:58.819557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:15:58.819557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:15:58.821545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:15:58.822949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:15:58.822949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:15:58.822949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:15:58.822949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:15:58.822949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 17/36] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:15:58.829959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd89e3a-1a5c-4eef-8d23-91b7ab4789f1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:58.830997 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:58.868389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58958b-1a98-4940-bdac-b1639051ee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:58.869309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58958b-1a98-4940-bdac-b1639051ee01 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:58.869592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58958b-1a98-4940-bdac-b1639051ee01 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:58.869873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58958b-1a98-4940-bdac-b1639051ee01 None admin] PATH_INFO: `/v3/domains/default/users/23d4803e5e4a4ff6aed2456c309e3051/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:58.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58958b-1a98-4940-bdac-b1639051ee01 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=23d4803e5e4a4ff6aed2456c309e3051, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:58.878190 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58958b-1a98-4940-bdac-b1639051ee01 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:58.907431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 20/37] 10.222.0.64 () {58 vars in 1361 bytes} [Thu Jul 21 08:15:58 2022] PUT /identity/v3/domains/default/users/23d4803e5e4a4ff6aed2456c309e3051/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:15:58.909093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cfd2e-6055-4314-8dbe-640195a49ca7 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:58.909393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cfd2e-6055-4314-8dbe-640195a49ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:58.909674 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cfd2e-6055-4314-8dbe-640195a49ca7 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:58.911282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 21/38] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:58.912811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13101b93-2257-47b9-ac99-30cdb6eddf1c None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:58.913116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13101b93-2257-47b9-ac99-30cdb6eddf1c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:58.913440 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13101b93-2257-47b9-ac99-30cdb6eddf1c None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:58.915093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 22/39] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:58.925746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7bab0-8e50-4d9e-8a29-0f1a6fa1bd37 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:58.926210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7bab0-8e50-4d9e-8a29-0f1a6fa1bd37 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:58.926447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7bab0-8e50-4d9e-8a29-0f1a6fa1bd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:58.948844 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:58.964750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-14a7bab0-8e50-4d9e-8a29-0f1a6fa1bd37 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:58.967635 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-14a7bab0-8e50-4d9e-8a29-0f1a6fa1bd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:58.969344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd89e3a-1a5c-4eef-8d23-91b7ab4789f1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:59.026870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62647aa6-a572-4cf4-ba37-4c90f3144830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:59.026870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62647aa6-a572-4cf4-ba37-4c90f3144830 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:59.026870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62647aa6-a572-4cf4-ba37-4c90f3144830 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:59.026870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62647aa6-a572-4cf4-ba37-4c90f3144830 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:59.027231 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62647aa6-a572-4cf4-ba37-4c90f3144830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:59.027231 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62647aa6-a572-4cf4-ba37-4c90f3144830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:59.027549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62647aa6-a572-4cf4-ba37-4c90f3144830 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:59.043814 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 18/40] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:59.045252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6630d-e672-4fdd-8acd-cb4285279864 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:59.045732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6630d-e672-4fdd-8acd-cb4285279864 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:59.045832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6630d-e672-4fdd-8acd-cb4285279864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:59.067053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-53b6630d-e672-4fdd-8acd-cb4285279864 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:59.067773 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 23/41] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:15:59.068349 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-53b6630d-e672-4fdd-8acd-cb4285279864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:59.069180 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7bab0-8e50-4d9e-8a29-0f1a6fa1bd37 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:59.148152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 19/42] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:15:59.149058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6630d-e672-4fdd-8acd-cb4285279864 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:59.186579 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7bab0-8e50-4d9e-8a29-0f1a6fa1bd37 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:59.203402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:59.228350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460f01a-d09e-44ed-abc2-9e004a564300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:59.229287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460f01a-d09e-44ed-abc2-9e004a564300 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:59.229811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460f01a-d09e-44ed-abc2-9e004a564300 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:59.230102 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460f01a-d09e-44ed-abc2-9e004a564300 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:59.230824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460f01a-d09e-44ed-abc2-9e004a564300 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:59.231831 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:59.233069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460f01a-d09e-44ed-abc2-9e004a564300 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:59.256555 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6630d-e672-4fdd-8acd-cb4285279864 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:59.275681 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 24/43] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 08:15:59 2022] POST /identity/v3/projects => generated 301 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:15:59.275681 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460f01a-d09e-44ed-abc2-9e004a564300 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:59.311955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f001ad7-6310-4a29-ae72-aca0b53b5d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:59.312869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f001ad7-6310-4a29-ae72-aca0b53b5d17 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:59.313227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f001ad7-6310-4a29-ae72-aca0b53b5d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:59.313576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f001ad7-6310-4a29-ae72-aca0b53b5d17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:59.315115 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f001ad7-6310-4a29-ae72-aca0b53b5d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:59.316809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f001ad7-6310-4a29-ae72-aca0b53b5d17 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:59.318812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 20/44] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:15:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:59.328702 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f001ad7-6310-4a29-ae72-aca0b53b5d17 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:59.458467 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f001ad7-6310-4a29-ae72-aca0b53b5d17 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:59.500518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0cfd5-649c-41bf-b475-ae4d175b4cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:59.501442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0cfd5-649c-41bf-b475-ae4d175b4cd0 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:59.501881 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0cfd5-649c-41bf-b475-ae4d175b4cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:59.502162 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0cfd5-649c-41bf-b475-ae4d175b4cd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:59.502898 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0cfd5-649c-41bf-b475-ae4d175b4cd0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:59.504402 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0cfd5-649c-41bf-b475-ae4d175b4cd0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:59.523454 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:59.531019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460f01a-d09e-44ed-abc2-9e004a564300 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:59.541063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 21/45] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 08:15:59 2022] POST /identity/v3/projects => generated 312 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:15:59.570803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0c046-be0c-4421-aad3-89991fec755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:59.571453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0c046-be0c-4421-aad3-89991fec755c None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:59.571777 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0c046-be0c-4421-aad3-89991fec755c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:59.572056 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0c046-be0c-4421-aad3-89991fec755c None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:59.572832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0c046-be0c-4421-aad3-89991fec755c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:59.574282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0c046-be0c-4421-aad3-89991fec755c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:59.597250 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 25/46] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 21 08:15:59 2022] POST /identity/v3/roles => generated 223 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:16:01.010076 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f572-efa8-4e6f-9e20-c2901e86b338 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:01.010627 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f572-efa8-4e6f-9e20-c2901e86b338 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:01.010627 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f572-efa8-4e6f-9e20-c2901e86b338 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:01.012160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 22/47] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:01.017895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d7a0f-dd25-4af9-9f4a-0f9f927b4eff None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:01.018336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d7a0f-dd25-4af9-9f4a-0f9f927b4eff None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:01.018423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d7a0f-dd25-4af9-9f4a-0f9f927b4eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:01.036497 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f85d7a0f-dd25-4af9-9f4a-0f9f927b4eff None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:01.037689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f85d7a0f-dd25-4af9-9f4a-0f9f927b4eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:01.058963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:01.109345 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 26/48] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:01.132848 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f572-efa8-4e6f-9e20-c2901e86b338 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:01.239812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f572-efa8-4e6f-9e20-c2901e86b338 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:01.274281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb3bfb-5065-4301-af76-7a250083b837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:01.275007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb3bfb-5065-4301-af76-7a250083b837 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:01.275290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb3bfb-5065-4301-af76-7a250083b837 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:01.275565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb3bfb-5065-4301-af76-7a250083b837 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:01.288076 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb3bfb-5065-4301-af76-7a250083b837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-f5eb3bfb-5065-4301-af76-7a250083b837 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:01.296854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:01.297895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:01.298839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:01.298839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:01.298839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:01.298839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:01.298839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:01.298839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:01.298839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:01.298839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:01.298839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:01.298839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:01.298839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:01.298839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:01.298839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 23/49] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:16:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:01.305805 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d7a0f-dd25-4af9-9f4a-0f9f927b4eff None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:01.405864 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d7a0f-dd25-4af9-9f4a-0f9f927b4eff None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:01.440765 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2dff5-23e7-4f18-bdbd-502d7017bad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:01.441439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2dff5-23e7-4f18-bdbd-502d7017bad8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:01.441719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2dff5-23e7-4f18-bdbd-502d7017bad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:01.441992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2dff5-23e7-4f18-bdbd-502d7017bad8 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:01.442741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2dff5-23e7-4f18-bdbd-502d7017bad8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:01.443042 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2dff5-23e7-4f18-bdbd-502d7017bad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:01.444625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2dff5-23e7-4f18-bdbd-502d7017bad8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:01.453898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 27/50] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:01.459855 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb3bfb-5065-4301-af76-7a250083b837 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:01.516768 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:01.560756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb3bfb-5065-4301-af76-7a250083b837 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:01.594634 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cc6ab-da97-422e-863c-69d22bbf5c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:01.595823 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cc6ab-da97-422e-863c-69d22bbf5c09 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:01.596110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cc6ab-da97-422e-863c-69d22bbf5c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:01.596388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cc6ab-da97-422e-863c-69d22bbf5c09 None admin] PATH_INFO: `/v3/users/23d4803e5e4a4ff6aed2456c309e3051` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:01.597324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b883c6-752f-4169-9927-cba6221bf4cb None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:01.597615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b883c6-752f-4169-9927-cba6221bf4cb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:01.597874 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cc6ab-da97-422e-863c-69d22bbf5c09 None admin] RBAC: Authorizing `identity:get_user(user_id=23d4803e5e4a4ff6aed2456c309e3051)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:01.597963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b883c6-752f-4169-9927-cba6221bf4cb None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:01.599302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 28/51] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:01.599443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cc6ab-da97-422e-863c-69d22bbf5c09 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:01.601197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 24/52] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:01 2022] GET /identity/v3/users/23d4803e5e4a4ff6aed2456c309e3051 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:01.604692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912961a-06d4-4e52-bd76-5d4d1d21eb93 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:01.605070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912961a-06d4-4e52-bd76-5d4d1d21eb93 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:01.605364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912961a-06d4-4e52-bd76-5d4d1d21eb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:01.606289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cc6ab-da97-422e-863c-69d22bbf5c09 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:01.622616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f912961a-06d4-4e52-bd76-5d4d1d21eb93 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:01.623869 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f912961a-06d4-4e52-bd76-5d4d1d21eb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:01.637133 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:01.693038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 29/53] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:01.705433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cc6ab-da97-422e-863c-69d22bbf5c09 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:01.716278 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912961a-06d4-4e52-bd76-5d4d1d21eb93 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:01.727920 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:01.739201 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d189f-4c69-4644-837d-91a70483e581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:01.740058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d189f-4c69-4644-837d-91a70483e581 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:01.740341 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d189f-4c69-4644-837d-91a70483e581 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:01.740631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d189f-4c69-4644-837d-91a70483e581 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:01.741875 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d189f-4c69-4644-837d-91a70483e581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:01.743361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d189f-4c69-4644-837d-91a70483e581 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:01.745044 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 25/54] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:01.750902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d189f-4c69-4644-837d-91a70483e581 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:01.826727 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912961a-06d4-4e52-bd76-5d4d1d21eb93 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:01.864428 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9111bb5-7056-4fa4-98bd-2a04c950e98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:01.865247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9111bb5-7056-4fa4-98bd-2a04c950e98c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:01.865533 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9111bb5-7056-4fa4-98bd-2a04c950e98c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:01.865842 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9111bb5-7056-4fa4-98bd-2a04c950e98c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:01.867114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9111bb5-7056-4fa4-98bd-2a04c950e98c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:01.868629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9111bb5-7056-4fa4-98bd-2a04c950e98c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:01.870264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 30/55] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:01.876390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9111bb5-7056-4fa4-98bd-2a04c950e98c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:01.894057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:01.960056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d189f-4c69-4644-837d-91a70483e581 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:01.974646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9111bb5-7056-4fa4-98bd-2a04c950e98c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:01.996465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c04481-253b-455c-a751-6e14ccc5efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:01.997506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c04481-253b-455c-a751-6e14ccc5efaf None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:01.997841 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c04481-253b-455c-a751-6e14ccc5efaf None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:01.998190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c04481-253b-455c-a751-6e14ccc5efaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:01.999106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c04481-253b-455c-a751-6e14ccc5efaf None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.domain.id=default, user.id=23d4803e5e4a4ff6aed2456c309e3051) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:01.999422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c04481-253b-455c-a751-6e14ccc5efaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:02.001100 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c04481-253b-455c-a751-6e14ccc5efaf None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:02.008743 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f009e-7248-40c6-9ff3-1eb88591b3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:02.009431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f009e-7248-40c6-9ff3-1eb88591b3c9 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:02.009720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f009e-7248-40c6-9ff3-1eb88591b3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:02.009938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 26/56] 10.222.0.64 () {56 vars in 1322 bytes} [Thu Jul 21 08:16:01 2022] GET /identity/v3/role_assignments?user.id=23d4803e5e4a4ff6aed2456c309e3051&scope.domain.id=default&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 530 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:02.010020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f009e-7248-40c6-9ff3-1eb88591b3c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:02.010712 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f009e-7248-40c6-9ff3-1eb88591b3c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:02.012214 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f009e-7248-40c6-9ff3-1eb88591b3c9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:02.046797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 31/57] 10.222.0.64 () {60 vars in 1140 bytes} [Thu Jul 21 08:16:01 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:16:04.085978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a8e44-ddc4-44f6-a3cf-7c025c5f3fd6 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:04.086870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a8e44-ddc4-44f6-a3cf-7c025c5f3fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:04.086870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a8e44-ddc4-44f6-a3cf-7c025c5f3fd6 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:04.089129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 27/58] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:04.097122 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89985d2-518f-4ab8-9566-a8c31448b893 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:04.097552 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89985d2-518f-4ab8-9566-a8c31448b893 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:04.097656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89985d2-518f-4ab8-9566-a8c31448b893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:04.117020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d89985d2-518f-4ab8-9566-a8c31448b893 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:04.120351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d89985d2-518f-4ab8-9566-a8c31448b893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:04.197763 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:04.205853 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 32/59] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:16:04.238086 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a8e44-ddc4-44f6-a3cf-7c025c5f3fd6 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:04.300136 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:04.352881 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a8e44-ddc4-44f6-a3cf-7c025c5f3fd6 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:04.389580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94774456-0a40-46d9-8407-36b066c3d851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:04.390375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94774456-0a40-46d9-8407-36b066c3d851 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:04.390658 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94774456-0a40-46d9-8407-36b066c3d851 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:04.390934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94774456-0a40-46d9-8407-36b066c3d851 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:04.392165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94774456-0a40-46d9-8407-36b066c3d851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:04.393634 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94774456-0a40-46d9-8407-36b066c3d851 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:04.395528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 28/60] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:04.401958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89985d2-518f-4ab8-9566-a8c31448b893 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:04.509578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89985d2-518f-4ab8-9566-a8c31448b893 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:04.546533 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b7de2-06b3-4863-9ae2-cdfe4b934542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:04.547213 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b7de2-06b3-4863-9ae2-cdfe4b934542 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:04.547502 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b7de2-06b3-4863-9ae2-cdfe4b934542 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:04.547819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b7de2-06b3-4863-9ae2-cdfe4b934542 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:04.548541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b7de2-06b3-4863-9ae2-cdfe4b934542 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:04.550008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b7de2-06b3-4863-9ae2-cdfe4b934542 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:04.580759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 33/61] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:16:04 2022] POST /identity/v3/users => generated 275 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:16:07.652400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c1d52-1ec8-46ca-8dcb-d3d368e68fbd None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:07.653460 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c1d52-1ec8-46ca-8dcb-d3d368e68fbd None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:07.654276 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c1d52-1ec8-46ca-8dcb-d3d368e68fbd None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:07.655910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 29/62] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:07.661290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c91d6-a63e-4588-bdd8-e6770c0bd8f2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:07.662133 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c91d6-a63e-4588-bdd8-e6770c0bd8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:07.662814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c91d6-a63e-4588-bdd8-e6770c0bd8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:07.684035 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4d2c91d6-a63e-4588-bdd8-e6770c0bd8f2 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:07.685550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4d2c91d6-a63e-4588-bdd8-e6770c0bd8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:07.751227 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:07.774230 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 34/63] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:07.811562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c1d52-1ec8-46ca-8dcb-d3d368e68fbd None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:07.872048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efd8ac-12eb-4447-85b3-a2e41dda05d6 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:07.872700 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efd8ac-12eb-4447-85b3-a2e41dda05d6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:07.873175 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efd8ac-12eb-4447-85b3-a2e41dda05d6 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:07.874767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 35/64] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:16:07.887190 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05a517-e9e8-44d8-8529-675cf0914b60 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:07.887792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05a517-e9e8-44d8-8529-675cf0914b60 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:07.888281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05a517-e9e8-44d8-8529-675cf0914b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:07.921334 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fa05a517-e9e8-44d8-8529-675cf0914b60 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:07.922982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fa05a517-e9e8-44d8-8529-675cf0914b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:07.971895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c1d52-1ec8-46ca-8dcb-d3d368e68fbd None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:08.023952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:08.033965 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 36/65] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:16:08.055720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391dc048-fe8b-4997-a011-f4625c4e5d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:08.056892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dc048-fe8b-4997-a011-f4625c4e5d95 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:08.057110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05a517-e9e8-44d8-8529-675cf0914b60 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:08.057209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dc048-fe8b-4997-a011-f4625c4e5d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:08.057456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dc048-fe8b-4997-a011-f4625c4e5d95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:08.084590 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391dc048-fe8b-4997-a011-f4625c4e5d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-391dc048-fe8b-4997-a011-f4625c4e5d95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:08.096502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:08.097382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:08.098164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:08.098164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:08.098164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:08.098164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:08.098164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:08.098164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:08.098164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:08.098164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:08.098164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:08.098164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:08.098164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:08.098164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:08.098164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 30/66] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:08.105003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391dc048-fe8b-4997-a011-f4625c4e5d95 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:08.166900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05a517-e9e8-44d8-8529-675cf0914b60 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:08.184027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:08.208470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb331c8c-2b33-478d-89d2-a4a768cc9e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:08.210780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb331c8c-2b33-478d-89d2-a4a768cc9e61 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:08.211448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb331c8c-2b33-478d-89d2-a4a768cc9e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:08.213605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb331c8c-2b33-478d-89d2-a4a768cc9e61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:08.229713 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb331c8c-2b33-478d-89d2-a4a768cc9e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-eb331c8c-2b33-478d-89d2-a4a768cc9e61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:08.239808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:08.240957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:08.241827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:08.241827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:08.241827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:08.241827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:08.241827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:08.241827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:08.241827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:08.241827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:08.241827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:08.241827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:08.241827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:08.241827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:08.241827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 37/67] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:16:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:16:08.243257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50660c-ff78-4ced-a499-ddc3b5b45189 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:08.243558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50660c-ff78-4ced-a499-ddc3b5b45189 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:08.243941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50660c-ff78-4ced-a499-ddc3b5b45189 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:08.245921 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 38/68] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:08.250874 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50660c-ff78-4ced-a499-ddc3b5b45189 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:08.293410 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391dc048-fe8b-4997-a011-f4625c4e5d95 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:08.332027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756f914-7bf4-45a1-97d6-0690e9f1afd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:08.332807 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756f914-7bf4-45a1-97d6-0690e9f1afd9 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:08.333067 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756f914-7bf4-45a1-97d6-0690e9f1afd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:08.333323 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756f914-7bf4-45a1-97d6-0690e9f1afd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:08.334126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756f914-7bf4-45a1-97d6-0690e9f1afd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:08.334586 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756f914-7bf4-45a1-97d6-0690e9f1afd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:08.336148 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756f914-7bf4-45a1-97d6-0690e9f1afd9 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:08.349303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 31/69] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:08.355105 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c481e-d1e2-450d-911b-46ee01b6854b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:08.355451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c481e-d1e2-450d-911b-46ee01b6854b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:08.355767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c481e-d1e2-450d-911b-46ee01b6854b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:08.369046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50660c-ff78-4ced-a499-ddc3b5b45189 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:08.372296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1a7c481e-d1e2-450d-911b-46ee01b6854b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:08.373487 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1a7c481e-d1e2-450d-911b-46ee01b6854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:08.407502 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770aa8b-ec26-49f8-b36a-490f3812a9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:08.408230 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770aa8b-ec26-49f8-b36a-490f3812a9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:08.408499 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770aa8b-ec26-49f8-b36a-490f3812a9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:08.408790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770aa8b-ec26-49f8-b36a-490f3812a9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:08.409551 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770aa8b-ec26-49f8-b36a-490f3812a9b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:08.409858 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770aa8b-ec26-49f8-b36a-490f3812a9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:08.411275 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770aa8b-ec26-49f8-b36a-490f3812a9b4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:08.416632 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:08.420214 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 39/70] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:08.421891 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17812077-3b42-487f-9637-007303a008ac None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:08.422164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17812077-3b42-487f-9637-007303a008ac None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:08.422441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17812077-3b42-487f-9637-007303a008ac None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:08.423750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 40/71] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:08.424373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17812077-3b42-487f-9637-007303a008ac None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:08.444152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 32/72] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:08.445504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed0726-4f85-42b3-ae40-811a02001f5d None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:08.445798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed0726-4f85-42b3-ae40-811a02001f5d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:08.448899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed0726-4f85-42b3-ae40-811a02001f5d None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:08.448899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 33/73] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:08.448899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed0726-4f85-42b3-ae40-811a02001f5d None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:08.466053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:08.539018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17812077-3b42-487f-9637-007303a008ac None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:08.563544 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed0726-4f85-42b3-ae40-811a02001f5d None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:08.575968 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28bc89-8ed4-44cb-9592-2518cd3c65c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:08.577046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28bc89-8ed4-44cb-9592-2518cd3c65c2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:08.577334 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28bc89-8ed4-44cb-9592-2518cd3c65c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:08.577605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28bc89-8ed4-44cb-9592-2518cd3c65c2 None admin] PATH_INFO: `/v3/users/13747340af1f46a1822347a891a6c5f5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:08.591764 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28bc89-8ed4-44cb-9592-2518cd3c65c2 None admin] RBAC: Authorizing `identity:get_user(user_id=13747340af1f46a1822347a891a6c5f5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:08.593289 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28bc89-8ed4-44cb-9592-2518cd3c65c2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:08.595014 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 41/74] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:08 2022] GET /identity/v3/users/13747340af1f46a1822347a891a6c5f5 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:08.598494 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfd485-c408-4754-b903-f90c8182ebf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:08.599401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfd485-c408-4754-b903-f90c8182ebf1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:08.600485 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfd485-c408-4754-b903-f90c8182ebf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:08.600761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfd485-c408-4754-b903-f90c8182ebf1 None admin] PATH_INFO: `/v3/users/23d4803e5e4a4ff6aed2456c309e3051` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:08.601039 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8035fb-59f0-42d3-acf2-6b559506a5e1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:08.601337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8035fb-59f0-42d3-acf2-6b559506a5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:08.601621 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8035fb-59f0-42d3-acf2-6b559506a5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:08.601966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfd485-c408-4754-b903-f90c8182ebf1 None admin] RBAC: Authorizing `identity:get_user(user_id=23d4803e5e4a4ff6aed2456c309e3051)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:08.603476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfd485-c408-4754-b903-f90c8182ebf1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:08.605157 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 34/75] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:08 2022] GET /identity/v3/users/23d4803e5e4a4ff6aed2456c309e3051 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:08.606305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58554f-84bd-47f2-bebf-605fc05f33d7 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:08.606607 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58554f-84bd-47f2-bebf-605fc05f33d7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:08.607071 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58554f-84bd-47f2-bebf-605fc05f33d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:08.618392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ee8035fb-59f0-42d3-acf2-6b559506a5e1 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:08.619630 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ee8035fb-59f0-42d3-acf2-6b559506a5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:08.624672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6e58554f-84bd-47f2-bebf-605fc05f33d7 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:08.626107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6e58554f-84bd-47f2-bebf-605fc05f33d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:08.666495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:08.686222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 42/76] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:08.686976 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8035fb-59f0-42d3-acf2-6b559506a5e1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:08.707619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 35/77] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:08.707619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58554f-84bd-47f2-bebf-605fc05f33d7 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:08.710661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:08.786047 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8035fb-59f0-42d3-acf2-6b559506a5e1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:08.805479 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58554f-84bd-47f2-bebf-605fc05f33d7 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:08.818753 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9ce03-88b8-4902-bf52-60d386a4357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:08.819609 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9ce03-88b8-4902-bf52-60d386a4357b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:08.819935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9ce03-88b8-4902-bf52-60d386a4357b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:08.820212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9ce03-88b8-4902-bf52-60d386a4357b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:08.830359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9ce03-88b8-4902-bf52-60d386a4357b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a3e9ce03-88b8-4902-bf52-60d386a4357b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:08.838422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:08.839469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:08.840400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:08.840400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:08.840400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:08.840400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:08.840400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:08.840400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:08.840400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:08.840400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:08.840400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:08.840400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:08.840400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:08.840400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:08.840400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 43/78] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:16:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:08.841207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b81a03-bbac-4dae-b703-03a82f2020c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:08.841845 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b81a03-bbac-4dae-b703-03a82f2020c9 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:08.842132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b81a03-bbac-4dae-b703-03a82f2020c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:08.842411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b81a03-bbac-4dae-b703-03a82f2020c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:08.844667 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9ce03-88b8-4902-bf52-60d386a4357b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:08.886841 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:08.912723 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b81a03-bbac-4dae-b703-03a82f2020c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:08.914213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b81a03-bbac-4dae-b703-03a82f2020c9 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:08.927000 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:08.942502 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9ce03-88b8-4902-bf52-60d386a4357b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:08.976652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527b9b6-6d81-46cc-b8d1-23c83c1be9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:08.977305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527b9b6-6d81-46cc-b8d1-23c83c1be9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:08.977583 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527b9b6-6d81-46cc-b8d1-23c83c1be9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:08.977864 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527b9b6-6d81-46cc-b8d1-23c83c1be9d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:09.012753 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 36/79] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:09.013606 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b81a03-bbac-4dae-b703-03a82f2020c9 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:09.046452 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527b9b6-6d81-46cc-b8d1-23c83c1be9d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:09.047995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527b9b6-6d81-46cc-b8d1-23c83c1be9d7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:09.088378 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:09.114905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b81a03-bbac-4dae-b703-03a82f2020c9 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:09.129977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:09.147647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 44/80] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:09.149787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a0b08-1a85-4e40-9735-cb7ac8b34b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:09.150600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a0b08-1a85-4e40-9735-cb7ac8b34b22 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:09.150885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a0b08-1a85-4e40-9735-cb7ac8b34b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:09.151165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a0b08-1a85-4e40-9735-cb7ac8b34b22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:09.152484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a0b08-1a85-4e40-9735-cb7ac8b34b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:09.152602 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527b9b6-6d81-46cc-b8d1-23c83c1be9d7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:09.153835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a0b08-1a85-4e40-9735-cb7ac8b34b22 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:09.155850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 37/81] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:09.156699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a0b08-1a85-4e40-9735-cb7ac8b34b22 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:09.253107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527b9b6-6d81-46cc-b8d1-23c83c1be9d7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:09.253399 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a0b08-1a85-4e40-9735-cb7ac8b34b22 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:09.287585 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196bdd8-b672-4d8e-bbbb-bc6772595bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:09.287782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa96ac-f3e0-48b9-bca2-0e2dbd9be86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:09.288271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196bdd8-b672-4d8e-bbbb-bc6772595bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:09.288477 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa96ac-f3e0-48b9-bca2-0e2dbd9be86d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:09.288586 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196bdd8-b672-4d8e-bbbb-bc6772595bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:09.288761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa96ac-f3e0-48b9-bca2-0e2dbd9be86d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:09.288844 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196bdd8-b672-4d8e-bbbb-bc6772595bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:09.289034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa96ac-f3e0-48b9-bca2-0e2dbd9be86d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:09.289564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196bdd8-b672-4d8e-bbbb-bc6772595bc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:09.289873 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196bdd8-b672-4d8e-bbbb-bc6772595bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:09.291271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196bdd8-b672-4d8e-bbbb-bc6772595bc8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:09.299100 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 38/82] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:09.299224 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa96ac-f3e0-48b9-bca2-0e2dbd9be86d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:09.299916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196bdd8-b672-4d8e-bbbb-bc6772595bc8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:09.305198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-04aa96ac-f3e0-48b9-bca2-0e2dbd9be86d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:09.307673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:09.308572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:09.309772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:09.309772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:09.309772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:09.309772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:09.309772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:09.309772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:09.309772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:09.309772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:09.309772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:09.309772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:09.309772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:09.309772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:09.309772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 45/83] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:09.310576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa96ac-f3e0-48b9-bca2-0e2dbd9be86d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:09.358648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:09.405876 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196bdd8-b672-4d8e-bbbb-bc6772595bc8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:09.414505 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa96ac-f3e0-48b9-bca2-0e2dbd9be86d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:09.439590 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a977f7-4a87-4ddd-bc2a-66409701c60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:09.440491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a977f7-4a87-4ddd-bc2a-66409701c60d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:09.440778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a977f7-4a87-4ddd-bc2a-66409701c60d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:09.441058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a977f7-4a87-4ddd-bc2a-66409701c60d None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:09.442277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a977f7-4a87-4ddd-bc2a-66409701c60d None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:09.443895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a977f7-4a87-4ddd-bc2a-66409701c60d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:09.445760 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 39/84] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:09 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:09.446513 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a977f7-4a87-4ddd-bc2a-66409701c60d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:09.450821 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecc35a-4a3e-49ce-b118-4b576cd8888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:09.453644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecc35a-4a3e-49ce-b118-4b576cd8888d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:09.453644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecc35a-4a3e-49ce-b118-4b576cd8888d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:09.453644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecc35a-4a3e-49ce-b118-4b576cd8888d None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:09.453644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecc35a-4a3e-49ce-b118-4b576cd8888d None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:09.455033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecc35a-4a3e-49ce-b118-4b576cd8888d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:09.457262 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 46/85] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:09 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:09.458071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecc35a-4a3e-49ce-b118-4b576cd8888d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:09.515150 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:09.545959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a977f7-4a87-4ddd-bc2a-66409701c60d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:09.558679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecc35a-4a3e-49ce-b118-4b576cd8888d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:09.571756 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:09.580143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a0af3-ffe8-4466-a392-037f53365c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:09.580832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a0af3-ffe8-4466-a392-037f53365c5c None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:09.581123 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a0af3-ffe8-4466-a392-037f53365c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:09.581403 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a0af3-ffe8-4466-a392-037f53365c5c None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:09.582138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a0af3-ffe8-4466-a392-037f53365c5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:09.583635 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a0af3-ffe8-4466-a392-037f53365c5c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:09.592565 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbe383-8746-46d8-9185-31725724d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:09.593427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbe383-8746-46d8-9185-31725724d6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:09.593713 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbe383-8746-46d8-9185-31725724d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:09.593996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbe383-8746-46d8-9185-31725724d6c9 None admin] PATH_INFO: `/v3/users/13747340af1f46a1822347a891a6c5f5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:09.595197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbe383-8746-46d8-9185-31725724d6c9 None admin] RBAC: Authorizing `identity:get_user(user_id=13747340af1f46a1822347a891a6c5f5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:09.596710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbe383-8746-46d8-9185-31725724d6c9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:09.598365 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 47/86] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:09 2022] GET /identity/v3/users/13747340af1f46a1822347a891a6c5f5 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:09.599121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbe383-8746-46d8-9185-31725724d6c9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:09.610880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 40/87] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:16:09 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:16:09.611584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a0af3-ffe8-4466-a392-037f53365c5c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:09.715801 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbe383-8746-46d8-9185-31725724d6c9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:09.741646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a0af3-ffe8-4466-a392-037f53365c5c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:09.754069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b26aa-116a-4f85-8009-c13aea630b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:09.754769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b26aa-116a-4f85-8009-c13aea630b91 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:09.755059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b26aa-116a-4f85-8009-c13aea630b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:09.755339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b26aa-116a-4f85-8009-c13aea630b91 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:09.756291 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b26aa-116a-4f85-8009-c13aea630b91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:09.756655 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b26aa-116a-4f85-8009-c13aea630b91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:09.758212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b26aa-116a-4f85-8009-c13aea630b91 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:09.767395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 48/88] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:09.773361 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b26aa-116a-4f85-8009-c13aea630b91 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:09.774729 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:09.786268 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e2192-b5d3-4dc3-ac8e-329d634be79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:09.786942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e2192-b5d3-4dc3-ac8e-329d634be79b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:09.787280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e2192-b5d3-4dc3-ac8e-329d634be79b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:09.787561 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e2192-b5d3-4dc3-ac8e-329d634be79b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:09.788448 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e2192-b5d3-4dc3-ac8e-329d634be79b None admin] RBAC: Adding query filter params (role.id=3fb4236a239b47e3ac59e14b3db524b1, scope.project.id=43279107ea034f0ab0fb5daa09dd0e92, user.id=13747340af1f46a1822347a891a6c5f5) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:09.788758 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e2192-b5d3-4dc3-ac8e-329d634be79b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:09.790238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e2192-b5d3-4dc3-ac8e-329d634be79b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:09.797006 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 41/89] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:09 2022] GET /identity/v3/role_assignments?user.id=13747340af1f46a1822347a891a6c5f5&scope.project.id=43279107ea034f0ab0fb5daa09dd0e92&role.id=3fb4236a239b47e3ac59e14b3db524b1 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:09.797900 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e2192-b5d3-4dc3-ac8e-329d634be79b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:09.829163 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:09.917711 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b26aa-116a-4f85-8009-c13aea630b91 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:09.935262 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e2192-b5d3-4dc3-ac8e-329d634be79b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:09.961268 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233e042-b257-44b5-bfae-a409af1ff206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:09.962312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233e042-b257-44b5-bfae-a409af1ff206 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:09.962816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233e042-b257-44b5-bfae-a409af1ff206 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:09.963289 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233e042-b257-44b5-bfae-a409af1ff206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:09.964372 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233e042-b257-44b5-bfae-a409af1ff206 None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=43279107ea034f0ab0fb5daa09dd0e92, user.id=23d4803e5e4a4ff6aed2456c309e3051) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:09.964884 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233e042-b257-44b5-bfae-a409af1ff206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:09.966571 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233e042-b257-44b5-bfae-a409af1ff206 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:09.974498 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 49/90] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:09 2022] GET /identity/v3/role_assignments?user.id=23d4803e5e4a4ff6aed2456c309e3051&scope.project.id=43279107ea034f0ab0fb5daa09dd0e92&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:09.974962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb1362-0366-44d2-be56-d8929b27ce3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:09.975654 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb1362-0366-44d2-be56-d8929b27ce3c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:09.975943 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb1362-0366-44d2-be56-d8929b27ce3c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:09.976221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb1362-0366-44d2-be56-d8929b27ce3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:09.976661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233e042-b257-44b5-bfae-a409af1ff206 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:10.057551 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:10.067317 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb1362-0366-44d2-be56-d8929b27ce3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:10.070390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb1362-0366-44d2-be56-d8929b27ce3c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:10.116035 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233e042-b257-44b5-bfae-a409af1ff206 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:10.125886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:10.165014 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c87d49-1801-478a-9ac9-3752b3e9be1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:10.166462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c87d49-1801-478a-9ac9-3752b3e9be1b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:10.166815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c87d49-1801-478a-9ac9-3752b3e9be1b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:10.167405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c87d49-1801-478a-9ac9-3752b3e9be1b None admin] PATH_INFO: `/v3/users/13747340af1f46a1822347a891a6c5f5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:10.168929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c87d49-1801-478a-9ac9-3752b3e9be1b None admin] RBAC: Authorizing `identity:get_user(user_id=13747340af1f46a1822347a891a6c5f5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:10.170752 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c87d49-1801-478a-9ac9-3752b3e9be1b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:10.172609 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 50/91] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:09 2022] GET /identity/v3/users/13747340af1f46a1822347a891a6c5f5 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:10.178225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c87d49-1801-478a-9ac9-3752b3e9be1b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:10.190486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 42/92] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:10.196817 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb1362-0366-44d2-be56-d8929b27ce3c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:10.292584 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c87d49-1801-478a-9ac9-3752b3e9be1b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:10.332861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df02a7-b0ff-4a4d-8626-3cc692dd6a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:10.333538 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df02a7-b0ff-4a4d-8626-3cc692dd6a15 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:10.339620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df02a7-b0ff-4a4d-8626-3cc692dd6a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:10.339620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df02a7-b0ff-4a4d-8626-3cc692dd6a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:10.351643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:10.364044 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb1362-0366-44d2-be56-d8929b27ce3c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:10.402194 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:10.424430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426012bf-3b7e-478a-83a5-8f01eb61f544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:10.425509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426012bf-3b7e-478a-83a5-8f01eb61f544 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:10.425794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426012bf-3b7e-478a-83a5-8f01eb61f544 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:10.426070 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426012bf-3b7e-478a-83a5-8f01eb61f544 None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:10.427280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426012bf-3b7e-478a-83a5-8f01eb61f544 None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:10.429624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426012bf-3b7e-478a-83a5-8f01eb61f544 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:10.431690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 43/93] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:10 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:10.437639 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426012bf-3b7e-478a-83a5-8f01eb61f544 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:10.473838 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df02a7-b0ff-4a4d-8626-3cc692dd6a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:10.475406 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df02a7-b0ff-4a4d-8626-3cc692dd6a15 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:10.590684 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426012bf-3b7e-478a-83a5-8f01eb61f544 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:10.643956 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514f015-2716-48ff-9b4d-bfe4e34c658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:10.644670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514f015-2716-48ff-9b4d-bfe4e34c658c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:10.644956 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514f015-2716-48ff-9b4d-bfe4e34c658c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:10.645232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514f015-2716-48ff-9b4d-bfe4e34c658c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:10.646603 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514f015-2716-48ff-9b4d-bfe4e34c658c None admin] RBAC: Adding query filter params (role.id=18bb65296a9c487faf3b57d2b4246578, scope.project.id=43279107ea034f0ab0fb5daa09dd0e92, user.id=13747340af1f46a1822347a891a6c5f5) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:10.646932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514f015-2716-48ff-9b4d-bfe4e34c658c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:10.648498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514f015-2716-48ff-9b4d-bfe4e34c658c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:10.655687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 44/94] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:10 2022] GET /identity/v3/role_assignments?user.id=13747340af1f46a1822347a891a6c5f5&scope.project.id=43279107ea034f0ab0fb5daa09dd0e92&role.id=18bb65296a9c487faf3b57d2b4246578 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:10.706799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 51/95] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:10.712890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514f015-2716-48ff-9b4d-bfe4e34c658c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:10.751776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:10.844586 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514f015-2716-48ff-9b4d-bfe4e34c658c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:10.892490 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5d3ce-7791-4c9a-81e0-1c10261b727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:10.893433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5d3ce-7791-4c9a-81e0-1c10261b727f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:10.893717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5d3ce-7791-4c9a-81e0-1c10261b727f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:10.893993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5d3ce-7791-4c9a-81e0-1c10261b727f None admin] PATH_INFO: `/v3/projects/b22bb393beaf425dbe69f2219534fe64` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:10.895209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5d3ce-7791-4c9a-81e0-1c10261b727f None admin] RBAC: Authorizing `identity:get_project(project_id=b22bb393beaf425dbe69f2219534fe64)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:10.896840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5d3ce-7791-4c9a-81e0-1c10261b727f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:10.898585 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 45/96] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:10 2022] GET /identity/v3/projects/b22bb393beaf425dbe69f2219534fe64 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:10.904991 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df02a7-b0ff-4a4d-8626-3cc692dd6a15 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:11.008783 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:11.039999 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df02a7-b0ff-4a4d-8626-3cc692dd6a15 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:11.085763 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2097a6-e697-49fd-a94e-05caf61ea4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:11.086439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2097a6-e697-49fd-a94e-05caf61ea4be None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:11.086722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2097a6-e697-49fd-a94e-05caf61ea4be None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:11.087001 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2097a6-e697-49fd-a94e-05caf61ea4be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:11.087868 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2097a6-e697-49fd-a94e-05caf61ea4be None admin] RBAC: Adding query filter params (role.id=3fb4236a239b47e3ac59e14b3db524b1, scope.project.id=b22bb393beaf425dbe69f2219534fe64, user.id=13747340af1f46a1822347a891a6c5f5) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:11.088182 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2097a6-e697-49fd-a94e-05caf61ea4be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:11.089650 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2097a6-e697-49fd-a94e-05caf61ea4be None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:11.099987 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 52/97] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:10 2022] GET /identity/v3/role_assignments?user.id=13747340af1f46a1822347a891a6c5f5&scope.project.id=b22bb393beaf425dbe69f2219534fe64&role.id=3fb4236a239b47e3ac59e14b3db524b1 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:12.616918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804b952-e828-41bd-85d1-78b11efda915 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:12.617944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804b952-e828-41bd-85d1-78b11efda915 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:12.618427 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804b952-e828-41bd-85d1-78b11efda915 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:12.620049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 46/98] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:12.625667 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4d5f6-a4e3-4f79-8c92-215a1cee5ca8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:12.626478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4d5f6-a4e3-4f79-8c92-215a1cee5ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:12.626946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4d5f6-a4e3-4f79-8c92-215a1cee5ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:12.652607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3aa4d5f6-a4e3-4f79-8c92-215a1cee5ca8 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:12.654582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3aa4d5f6-a4e3-4f79-8c92-215a1cee5ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:12.750017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 53/99] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:12.785508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804b952-e828-41bd-85d1-78b11efda915 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:12.914757 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:12.928866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804b952-e828-41bd-85d1-78b11efda915 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:12.976859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052880fd-63ee-4b88-b1f7-9a15736ed92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:12.977683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052880fd-63ee-4b88-b1f7-9a15736ed92e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:12.977967 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052880fd-63ee-4b88-b1f7-9a15736ed92e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:12.978254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052880fd-63ee-4b88-b1f7-9a15736ed92e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:12.993886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052880fd-63ee-4b88-b1f7-9a15736ed92e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-052880fd-63ee-4b88-b1f7-9a15736ed92e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:13.001857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:13.002717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:13.003473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:13.003473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:13.003473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:13.003473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:13.003473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:13.003473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:13.003473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:13.003473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:13.003473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:13.003473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:13.003473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:13.003473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:13.003473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 47/100] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:13.010587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4d5f6-a4e3-4f79-8c92-215a1cee5ca8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:13.090456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:13.131552 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4d5f6-a4e3-4f79-8c92-215a1cee5ca8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:13.175426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fa612-1210-411e-be9f-8bcc28dcca3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:13.176142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fa612-1210-411e-be9f-8bcc28dcca3a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:13.176429 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fa612-1210-411e-be9f-8bcc28dcca3a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:13.176710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fa612-1210-411e-be9f-8bcc28dcca3a None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:13.177482 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fa612-1210-411e-be9f-8bcc28dcca3a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:13.177840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fa612-1210-411e-be9f-8bcc28dcca3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:13.179259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fa612-1210-411e-be9f-8bcc28dcca3a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:13.191268 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 54/101] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:13.196958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052880fd-63ee-4b88-b1f7-9a15736ed92e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:13.221423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd84bc-a983-4af3-8990-b5a441b719b7 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:13.221757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd84bc-a983-4af3-8990-b5a441b719b7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:13.221993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd84bc-a983-4af3-8990-b5a441b719b7 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:13.223899 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 55/102] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:13.230128 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb70518-4edf-475f-8107-a1bd6db1beaa None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:13.230726 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb70518-4edf-475f-8107-a1bd6db1beaa None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:13.231249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb70518-4edf-475f-8107-a1bd6db1beaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:13.249155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3bb70518-4edf-475f-8107-a1bd6db1beaa None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:13.250673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3bb70518-4edf-475f-8107-a1bd6db1beaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:13.330787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052880fd-63ee-4b88-b1f7-9a15736ed92e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:13.350436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 56/103] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:16:13.350436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801ad8c-0f63-4ec4-ae22-f984c9852824 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:13.350436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801ad8c-0f63-4ec4-ae22-f984c9852824 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:13.350436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801ad8c-0f63-4ec4-ae22-f984c9852824 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:13.350436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 57/104] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:13.351461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d63f8-10f3-402a-a2ca-dbaa215659bf None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:13.352005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d63f8-10f3-402a-a2ca-dbaa215659bf None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:13.352005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d63f8-10f3-402a-a2ca-dbaa215659bf None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:13.354088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 58/105] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:13.359110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242903c-e536-4656-8cfd-dae5e6f1bca7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:13.359110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242903c-e536-4656-8cfd-dae5e6f1bca7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:13.359110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242903c-e536-4656-8cfd-dae5e6f1bca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:13.383093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9242903c-e536-4656-8cfd-dae5e6f1bca7 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:13.386197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9242903c-e536-4656-8cfd-dae5e6f1bca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:13.393648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e5e57-98d4-4c7d-811b-73b75ac894e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:13.394858 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e5e57-98d4-4c7d-811b-73b75ac894e5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:13.395359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e5e57-98d4-4c7d-811b-73b75ac894e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:13.395898 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e5e57-98d4-4c7d-811b-73b75ac894e5 None admin] PATH_INFO: `/v3/users/f2b30a14f84442c4a6f9db62e19c24e6` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:13.414443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e5e57-98d4-4c7d-811b-73b75ac894e5 None admin] RBAC: Authorizing `identity:get_user(user_id=f2b30a14f84442c4a6f9db62e19c24e6)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:13.416335 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e5e57-98d4-4c7d-811b-73b75ac894e5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:13.418662 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 48/106] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:13 2022] GET /identity/v3/users/f2b30a14f84442c4a6f9db62e19c24e6 => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:13.420325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519d6e5-95e5-498f-a805-6f15781f2912 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:13.420845 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519d6e5-95e5-498f-a805-6f15781f2912 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:13.421317 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519d6e5-95e5-498f-a805-6f15781f2912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:13.438916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1519d6e5-95e5-498f-a805-6f15781f2912 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:13.440479 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1519d6e5-95e5-498f-a805-6f15781f2912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:13.443940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:13.450313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:13.464733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 59/107] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:13.465436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242903c-e536-4656-8cfd-dae5e6f1bca7 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:13.525008 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 49/108] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:13.526272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519d6e5-95e5-498f-a805-6f15781f2912 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:13.596404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242903c-e536-4656-8cfd-dae5e6f1bca7 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:13.630884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519d6e5-95e5-498f-a805-6f15781f2912 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:13.632868 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477aff33-c571-48a2-8a3a-ced13832e386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:13.633695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aff33-c571-48a2-8a3a-ced13832e386 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:13.633987 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aff33-c571-48a2-8a3a-ced13832e386 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:13.634261 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aff33-c571-48a2-8a3a-ced13832e386 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:13.645781 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477aff33-c571-48a2-8a3a-ced13832e386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-477aff33-c571-48a2-8a3a-ced13832e386 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:13.654492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:13.655451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:13.657187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:13.657187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:13.657187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:13.657187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:13.657187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:13.657187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:13.657187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:13.657187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:13.657187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:13.657187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:13.657187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:13.657187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:13.657187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 60/109] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:13.657187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477aff33-c571-48a2-8a3a-ced13832e386 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:13.673458 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda77ed-4251-4364-9a8f-36dc466fd31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:13.674348 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda77ed-4251-4364-9a8f-36dc466fd31e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:13.674773 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda77ed-4251-4364-9a8f-36dc466fd31e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:13.675204 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda77ed-4251-4364-9a8f-36dc466fd31e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:13.686238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:13.711649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:13.746853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda77ed-4251-4364-9a8f-36dc466fd31e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:13.748363 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda77ed-4251-4364-9a8f-36dc466fd31e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:13.767484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477aff33-c571-48a2-8a3a-ced13832e386 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:13.804754 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9c00c-1e0a-4e6a-b4bf-7b5adf9ca590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:13.805559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9c00c-1e0a-4e6a-b4bf-7b5adf9ca590 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:13.805851 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9c00c-1e0a-4e6a-b4bf-7b5adf9ca590 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:13.806131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9c00c-1e0a-4e6a-b4bf-7b5adf9ca590 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:13.817594 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9c00c-1e0a-4e6a-b4bf-7b5adf9ca590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-39b9c00c-1e0a-4e6a-b4bf-7b5adf9ca590 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:13.825797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:13.826791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:13.827889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:13.827889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:13.827889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:13.827889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:13.827889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:13.827889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:13.827889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:13.827889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:13.827889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:13.827889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:13.827889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:13.827889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:13.827889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 61/110] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:16:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:13.827889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9c00c-1e0a-4e6a-b4bf-7b5adf9ca590 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:13.866046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 50/111] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:13.867786 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fe6e5-1d3e-4486-999c-26d96a8f8b8a None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:13.868234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fe6e5-1d3e-4486-999c-26d96a8f8b8a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:13.868647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fe6e5-1d3e-4486-999c-26d96a8f8b8a None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:13.870347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 51/112] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:13.871553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fe6e5-1d3e-4486-999c-26d96a8f8b8a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:13.917644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:13.944722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9c00c-1e0a-4e6a-b4bf-7b5adf9ca590 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:13.956089 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:13.980091 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fe6e5-1d3e-4486-999c-26d96a8f8b8a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:13.981138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0712f2-4697-46e7-87d1-65a425916d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:13.981948 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0712f2-4697-46e7-87d1-65a425916d73 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:13.982227 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0712f2-4697-46e7-87d1-65a425916d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:13.982499 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0712f2-4697-46e7-87d1-65a425916d73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:13.983688 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0712f2-4697-46e7-87d1-65a425916d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:13.985166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0712f2-4697-46e7-87d1-65a425916d73 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:13.986789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 62/113] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:13.987552 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0712f2-4697-46e7-87d1-65a425916d73 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:14.016077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba76d8f-618c-4fa0-971c-843b9532eece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:14.016750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba76d8f-618c-4fa0-971c-843b9532eece None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:14.017031 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba76d8f-618c-4fa0-971c-843b9532eece None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:14.017304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba76d8f-618c-4fa0-971c-843b9532eece None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:14.018061 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba76d8f-618c-4fa0-971c-843b9532eece None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:14.018373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba76d8f-618c-4fa0-971c-843b9532eece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:14.019798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba76d8f-618c-4fa0-971c-843b9532eece None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:14.027887 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 52/114] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:14.029200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba76d8f-618c-4fa0-971c-843b9532eece None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:14.089328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0712f2-4697-46e7-87d1-65a425916d73 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:14.122896 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaabd2-5566-441b-a192-c05b8b0df995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:14.123499 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaabd2-5566-441b-a192-c05b8b0df995 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:14.123618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba76d8f-618c-4fa0-971c-843b9532eece None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:14.123832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaabd2-5566-441b-a192-c05b8b0df995 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:14.124117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaabd2-5566-441b-a192-c05b8b0df995 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:14.124871 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaabd2-5566-441b-a192-c05b8b0df995 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:14.125188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaabd2-5566-441b-a192-c05b8b0df995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:14.125309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:14.126599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaabd2-5566-441b-a192-c05b8b0df995 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:14.135706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 63/115] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:14.136947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004c2fc-0f67-40b9-b858-c8ed14c0d65a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:14.137242 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004c2fc-0f67-40b9-b858-c8ed14c0d65a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:14.137526 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004c2fc-0f67-40b9-b858-c8ed14c0d65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:14.154048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8004c2fc-0f67-40b9-b858-c8ed14c0d65a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:14.155271 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8004c2fc-0f67-40b9-b858-c8ed14c0d65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:14.164127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4aa5d-58ff-4281-a7c5-15def6002b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:14.165012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4aa5d-58ff-4281-a7c5-15def6002b5f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:14.165290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4aa5d-58ff-4281-a7c5-15def6002b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:14.165626 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4aa5d-58ff-4281-a7c5-15def6002b5f None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:14.166828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4aa5d-58ff-4281-a7c5-15def6002b5f None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:14.168403 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4aa5d-58ff-4281-a7c5-15def6002b5f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:14.170145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 53/116] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:14 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:14.170145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1a69b-42a4-46c2-8025-2be5ca97b6c6 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:14.170145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1a69b-42a4-46c2-8025-2be5ca97b6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:14.170145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1a69b-42a4-46c2-8025-2be5ca97b6c6 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:14.170145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 54/117] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:14.170145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1a69b-42a4-46c2-8025-2be5ca97b6c6 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:14.197266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:14.235145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 64/118] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:14.236118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004c2fc-0f67-40b9-b858-c8ed14c0d65a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:14.282523 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1a69b-42a4-46c2-8025-2be5ca97b6c6 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:14.315334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2b0b5-7ef6-4c79-9fca-709a800a7843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:14.316031 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2b0b5-7ef6-4c79-9fca-709a800a7843 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:14.316312 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2b0b5-7ef6-4c79-9fca-709a800a7843 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:14.316586 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2b0b5-7ef6-4c79-9fca-709a800a7843 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:14.317296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2b0b5-7ef6-4c79-9fca-709a800a7843 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:14.319008 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2b0b5-7ef6-4c79-9fca-709a800a7843 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:14.344540 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004c2fc-0f67-40b9-b858-c8ed14c0d65a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:14.345135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 55/119] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 08:16:14 2022] POST /identity/v3/projects => generated 302 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:16:14.346145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2b0b5-7ef6-4c79-9fca-709a800a7843 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:14.380176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:14.400699 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd3dcc-6e68-45b5-967a-f09abe2c42bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:14.401610 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd3dcc-6e68-45b5-967a-f09abe2c42bc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:14.401906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd3dcc-6e68-45b5-967a-f09abe2c42bc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:14.402186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd3dcc-6e68-45b5-967a-f09abe2c42bc None admin] PATH_INFO: `/v3/users/13747340af1f46a1822347a891a6c5f5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:14.404084 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd3dcc-6e68-45b5-967a-f09abe2c42bc None admin] RBAC: Authorizing `identity:get_user(user_id=13747340af1f46a1822347a891a6c5f5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:14.405644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd3dcc-6e68-45b5-967a-f09abe2c42bc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:14.407405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 65/120] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:14 2022] GET /identity/v3/users/13747340af1f46a1822347a891a6c5f5 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:14.412661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd3dcc-6e68-45b5-967a-f09abe2c42bc None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:14.469307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:14.486334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2b0b5-7ef6-4c79-9fca-709a800a7843 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:14.531341 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4363707-6dda-4a70-baa7-85142794f093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:14.532264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4363707-6dda-4a70-baa7-85142794f093 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:14.532540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4363707-6dda-4a70-baa7-85142794f093 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:14.532869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4363707-6dda-4a70-baa7-85142794f093 None admin] PATH_INFO: `/v3/users/23d4803e5e4a4ff6aed2456c309e3051` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:14.535658 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4363707-6dda-4a70-baa7-85142794f093 None admin] RBAC: Authorizing `identity:get_user(user_id=23d4803e5e4a4ff6aed2456c309e3051)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:14.536701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4363707-6dda-4a70-baa7-85142794f093 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:14.538436 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 56/121] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:14 2022] GET /identity/v3/users/23d4803e5e4a4ff6aed2456c309e3051 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:14.539853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92210f-15f9-41bf-8d4a-4109ff9f1cb1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:14.540147 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92210f-15f9-41bf-8d4a-4109ff9f1cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:14.540431 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92210f-15f9-41bf-8d4a-4109ff9f1cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:14.543069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd3dcc-6e68-45b5-967a-f09abe2c42bc None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:14.558257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-7b92210f-15f9-41bf-8d4a-4109ff9f1cb1 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:14.559478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7b92210f-15f9-41bf-8d4a-4109ff9f1cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:14.581272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e8ab3-b79f-4a98-a419-11f13b2d84d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:14.582088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e8ab3-b79f-4a98-a419-11f13b2d84d7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:14.582369 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e8ab3-b79f-4a98-a419-11f13b2d84d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:14.582692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e8ab3-b79f-4a98-a419-11f13b2d84d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:14.583528 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e8ab3-b79f-4a98-a419-11f13b2d84d7 None admin] RBAC: Adding query filter params (role.id=e8fe982879094fdda82d271ad13509de, scope.project.id=43279107ea034f0ab0fb5daa09dd0e92, user.id=f2b30a14f84442c4a6f9db62e19c24e6) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:14.583962 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e8ab3-b79f-4a98-a419-11f13b2d84d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:14.585838 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e8ab3-b79f-4a98-a419-11f13b2d84d7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:14.592230 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 66/122] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:14 2022] GET /identity/v3/role_assignments?user.id=f2b30a14f84442c4a6f9db62e19c24e6&scope.project.id=43279107ea034f0ab0fb5daa09dd0e92&role.id=e8fe982879094fdda82d271ad13509de => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:14.601128 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e8ab3-b79f-4a98-a419-11f13b2d84d7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:14.635544 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 57/123] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:14.636374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92210f-15f9-41bf-8d4a-4109ff9f1cb1 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:14.688510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:14.720941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e8ab3-b79f-4a98-a419-11f13b2d84d7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:14.723228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:14.748447 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92210f-15f9-41bf-8d4a-4109ff9f1cb1 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:14.761570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674be11-a214-41a6-8dbb-ea862c7935e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:14.762681 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674be11-a214-41a6-8dbb-ea862c7935e9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:14.763232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674be11-a214-41a6-8dbb-ea862c7935e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:14.763728 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674be11-a214-41a6-8dbb-ea862c7935e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:14.776463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674be11-a214-41a6-8dbb-ea862c7935e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-5674be11-a214-41a6-8dbb-ea862c7935e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:14.786119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:14.787282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:14.788448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:14.788448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:14.788448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:14.788448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:14.788448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:14.788448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:14.788448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:14.788448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:14.788448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:14.788448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:14.788448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:14.788448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:14.789037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83813d95-f669-423f-96e5-9770c9330481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:14.789037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83813d95-f669-423f-96e5-9770c9330481 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:14.789037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83813d95-f669-423f-96e5-9770c9330481 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:14.789037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83813d95-f669-423f-96e5-9770c9330481 None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:14.790659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83813d95-f669-423f-96e5-9770c9330481 None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:14.791440 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 67/124] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:16:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:14.792421 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83813d95-f669-423f-96e5-9770c9330481 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:14.792698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674be11-a214-41a6-8dbb-ea862c7935e9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:14.794581 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 58/125] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:14 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:14.795433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83813d95-f669-423f-96e5-9770c9330481 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:14.912979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674be11-a214-41a6-8dbb-ea862c7935e9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:14.920010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:14.936764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83813d95-f669-423f-96e5-9770c9330481 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:14.949922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1f6a-a63f-4baf-b28a-a78ea2749652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:14.950939 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1f6a-a63f-4baf-b28a-a78ea2749652 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:14.951511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1f6a-a63f-4baf-b28a-a78ea2749652 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:14.951632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1f6a-a63f-4baf-b28a-a78ea2749652 None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:14.952941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc1f6a-a63f-4baf-b28a-a78ea2749652 None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:14.954523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc1f6a-a63f-4baf-b28a-a78ea2749652 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:14.961106 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 68/126] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:14 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:14.961106 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1f6a-a63f-4baf-b28a-a78ea2749652 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:14.988384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade4e48-5590-4412-ac43-f963a6288d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:14.989225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade4e48-5590-4412-ac43-f963a6288d4b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:14.989516 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade4e48-5590-4412-ac43-f963a6288d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:14.989790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade4e48-5590-4412-ac43-f963a6288d4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:14.994360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:15.002091 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade4e48-5590-4412-ac43-f963a6288d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-9ade4e48-5590-4412-ac43-f963a6288d4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:15.010829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:15.011721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:15.012491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:15.012491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:15.012491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:15.012491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:15.012491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:15.012491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:15.012491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:15.012491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:15.012491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:15.012491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:15.012491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:15.012491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:15.012491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 59/127] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:15.013114 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade4e48-5590-4412-ac43-f963a6288d4b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:15.086344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1f6a-a63f-4baf-b28a-a78ea2749652 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:15.122679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d9e8d-948c-4f68-93bf-ffd73fdd35ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:15.123772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d9e8d-948c-4f68-93bf-ffd73fdd35ae None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:15.124265 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d9e8d-948c-4f68-93bf-ffd73fdd35ae None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:15.124728 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d9e8d-948c-4f68-93bf-ffd73fdd35ae None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:15.125697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d9e8d-948c-4f68-93bf-ffd73fdd35ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:15.126197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d9e8d-948c-4f68-93bf-ffd73fdd35ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:15.127836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d9e8d-948c-4f68-93bf-ffd73fdd35ae None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:15.133631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade4e48-5590-4412-ac43-f963a6288d4b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:15.137595 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 69/128] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:15.139565 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d9e8d-948c-4f68-93bf-ffd73fdd35ae None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:15.178542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6d81a-7443-4dd2-90ed-9ef1ed5b5ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:15.180076 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6d81a-7443-4dd2-90ed-9ef1ed5b5ff7 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:15.180367 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6d81a-7443-4dd2-90ed-9ef1ed5b5ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:15.180651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6d81a-7443-4dd2-90ed-9ef1ed5b5ff7 None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92/users/13747340af1f46a1822347a891a6c5f5/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:15.184961 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6d81a-7443-4dd2-90ed-9ef1ed5b5ff7 None admin] RBAC: Authorizing `identity:create_grant(project_id=43279107ea034f0ab0fb5daa09dd0e92, user_id=13747340af1f46a1822347a891a6c5f5, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:15.187200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6d81a-7443-4dd2-90ed-9ef1ed5b5ff7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:15.209839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 60/129] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:16:15 2022] PUT /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92/users/13747340af1f46a1822347a891a6c5f5/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:16:15.211496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6d81a-7443-4dd2-90ed-9ef1ed5b5ff7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:15.236017 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:15.282807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:15.302612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d9e8d-948c-4f68-93bf-ffd73fdd35ae None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:15.356390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37353fb7-1839-4220-99b4-178304fe5fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:15.357323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37353fb7-1839-4220-99b4-178304fe5fb2 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:15.357613 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37353fb7-1839-4220-99b4-178304fe5fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:15.357890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37353fb7-1839-4220-99b4-178304fe5fb2 None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92/users/23d4803e5e4a4ff6aed2456c309e3051/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:15.360012 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37353fb7-1839-4220-99b4-178304fe5fb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=43279107ea034f0ab0fb5daa09dd0e92, user_id=23d4803e5e4a4ff6aed2456c309e3051, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:15.361497 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37353fb7-1839-4220-99b4-178304fe5fb2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:15.391787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 70/130] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:16:15 2022] PUT /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92/users/23d4803e5e4a4ff6aed2456c309e3051/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:16:15.392879 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37353fb7-1839-4220-99b4-178304fe5fb2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:15.397016 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6d81a-7443-4dd2-90ed-9ef1ed5b5ff7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:15.456239 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deaa87-6722-42dd-9b8b-3bec3211e04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:15.457340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deaa87-6722-42dd-9b8b-3bec3211e04d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:15.457845 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deaa87-6722-42dd-9b8b-3bec3211e04d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:15.458413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deaa87-6722-42dd-9b8b-3bec3211e04d None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:15.459851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46deaa87-6722-42dd-9b8b-3bec3211e04d None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:15.460495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46deaa87-6722-42dd-9b8b-3bec3211e04d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:15.462277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46deaa87-6722-42dd-9b8b-3bec3211e04d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:15.473484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 61/131] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:15.480907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deaa87-6722-42dd-9b8b-3bec3211e04d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:15.603966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:15.638739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deaa87-6722-42dd-9b8b-3bec3211e04d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:15.641432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37353fb7-1839-4220-99b4-178304fe5fb2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:15.675912 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacfdb2-2abf-4aaa-aca8-1c9238435da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:15.677257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacfdb2-2abf-4aaa-aca8-1c9238435da7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:15.677777 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacfdb2-2abf-4aaa-aca8-1c9238435da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:15.678275 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacfdb2-2abf-4aaa-aca8-1c9238435da7 None admin] PATH_INFO: `/v3/users/13747340af1f46a1822347a891a6c5f5` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:15.679794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacfdb2-2abf-4aaa-aca8-1c9238435da7 None admin] RBAC: Authorizing `identity:get_user(user_id=13747340af1f46a1822347a891a6c5f5)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:15.681495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacfdb2-2abf-4aaa-aca8-1c9238435da7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:15.683386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 62/132] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:15 2022] GET /identity/v3/users/13747340af1f46a1822347a891a6c5f5 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:15.689006 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacfdb2-2abf-4aaa-aca8-1c9238435da7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:15.696383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14544526-eedb-4764-9e66-abb6ad5879c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:15.697299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14544526-eedb-4764-9e66-abb6ad5879c4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:15.697581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14544526-eedb-4764-9e66-abb6ad5879c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:15.697856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14544526-eedb-4764-9e66-abb6ad5879c4 None admin] PATH_INFO: `/v3/users/13747340af1f46a1822347a891a6c5f5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:15.699116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14544526-eedb-4764-9e66-abb6ad5879c4 None admin] RBAC: Authorizing `identity:get_user(user_id=13747340af1f46a1822347a891a6c5f5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:15.700820 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14544526-eedb-4764-9e66-abb6ad5879c4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:15.702741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 71/133] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:15 2022] GET /identity/v3/users/13747340af1f46a1822347a891a6c5f5 => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:15.712628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14544526-eedb-4764-9e66-abb6ad5879c4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:15.766646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:15.797882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacfdb2-2abf-4aaa-aca8-1c9238435da7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:15.841065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046cd55-8e55-4ddc-b8a5-cb70ed62b214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:15.842326 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046cd55-8e55-4ddc-b8a5-cb70ed62b214 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:15.842803 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046cd55-8e55-4ddc-b8a5-cb70ed62b214 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:15.843273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046cd55-8e55-4ddc-b8a5-cb70ed62b214 None admin] PATH_INFO: `/v3/projects/b22bb393beaf425dbe69f2219534fe64` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:15.844850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046cd55-8e55-4ddc-b8a5-cb70ed62b214 None admin] RBAC: Authorizing `identity:get_project(project_id=b22bb393beaf425dbe69f2219534fe64)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:15.846537 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046cd55-8e55-4ddc-b8a5-cb70ed62b214 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:15.849124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 63/134] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:15 2022] GET /identity/v3/projects/b22bb393beaf425dbe69f2219534fe64 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:15.855448 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046cd55-8e55-4ddc-b8a5-cb70ed62b214 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:15.873656 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:16.010730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14544526-eedb-4764-9e66-abb6ad5879c4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:16.011324 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046cd55-8e55-4ddc-b8a5-cb70ed62b214 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:16.057202 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81876a-d267-4e07-9d24-13db5d68f587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:16.058100 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81876a-d267-4e07-9d24-13db5d68f587 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:16.058388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81876a-d267-4e07-9d24-13db5d68f587 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:16.058671 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81876a-d267-4e07-9d24-13db5d68f587 None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:16.060072 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81876a-d267-4e07-9d24-13db5d68f587 None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:16.062548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81876a-d267-4e07-9d24-13db5d68f587 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:16.067210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 72/135] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:15 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:16.077589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81876a-d267-4e07-9d24-13db5d68f587 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:16.099428 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85eff23-55eb-4f1a-8b67-41a51f5f9757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:16.100469 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85eff23-55eb-4f1a-8b67-41a51f5f9757 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:16.100911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85eff23-55eb-4f1a-8b67-41a51f5f9757 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:16.101261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85eff23-55eb-4f1a-8b67-41a51f5f9757 None admin] PATH_INFO: `/v3/projects/b22bb393beaf425dbe69f2219534fe64/users/13747340af1f46a1822347a891a6c5f5/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:16.105610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85eff23-55eb-4f1a-8b67-41a51f5f9757 None admin] RBAC: Authorizing `identity:create_grant(project_id=b22bb393beaf425dbe69f2219534fe64, user_id=13747340af1f46a1822347a891a6c5f5, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:16.107156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85eff23-55eb-4f1a-8b67-41a51f5f9757 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:16.131311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 64/136] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:16:15 2022] PUT /identity/v3/projects/b22bb393beaf425dbe69f2219534fe64/users/13747340af1f46a1822347a891a6c5f5/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:16:16.206773 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:16.221756 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81876a-d267-4e07-9d24-13db5d68f587 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:16.273568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d33a13-acc2-486d-aea8-3f89741a0901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:16.274414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33a13-acc2-486d-aea8-3f89741a0901 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:16.274714 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33a13-acc2-486d-aea8-3f89741a0901 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:16.274996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33a13-acc2-486d-aea8-3f89741a0901 None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92/users/13747340af1f46a1822347a891a6c5f5/roles/18bb65296a9c487faf3b57d2b4246578` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:16.277605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d33a13-acc2-486d-aea8-3f89741a0901 None admin] RBAC: Authorizing `identity:create_grant(project_id=43279107ea034f0ab0fb5daa09dd0e92, user_id=13747340af1f46a1822347a891a6c5f5, role_id=18bb65296a9c487faf3b57d2b4246578)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:16.279523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d33a13-acc2-486d-aea8-3f89741a0901 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:16.298033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 73/137] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:16:16 2022] PUT /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92/users/13747340af1f46a1822347a891a6c5f5/roles/18bb65296a9c487faf3b57d2b4246578 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:16:16.826881 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167accb4-ffdd-4969-825e-ad141637f390 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:16.827976 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167accb4-ffdd-4969-825e-ad141637f390 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:16.828474 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167accb4-ffdd-4969-825e-ad141637f390 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:16.830093 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 65/138] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:16:16.835898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2ce04-2121-4c3b-8901-5a3d92c3f117 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:16.836815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2ce04-2121-4c3b-8901-5a3d92c3f117 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:16.837382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2ce04-2121-4c3b-8901-5a3d92c3f117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:16.859253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-dcc2ce04-2121-4c3b-8901-5a3d92c3f117 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:16.860504 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-dcc2ce04-2121-4c3b-8901-5a3d92c3f117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:16.944622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 74/139] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:16:16.968700 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167accb4-ffdd-4969-825e-ad141637f390 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:17.056939 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:17.096507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167accb4-ffdd-4969-825e-ad141637f390 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:17.129940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3b710-3bad-46a4-b640-29c48abe3fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:17.130866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3b710-3bad-46a4-b640-29c48abe3fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:17.131254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3b710-3bad-46a4-b640-29c48abe3fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:17.131528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3b710-3bad-46a4-b640-29c48abe3fc8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:17.132759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3b710-3bad-46a4-b640-29c48abe3fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:17.134232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3b710-3bad-46a4-b640-29c48abe3fc8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:17.136059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 66/140] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:17.141753 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2ce04-2121-4c3b-8901-5a3d92c3f117 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:17.226067 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:17.250096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2ce04-2121-4c3b-8901-5a3d92c3f117 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:17.285489 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e41b3-ffc5-4e0d-a25d-6894f119dfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:17.286185 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e41b3-ffc5-4e0d-a25d-6894f119dfb7 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:17.286464 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e41b3-ffc5-4e0d-a25d-6894f119dfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:17.286739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e41b3-ffc5-4e0d-a25d-6894f119dfb7 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:17.287849 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e41b3-ffc5-4e0d-a25d-6894f119dfb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:17.289380 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e41b3-ffc5-4e0d-a25d-6894f119dfb7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:17.316055 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27721482-d7a7-4c96-a6e7-32d7059518bc None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:17.316401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27721482-d7a7-4c96-a6e7-32d7059518bc None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:17.316620 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27721482-d7a7-4c96-a6e7-32d7059518bc None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:17.318213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 67/141] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:16:17.322101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 75/142] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:16:17 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:16:17.333696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d0b37-a6bf-4710-9f14-b4e9e014f20a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:17.333696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d0b37-a6bf-4710-9f14-b4e9e014f20a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:17.334385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d0b37-a6bf-4710-9f14-b4e9e014f20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:17.364546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-945d0b37-a6bf-4710-9f14-b4e9e014f20a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:17.365824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-945d0b37-a6bf-4710-9f14-b4e9e014f20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:17.465940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 68/143] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:16:17.505164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e41b3-ffc5-4e0d-a25d-6894f119dfb7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:17.618538 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e41b3-ffc5-4e0d-a25d-6894f119dfb7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:17.654227 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f7b20-6751-4d1a-9f4c-f0bb80b3d02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:17.655405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f7b20-6751-4d1a-9f4c-f0bb80b3d02d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:17.655920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f7b20-6751-4d1a-9f4c-f0bb80b3d02d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:17.656412 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f7b20-6751-4d1a-9f4c-f0bb80b3d02d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:17.658562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:17.668529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f7b20-6751-4d1a-9f4c-f0bb80b3d02d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e58f7b20-6751-4d1a-9f4c-f0bb80b3d02d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:17.677485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:17.678485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:17.679323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:17.679323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:17.679323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:17.679323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:17.679323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:17.679323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:17.679323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:17.679323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:17.679323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:17.679323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:17.679323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:17.679323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:17.679323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 76/144] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:17.688728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d0b37-a6bf-4710-9f14-b4e9e014f20a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:17.777867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:17.823534 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d0b37-a6bf-4710-9f14-b4e9e014f20a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:17.859969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2995c9d-3888-4e47-8ae1-6b01301f6d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:17.860742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2995c9d-3888-4e47-8ae1-6b01301f6d44 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:17.860933 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2995c9d-3888-4e47-8ae1-6b01301f6d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:17.861222 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2995c9d-3888-4e47-8ae1-6b01301f6d44 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:17.861999 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2995c9d-3888-4e47-8ae1-6b01301f6d44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:17.862313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2995c9d-3888-4e47-8ae1-6b01301f6d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:17.863760 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2995c9d-3888-4e47-8ae1-6b01301f6d44 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:17.873655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 69/145] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:17.879252 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f7b20-6751-4d1a-9f4c-f0bb80b3d02d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:18.002287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f7b20-6751-4d1a-9f4c-f0bb80b3d02d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:18.037832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ebc58-50be-4b5b-aea8-d20d2e50a838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:18.038722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ebc58-50be-4b5b-aea8-d20d2e50a838 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:18.039005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ebc58-50be-4b5b-aea8-d20d2e50a838 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:18.039279 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ebc58-50be-4b5b-aea8-d20d2e50a838 None admin] PATH_INFO: `/v3/users/f2b30a14f84442c4a6f9db62e19c24e6` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:18.040546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ebc58-50be-4b5b-aea8-d20d2e50a838 None admin] RBAC: Authorizing `identity:get_user(user_id=f2b30a14f84442c4a6f9db62e19c24e6)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:18.042027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ebc58-50be-4b5b-aea8-d20d2e50a838 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:18.043951 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 77/146] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:17 2022] GET /identity/v3/users/f2b30a14f84442c4a6f9db62e19c24e6 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:18.049323 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2995c9d-3888-4e47-8ae1-6b01301f6d44 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:18.166609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2995c9d-3888-4e47-8ae1-6b01301f6d44 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:18.195760 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:18.206384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbb619-a97e-40e9-a56c-f7798a71733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:18.207294 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbb619-a97e-40e9-a56c-f7798a71733f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:18.207581 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbb619-a97e-40e9-a56c-f7798a71733f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:18.207878 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbb619-a97e-40e9-a56c-f7798a71733f None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:18.209336 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbb619-a97e-40e9-a56c-f7798a71733f None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:18.210842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbb619-a97e-40e9-a56c-f7798a71733f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:18.212702 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 70/147] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:18 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:18.218697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ebc58-50be-4b5b-aea8-d20d2e50a838 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:18.300992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:18.345067 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ebc58-50be-4b5b-aea8-d20d2e50a838 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:18.382040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea7ec2-c266-473d-9067-a645c5a2c8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:18.383019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea7ec2-c266-473d-9067-a645c5a2c8f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:18.383303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea7ec2-c266-473d-9067-a645c5a2c8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:18.383577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea7ec2-c266-473d-9067-a645c5a2c8f3 None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92/users/f2b30a14f84442c4a6f9db62e19c24e6/roles/e8fe982879094fdda82d271ad13509de` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:18.385629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea7ec2-c266-473d-9067-a645c5a2c8f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=43279107ea034f0ab0fb5daa09dd0e92, user_id=f2b30a14f84442c4a6f9db62e19c24e6, role_id=e8fe982879094fdda82d271ad13509de)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:18.387113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea7ec2-c266-473d-9067-a645c5a2c8f3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:18.410472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 78/148] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:16:18 2022] PUT /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92/users/f2b30a14f84442c4a6f9db62e19c24e6/roles/e8fe982879094fdda82d271ad13509de => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:16:18.516721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f14edf-3ac9-48fb-a9f1-e6a62edaa6bb None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:18.517053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f14edf-3ac9-48fb-a9f1-e6a62edaa6bb None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:18.517290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f14edf-3ac9-48fb-a9f1-e6a62edaa6bb None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:18.518685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 71/149] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:18.534780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71352bf8-2400-4a69-a19f-f85efbe5b4bf None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:18.535120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71352bf8-2400-4a69-a19f-f85efbe5b4bf None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:18.535338 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71352bf8-2400-4a69-a19f-f85efbe5b4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:18.556685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-71352bf8-2400-4a69-a19f-f85efbe5b4bf None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:18.557931 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-71352bf8-2400-4a69-a19f-f85efbe5b4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:18.637795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 79/150] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:18.662511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f14edf-3ac9-48fb-a9f1-e6a62edaa6bb None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:18.783814 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f14edf-3ac9-48fb-a9f1-e6a62edaa6bb None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:18.827005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc98607-4671-4b68-abf2-a41f6a97915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:18.827859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc98607-4671-4b68-abf2-a41f6a97915e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:18.828150 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc98607-4671-4b68-abf2-a41f6a97915e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:18.828434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc98607-4671-4b68-abf2-a41f6a97915e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:18.842326 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc98607-4671-4b68-abf2-a41f6a97915e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ffc98607-4671-4b68-abf2-a41f6a97915e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:18.850628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:18.851502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:18.852833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:18.852833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:18.852833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:18.852833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:18.852833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:18.852833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:18.852833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:18.852833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:18.852833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:18.852833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:18.852833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:18.852833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:18.852833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 72/151] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:18.858206 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71352bf8-2400-4a69-a19f-f85efbe5b4bf None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:18.920176 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:18.973630 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71352bf8-2400-4a69-a19f-f85efbe5b4bf None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:19.011810 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c427f3a-dbb6-4401-b359-74f3785d0f09 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:19.012319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c427f3a-dbb6-4401-b359-74f3785d0f09 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:19.012390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c427f3a-dbb6-4401-b359-74f3785d0f09 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:19.013946 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 73/152] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:16:19.020661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc7c4d-547f-4076-bf6d-e487cc5e4235 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:19.020938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc7c4d-547f-4076-bf6d-e487cc5e4235 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:19.021275 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc7c4d-547f-4076-bf6d-e487cc5e4235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:19.040918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97364625-37cb-4fe2-a367-9f0440d4aa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:19.041535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97364625-37cb-4fe2-a367-9f0440d4aa85 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:19.041821 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97364625-37cb-4fe2-a367-9f0440d4aa85 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:19.042096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97364625-37cb-4fe2-a367-9f0440d4aa85 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:19.042871 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97364625-37cb-4fe2-a367-9f0440d4aa85 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:19.043179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97364625-37cb-4fe2-a367-9f0440d4aa85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:19.044634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97364625-37cb-4fe2-a367-9f0440d4aa85 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:19.048934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b5cc7c4d-547f-4076-bf6d-e487cc5e4235 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:19.050157 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b5cc7c4d-547f-4076-bf6d-e487cc5e4235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:19.067988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 80/153] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:19.073186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97364625-37cb-4fe2-a367-9f0440d4aa85 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:19.166272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:19.207348 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 74/154] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:19.269468 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc7c4d-547f-4076-bf6d-e487cc5e4235 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:19.275952 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97364625-37cb-4fe2-a367-9f0440d4aa85 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:19.297170 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:19.322135 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617d650-a580-47dc-97c7-7996ffbc68d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:19.323042 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617d650-a580-47dc-97c7-7996ffbc68d2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:19.323319 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617d650-a580-47dc-97c7-7996ffbc68d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:19.323590 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617d650-a580-47dc-97c7-7996ffbc68d2 None admin] PATH_INFO: `/v3/users/13747340af1f46a1822347a891a6c5f5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:19.324887 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617d650-a580-47dc-97c7-7996ffbc68d2 None admin] RBAC: Authorizing `identity:get_user(user_id=13747340af1f46a1822347a891a6c5f5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:19.326426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617d650-a580-47dc-97c7-7996ffbc68d2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:19.328335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 81/155] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:19 2022] GET /identity/v3/users/13747340af1f46a1822347a891a6c5f5 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:19.342977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617d650-a580-47dc-97c7-7996ffbc68d2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:19.448567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc7c4d-547f-4076-bf6d-e487cc5e4235 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:19.486857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a2ea9-7761-4a24-911d-422bc2ef26a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:19.487692 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a2ea9-7761-4a24-911d-422bc2ef26a1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:19.487977 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a2ea9-7761-4a24-911d-422bc2ef26a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:19.488251 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a2ea9-7761-4a24-911d-422bc2ef26a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:19.497565 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617d650-a580-47dc-97c7-7996ffbc68d2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:19.499448 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a2ea9-7761-4a24-911d-422bc2ef26a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-d66a2ea9-7761-4a24-911d-422bc2ef26a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:19.511333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:19.512438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:19.513303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:19.513303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:19.513303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:19.513303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:19.513303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:19.513303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:19.513303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:19.513303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:19.513303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:19.513303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:19.513303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:19.513303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:19.513303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 75/156] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:16:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:19.520437 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a2ea9-7761-4a24-911d-422bc2ef26a1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:19.621316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c15f89-78f4-4f28-8814-f7a1f257cf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:19.622026 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c15f89-78f4-4f28-8814-f7a1f257cf43 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:19.622307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c15f89-78f4-4f28-8814-f7a1f257cf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:19.622583 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c15f89-78f4-4f28-8814-f7a1f257cf43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:19.627226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:19.679938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:19.704982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c15f89-78f4-4f28-8814-f7a1f257cf43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:19.706470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c15f89-78f4-4f28-8814-f7a1f257cf43 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:19.732347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a2ea9-7761-4a24-911d-422bc2ef26a1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:19.801241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ee335-0298-4b6f-bdac-7fa8c84bfe12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:19.802213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ee335-0298-4b6f-bdac-7fa8c84bfe12 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:19.802720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ee335-0298-4b6f-bdac-7fa8c84bfe12 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:19.803378 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ee335-0298-4b6f-bdac-7fa8c84bfe12 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:19.804462 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ee335-0298-4b6f-bdac-7fa8c84bfe12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:19.804941 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ee335-0298-4b6f-bdac-7fa8c84bfe12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:19.806531 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ee335-0298-4b6f-bdac-7fa8c84bfe12 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:19.824870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 76/157] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:19.830787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ee335-0298-4b6f-bdac-7fa8c84bfe12 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:19.846305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 82/158] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:16:19.852805 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c15f89-78f4-4f28-8814-f7a1f257cf43 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:19.969069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:19.998629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c15f89-78f4-4f28-8814-f7a1f257cf43 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:20.075298 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805ee0c-408a-4db5-94d5-da1b3d6a42ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:20.076653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ee0c-408a-4db5-94d5-da1b3d6a42ed None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:20.077151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ee0c-408a-4db5-94d5-da1b3d6a42ed None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:20.077636 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ee0c-408a-4db5-94d5-da1b3d6a42ed None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:20.080830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805ee0c-408a-4db5-94d5-da1b3d6a42ed None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:20.082523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805ee0c-408a-4db5-94d5-da1b3d6a42ed None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:20.085044 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 83/159] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:19 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:20.091259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805ee0c-408a-4db5-94d5-da1b3d6a42ed None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:20.141233 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ee335-0298-4b6f-bdac-7fa8c84bfe12 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:20.151976 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:20.206148 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c096389-09fa-4ebd-91a7-f0e4ddeeb0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:20.207036 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c096389-09fa-4ebd-91a7-f0e4ddeeb0bf None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:20.207312 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c096389-09fa-4ebd-91a7-f0e4ddeeb0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:20.207579 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c096389-09fa-4ebd-91a7-f0e4ddeeb0bf None admin] PATH_INFO: `/v3/users/23d4803e5e4a4ff6aed2456c309e3051` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:20.209844 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c096389-09fa-4ebd-91a7-f0e4ddeeb0bf None admin] RBAC: Authorizing `identity:get_user(user_id=23d4803e5e4a4ff6aed2456c309e3051)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:20.211484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c096389-09fa-4ebd-91a7-f0e4ddeeb0bf None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:20.213365 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 77/160] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:19 2022] GET /identity/v3/users/23d4803e5e4a4ff6aed2456c309e3051 => generated 247 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:20.214338 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7b4f0-512f-4426-8148-17261af6abd4 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:20.214615 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7b4f0-512f-4426-8148-17261af6abd4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:20.214887 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7b4f0-512f-4426-8148-17261af6abd4 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:20.216495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 78/161] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:20.221859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057938a-d960-4cb1-ba7b-de6d96540537 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:20.222077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057938a-d960-4cb1-ba7b-de6d96540537 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:20.222396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057938a-d960-4cb1-ba7b-de6d96540537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:20.248965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a057938a-d960-4cb1-ba7b-de6d96540537 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:20.250333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a057938a-d960-4cb1-ba7b-de6d96540537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:20.328094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805ee0c-408a-4db5-94d5-da1b3d6a42ed None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:20.373352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 79/162] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:20.374264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057938a-d960-4cb1-ba7b-de6d96540537 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:20.416327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5d25f-cc8f-48e5-a4e3-f3ed502c948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:20.417416 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5d25f-cc8f-48e5-a4e3-f3ed502c948a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:20.417901 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5d25f-cc8f-48e5-a4e3-f3ed502c948a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:20.418386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5d25f-cc8f-48e5-a4e3-f3ed502c948a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:20.419428 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5d25f-cc8f-48e5-a4e3-f3ed502c948a None admin] RBAC: Adding query filter params (role.id=3fb4236a239b47e3ac59e14b3db524b1, scope.project.id=43279107ea034f0ab0fb5daa09dd0e92, user.id=13747340af1f46a1822347a891a6c5f5) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:20.419968 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5d25f-cc8f-48e5-a4e3-f3ed502c948a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:20.421703 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5d25f-cc8f-48e5-a4e3-f3ed502c948a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:20.428687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 84/163] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:20 2022] GET /identity/v3/role_assignments?user.id=13747340af1f46a1822347a891a6c5f5&scope.project.id=43279107ea034f0ab0fb5daa09dd0e92&role.id=3fb4236a239b47e3ac59e14b3db524b1 => generated 608 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:20.436449 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade5200-cb4a-469f-8046-4d56108a72c3 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:20.437076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade5200-cb4a-469f-8046-4d56108a72c3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:20.437572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade5200-cb4a-469f-8046-4d56108a72c3 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:20.439248 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 85/164] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:20 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:20.440294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade5200-cb4a-469f-8046-4d56108a72c3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:20.477122 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:20.499983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057938a-d960-4cb1-ba7b-de6d96540537 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:20.502470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:20.547396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852510fb-f4ce-4cec-9ae1-90b441a4abe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:20.548223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852510fb-f4ce-4cec-9ae1-90b441a4abe3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:20.548680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852510fb-f4ce-4cec-9ae1-90b441a4abe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:20.549002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852510fb-f4ce-4cec-9ae1-90b441a4abe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:20.601296 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade5200-cb4a-469f-8046-4d56108a72c3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:20.661108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852510fb-f4ce-4cec-9ae1-90b441a4abe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:20.661449 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c17e4c-de78-49ea-a92c-91f068faddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:20.662406 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c17e4c-de78-49ea-a92c-91f068faddc0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:20.662685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c17e4c-de78-49ea-a92c-91f068faddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:20.662949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c17e4c-de78-49ea-a92c-91f068faddc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:20.663070 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852510fb-f4ce-4cec-9ae1-90b441a4abe3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:20.680317 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c17e4c-de78-49ea-a92c-91f068faddc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b5c17e4c-de78-49ea-a92c-91f068faddc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:20.691985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:20.693003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:20.694346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:20.694346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:20.694346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:20.694346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:20.694346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:20.694346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:20.694346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:20.694346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:20.694346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:20.694346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:20.694346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:20.694346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:20.699947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 86/165] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:16:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:20.701376 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b82eeb-7f30-4a86-b522-4cdb98b9f21e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:20.701658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b82eeb-7f30-4a86-b522-4cdb98b9f21e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:20.701932 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b82eeb-7f30-4a86-b522-4cdb98b9f21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:20.728540 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c6b82eeb-7f30-4a86-b522-4cdb98b9f21e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:20.729686 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c6b82eeb-7f30-4a86-b522-4cdb98b9f21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:20.776485 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 80/166] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:20.777414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852510fb-f4ce-4cec-9ae1-90b441a4abe3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:20.781369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:20.832492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 87/167] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:20.833368 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b82eeb-7f30-4a86-b522-4cdb98b9f21e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:20.841698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:20.909824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852510fb-f4ce-4cec-9ae1-90b441a4abe3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:20.956630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06282364-ec5e-42d9-81a1-3773eaba0e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:20.957481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06282364-ec5e-42d9-81a1-3773eaba0e52 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:20.957784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06282364-ec5e-42d9-81a1-3773eaba0e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:20.958122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06282364-ec5e-42d9-81a1-3773eaba0e52 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:20.958948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06282364-ec5e-42d9-81a1-3773eaba0e52 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:20.959248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06282364-ec5e-42d9-81a1-3773eaba0e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:20.960958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06282364-ec5e-42d9-81a1-3773eaba0e52 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:20.972999 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b82eeb-7f30-4a86-b522-4cdb98b9f21e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:20.975368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 81/168] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:20.976257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06282364-ec5e-42d9-81a1-3773eaba0e52 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:21.029995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40dbb7-b0d0-4efa-84a6-bd419f9bab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:21.030865 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40dbb7-b0d0-4efa-84a6-bd419f9bab3f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:21.031127 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40dbb7-b0d0-4efa-84a6-bd419f9bab3f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:21.031400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40dbb7-b0d0-4efa-84a6-bd419f9bab3f None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:21.032678 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40dbb7-b0d0-4efa-84a6-bd419f9bab3f None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:21.034210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40dbb7-b0d0-4efa-84a6-bd419f9bab3f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:21.044411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 88/169] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:20 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:21.045431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40dbb7-b0d0-4efa-84a6-bd419f9bab3f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:21.055307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:21.098554 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06282364-ec5e-42d9-81a1-3773eaba0e52 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:21.160732 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:21.181731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0027e-d980-4563-9e8d-0983c8d08e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:21.182542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0027e-d980-4563-9e8d-0983c8d08e63 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:21.182819 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0027e-d980-4563-9e8d-0983c8d08e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:21.183089 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0027e-d980-4563-9e8d-0983c8d08e63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:21.206632 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0027e-d980-4563-9e8d-0983c8d08e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-94c0027e-d980-4563-9e8d-0983c8d08e63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:21.214463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:21.216596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:21.218505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:21.218505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:21.218505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:21.218505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:21.218505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:21.218505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:21.218505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:21.218505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:21.218505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:21.218505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:21.218505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:21.218505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:21.222607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40dbb7-b0d0-4efa-84a6-bd419f9bab3f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:21.225806 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 82/170] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:21.226685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0027e-d980-4563-9e8d-0983c8d08e63 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:21.287017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397008d-2e73-4971-abee-98448ab06650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:21.287841 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397008d-2e73-4971-abee-98448ab06650 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:21.288120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397008d-2e73-4971-abee-98448ab06650 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:21.288395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397008d-2e73-4971-abee-98448ab06650 None admin] PATH_INFO: `/v3/users/13747340af1f46a1822347a891a6c5f5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:21.289628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397008d-2e73-4971-abee-98448ab06650 None admin] RBAC: Authorizing `identity:get_user(user_id=13747340af1f46a1822347a891a6c5f5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:21.291095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397008d-2e73-4971-abee-98448ab06650 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:21.293196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 89/171] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:21 2022] GET /identity/v3/users/13747340af1f46a1822347a891a6c5f5 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:21.293992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397008d-2e73-4971-abee-98448ab06650 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:21.414529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0027e-d980-4563-9e8d-0983c8d08e63 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:21.473083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:21.478511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397008d-2e73-4971-abee-98448ab06650 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:21.492077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea961a-9fd4-4978-a348-ef3142c7da4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:21.492742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea961a-9fd4-4978-a348-ef3142c7da4d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:21.493024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea961a-9fd4-4978-a348-ef3142c7da4d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:21.493299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea961a-9fd4-4978-a348-ef3142c7da4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:21.494142 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea961a-9fd4-4978-a348-ef3142c7da4d None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=43279107ea034f0ab0fb5daa09dd0e92, user.id=23d4803e5e4a4ff6aed2456c309e3051) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:21.494451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea961a-9fd4-4978-a348-ef3142c7da4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:21.496433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea961a-9fd4-4978-a348-ef3142c7da4d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:21.517459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5475-574a-4025-b22d-7e0f40e714f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:21.517642 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 83/172] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:21 2022] GET /identity/v3/role_assignments?user.id=23d4803e5e4a4ff6aed2456c309e3051&scope.project.id=43279107ea034f0ab0fb5daa09dd0e92&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:21.518168 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5475-574a-4025-b22d-7e0f40e714f6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:21.518412 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea961a-9fd4-4978-a348-ef3142c7da4d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:21.518520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5475-574a-4025-b22d-7e0f40e714f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:21.518830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5475-574a-4025-b22d-7e0f40e714f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:21.519686 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5475-574a-4025-b22d-7e0f40e714f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:21.520000 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5475-574a-4025-b22d-7e0f40e714f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:21.521557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5475-574a-4025-b22d-7e0f40e714f6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:21.532561 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 90/173] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:21.538755 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5475-574a-4025-b22d-7e0f40e714f6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:21.541780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:21.667430 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5475-574a-4025-b22d-7e0f40e714f6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:21.699059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea961a-9fd4-4978-a348-ef3142c7da4d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:21.716500 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a3934-2709-4a54-b8b6-f3b77977322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:21.717642 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a3934-2709-4a54-b8b6-f3b77977322e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:21.717926 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a3934-2709-4a54-b8b6-f3b77977322e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:21.718578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a3934-2709-4a54-b8b6-f3b77977322e None admin] PATH_INFO: `/v3/users/13747340af1f46a1822347a891a6c5f5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:21.719820 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a3934-2709-4a54-b8b6-f3b77977322e None admin] RBAC: Authorizing `identity:get_user(user_id=13747340af1f46a1822347a891a6c5f5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:21.721895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a3934-2709-4a54-b8b6-f3b77977322e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:21.724439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 91/174] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:21 2022] GET /identity/v3/users/13747340af1f46a1822347a891a6c5f5 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:21.726365 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b5e19-9bcb-48ef-bcf6-7bc75cb88f86 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:21.726649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b5e19-9bcb-48ef-bcf6-7bc75cb88f86 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:21.726928 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b5e19-9bcb-48ef-bcf6-7bc75cb88f86 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:21.733583 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 92/175] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:21.734414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b5e19-9bcb-48ef-bcf6-7bc75cb88f86 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:21.746864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e78e9-1014-4b3b-b4a5-3f5636a53307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:21.747628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e78e9-1014-4b3b-b4a5-3f5636a53307 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:21.747936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e78e9-1014-4b3b-b4a5-3f5636a53307 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:21.748208 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e78e9-1014-4b3b-b4a5-3f5636a53307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:21.813228 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:21.825263 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e78e9-1014-4b3b-b4a5-3f5636a53307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:21.826802 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e78e9-1014-4b3b-b4a5-3f5636a53307 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:21.836150 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:21.877678 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b5e19-9bcb-48ef-bcf6-7bc75cb88f86 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:21.920136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ca8c-9c4e-4ed8-b3cb-188d360f8ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:21.921536 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ca8c-9c4e-4ed8-b3cb-188d360f8ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:21.922264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ca8c-9c4e-4ed8-b3cb-188d360f8ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:21.922733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ca8c-9c4e-4ed8-b3cb-188d360f8ee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:21.942116 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 84/176] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:21.945074 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06612-50fc-4078-ae22-84dab73083c5 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:21.949736 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06612-50fc-4078-ae22-84dab73083c5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:21.949736 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06612-50fc-4078-ae22-84dab73083c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:21.974105 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a4a06612-50fc-4078-ae22-84dab73083c5 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:21.975649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a4a06612-50fc-4078-ae22-84dab73083c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:22.011136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148ca8c-9c4e-4ed8-b3cb-188d360f8ee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:22.013320 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148ca8c-9c4e-4ed8-b3cb-188d360f8ee2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:22.071702 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 85/177] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:22.071702 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06612-50fc-4078-ae22-84dab73083c5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:22.094039 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:22.115788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:22.156297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 93/178] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:22.157485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ca8c-9c4e-4ed8-b3cb-188d360f8ee2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:22.203234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06612-50fc-4078-ae22-84dab73083c5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:22.240408 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea280c4-6486-4e71-96a5-65088737d749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:22.241652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea280c4-6486-4e71-96a5-65088737d749 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:22.242142 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea280c4-6486-4e71-96a5-65088737d749 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:22.242602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea280c4-6486-4e71-96a5-65088737d749 None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:22.244017 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea280c4-6486-4e71-96a5-65088737d749 None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:22.245698 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea280c4-6486-4e71-96a5-65088737d749 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:22.247756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 86/179] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:22 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:22.248800 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea280c4-6486-4e71-96a5-65088737d749 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:22.296922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ca8c-9c4e-4ed8-b3cb-188d360f8ee2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:22.343692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b85c8-9464-446a-b797-fb5272fe4538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:22.344463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b85c8-9464-446a-b797-fb5272fe4538 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:22.344743 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b85c8-9464-446a-b797-fb5272fe4538 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:22.345001 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b85c8-9464-446a-b797-fb5272fe4538 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:22.357057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b85c8-9464-446a-b797-fb5272fe4538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-5f3b85c8-9464-446a-b797-fb5272fe4538 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:22.364794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:22.365735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:22.366513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:22.366513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:22.366513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:22.366513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:22.366513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:22.366513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:22.366513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:22.366513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:22.366513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:22.366513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:22.366513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:22.366513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:22.366513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 94/180] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:16:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:22.367775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b85c8-9464-446a-b797-fb5272fe4538 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:22.373356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:22.390281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea280c4-6486-4e71-96a5-65088737d749 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:22.408798 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:22.441507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa9300-08a3-4683-914e-a9029c4fff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:22.442765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa9300-08a3-4683-914e-a9029c4fff74 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:22.443583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa9300-08a3-4683-914e-a9029c4fff74 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:22.444078 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa9300-08a3-4683-914e-a9029c4fff74 None admin] PATH_INFO: `/v3/projects/b22bb393beaf425dbe69f2219534fe64` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:22.445534 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa9300-08a3-4683-914e-a9029c4fff74 None admin] RBAC: Authorizing `identity:get_project(project_id=b22bb393beaf425dbe69f2219534fe64)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:22.453520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa9300-08a3-4683-914e-a9029c4fff74 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:22.456031 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 87/181] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:22 2022] GET /identity/v3/projects/b22bb393beaf425dbe69f2219534fe64 => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:22.457013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa9300-08a3-4683-914e-a9029c4fff74 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:22.542604 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b85c8-9464-446a-b797-fb5272fe4538 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:22.579745 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87c1f5-d50e-4626-b76d-c4c4bc6f4dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:22.580416 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87c1f5-d50e-4626-b76d-c4c4bc6f4dea None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:22.580698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87c1f5-d50e-4626-b76d-c4c4bc6f4dea None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:22.580857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa9300-08a3-4683-914e-a9029c4fff74 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:22.580977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87c1f5-d50e-4626-b76d-c4c4bc6f4dea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:22.581807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87c1f5-d50e-4626-b76d-c4c4bc6f4dea None admin] RBAC: Adding query filter params (role.id=18bb65296a9c487faf3b57d2b4246578, scope.project.id=43279107ea034f0ab0fb5daa09dd0e92, user.id=13747340af1f46a1822347a891a6c5f5) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:22.582117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87c1f5-d50e-4626-b76d-c4c4bc6f4dea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:22.583755 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87c1f5-d50e-4626-b76d-c4c4bc6f4dea None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:22.590453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 95/182] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:22 2022] GET /identity/v3/role_assignments?user.id=13747340af1f46a1822347a891a6c5f5&scope.project.id=43279107ea034f0ab0fb5daa09dd0e92&role.id=18bb65296a9c487faf3b57d2b4246578 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:22.591171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87c1f5-d50e-4626-b76d-c4c4bc6f4dea None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:22.633038 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e5e99-8312-42e7-a3c3-acaaa3593d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:22.635008 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e5e99-8312-42e7-a3c3-acaaa3593d63 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:22.635497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e5e99-8312-42e7-a3c3-acaaa3593d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:22.636009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e5e99-8312-42e7-a3c3-acaaa3593d63 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:22.637012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e5e99-8312-42e7-a3c3-acaaa3593d63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:22.637528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e5e99-8312-42e7-a3c3-acaaa3593d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:22.639911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e5e99-8312-42e7-a3c3-acaaa3593d63 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:22.653049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 88/183] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:22.655118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76e48-785e-4568-b8e4-f3766cf1be3f None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:22.655652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76e48-785e-4568-b8e4-f3766cf1be3f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:22.656753 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76e48-785e-4568-b8e4-f3766cf1be3f None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:22.658824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 89/184] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:22.660197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed9b01-3840-4155-899e-a47fff9efac7 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:22.660687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed9b01-3840-4155-899e-a47fff9efac7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:22.661167 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed9b01-3840-4155-899e-a47fff9efac7 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:22.662741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 90/185] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:22.664176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed9b01-3840-4155-899e-a47fff9efac7 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:22.697203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:22.717364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:22.725260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87c1f5-d50e-4626-b76d-c4c4bc6f4dea None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:22.764987 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6075e-d44a-4c88-832b-d8ae0cacc4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:22.765678 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6075e-d44a-4c88-832b-d8ae0cacc4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:22.765947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6075e-d44a-4c88-832b-d8ae0cacc4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:22.766230 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6075e-d44a-4c88-832b-d8ae0cacc4a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:22.767081 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6075e-d44a-4c88-832b-d8ae0cacc4a9 None admin] RBAC: Adding query filter params (role.id=3fb4236a239b47e3ac59e14b3db524b1, scope.project.id=b22bb393beaf425dbe69f2219534fe64, user.id=13747340af1f46a1822347a891a6c5f5) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:22.767395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6075e-d44a-4c88-832b-d8ae0cacc4a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:22.769402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6075e-d44a-4c88-832b-d8ae0cacc4a9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:22.776393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 96/186] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:22 2022] GET /identity/v3/role_assignments?user.id=13747340af1f46a1822347a891a6c5f5&scope.project.id=b22bb393beaf425dbe69f2219534fe64&role.id=3fb4236a239b47e3ac59e14b3db524b1 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:22.777651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1e93c-57b6-4d34-af31-591407a09b6a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:22.777943 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1e93c-57b6-4d34-af31-591407a09b6a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:22.778222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1e93c-57b6-4d34-af31-591407a09b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:22.807006 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-98e1e93c-57b6-4d34-af31-591407a09b6a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:22.808314 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-98e1e93c-57b6-4d34-af31-591407a09b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:22.817447 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed9b01-3840-4155-899e-a47fff9efac7 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:22.872613 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c9cd0-fe91-48e0-8e9d-fd28215ec803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:22.873529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c9cd0-fe91-48e0-8e9d-fd28215ec803 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:22.873805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c9cd0-fe91-48e0-8e9d-fd28215ec803 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:22.874130 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c9cd0-fe91-48e0-8e9d-fd28215ec803 None admin] PATH_INFO: `/v3/users/a95f00a226ec4eaeac8b48f7391b4090` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:22.889891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c9cd0-fe91-48e0-8e9d-fd28215ec803 None admin] RBAC: Authorizing `identity:get_user(user_id=a95f00a226ec4eaeac8b48f7391b4090)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:22.891304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c9cd0-fe91-48e0-8e9d-fd28215ec803 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:22.893129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 91/187] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:22 2022] GET /identity/v3/users/a95f00a226ec4eaeac8b48f7391b4090 => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:22.898623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 97/188] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:22.899589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa250f4c-cbb9-4ccc-9b47-900d8cb6622e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:22.900068 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa250f4c-cbb9-4ccc-9b47-900d8cb6622e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:22.900343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa250f4c-cbb9-4ccc-9b47-900d8cb6622e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:22.903613 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eeeaad-55f6-4280-9929-a32e5236158e None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:22.903900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eeeaad-55f6-4280-9929-a32e5236158e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:22.904178 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eeeaad-55f6-4280-9929-a32e5236158e None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:22.905775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 98/189] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:22.908563 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eeeaad-55f6-4280-9929-a32e5236158e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:22.926350 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-aa250f4c-cbb9-4ccc-9b47-900d8cb6622e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:22.927917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-aa250f4c-cbb9-4ccc-9b47-900d8cb6622e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:23.003633 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 92/190] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:23.005268 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f691ba9-4f1f-4996-a79b-5f13d7c6f4a0 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:23.005664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f691ba9-4f1f-4996-a79b-5f13d7c6f4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:23.006107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f691ba9-4f1f-4996-a79b-5f13d7c6f4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:23.015161 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:23.022052 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:23.029246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9f691ba9-4f1f-4996-a79b-5f13d7c6f4a0 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:23.030422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9f691ba9-4f1f-4996-a79b-5f13d7c6f4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:23.032399 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eeeaad-55f6-4280-9929-a32e5236158e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:23.066507 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17770c-98f5-4118-bb8a-ef98fa8b6ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:23.067165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17770c-98f5-4118-bb8a-ef98fa8b6ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:23.067450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17770c-98f5-4118-bb8a-ef98fa8b6ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:23.067763 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17770c-98f5-4118-bb8a-ef98fa8b6ae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:23.097889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 93/191] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:23.098730 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f691ba9-4f1f-4996-a79b-5f13d7c6f4a0 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:23.143248 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17770c-98f5-4118-bb8a-ef98fa8b6ae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:23.144707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17770c-98f5-4118-bb8a-ef98fa8b6ae8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:23.200416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f691ba9-4f1f-4996-a79b-5f13d7c6f4a0 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:23.231373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:23.236409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb0ed9-502f-4d03-abef-f160731bf6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:23.237676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb0ed9-502f-4d03-abef-f160731bf6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:23.238194 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb0ed9-502f-4d03-abef-f160731bf6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:23.238572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb0ed9-502f-4d03-abef-f160731bf6e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:23.240030 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb0ed9-502f-4d03-abef-f160731bf6e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:23.242075 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb0ed9-502f-4d03-abef-f160731bf6e4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:23.248471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 94/192] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:23.248471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb0ed9-502f-4d03-abef-f160731bf6e4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:23.248703 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 99/193] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:23.248703 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17770c-98f5-4118-bb8a-ef98fa8b6ae8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:23.252731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:23.349955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb0ed9-502f-4d03-abef-f160731bf6e4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:23.353088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17770c-98f5-4118-bb8a-ef98fa8b6ae8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:23.384299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e0e4d-bc8d-43c9-a8a7-eb80ff8ab677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:23.385089 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e0e4d-bc8d-43c9-a8a7-eb80ff8ab677 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:23.385370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e0e4d-bc8d-43c9-a8a7-eb80ff8ab677 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:23.385646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e0e4d-bc8d-43c9-a8a7-eb80ff8ab677 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:23.386171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9482be7-dd55-49a4-a8f6-2ed2ee794b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:23.386991 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9482be7-dd55-49a4-a8f6-2ed2ee794b9d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:23.387279 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9482be7-dd55-49a4-a8f6-2ed2ee794b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:23.387556 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9482be7-dd55-49a4-a8f6-2ed2ee794b9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:23.396232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e0e4d-bc8d-43c9-a8a7-eb80ff8ab677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:23.397693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9482be7-dd55-49a4-a8f6-2ed2ee794b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-a31e0e4d-bc8d-43c9-a8a7-eb80ff8ab677 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:23.404156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:23.405196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:23.405974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:23.405974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:23.405974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:23.405974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:23.405974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:23.405974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:23.405974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:23.405974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:23.405974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:23.405974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:23.405974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:23.405974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:23.405974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 95/194] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b9482be7-dd55-49a4-a8f6-2ed2ee794b9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:23.406616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:23.407401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:23.408232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:23.408232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:23.408232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:23.408232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:23.408232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:23.408232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:23.408232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:23.408232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:23.408232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:23.408232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:23.408232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:23.408232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:23.408232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 100/195] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:16:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:23.411517 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e0e4d-bc8d-43c9-a8a7-eb80ff8ab677 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:23.412736 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9482be7-dd55-49a4-a8f6-2ed2ee794b9d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:23.470282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:23.476998 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:23.516626 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e0e4d-bc8d-43c9-a8a7-eb80ff8ab677 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:23.520410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9482be7-dd55-49a4-a8f6-2ed2ee794b9d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:23.551202 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd78f3-e793-42b3-b9e8-3d3ad962d8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:23.551988 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd78f3-e793-42b3-b9e8-3d3ad962d8c8 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:23.552655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd78f3-e793-42b3-b9e8-3d3ad962d8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:23.552934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd78f3-e793-42b3-b9e8-3d3ad962d8c8 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:23.553691 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd78f3-e793-42b3-b9e8-3d3ad962d8c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:23.555160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd78f3-e793-42b3-b9e8-3d3ad962d8c8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:23.555418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330f2ee-5bde-4680-b2c8-a1e08de165ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:23.556379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330f2ee-5bde-4680-b2c8-a1e08de165ff None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:23.556600 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330f2ee-5bde-4680-b2c8-a1e08de165ff None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:23.556876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330f2ee-5bde-4680-b2c8-a1e08de165ff None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:23.558091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330f2ee-5bde-4680-b2c8-a1e08de165ff None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:23.559565 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330f2ee-5bde-4680-b2c8-a1e08de165ff None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:23.561529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 101/196] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:23 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:23.562069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330f2ee-5bde-4680-b2c8-a1e08de165ff None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:23.576449 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 96/197] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:16:23 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:16:23.577278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd78f3-e793-42b3-b9e8-3d3ad962d8c8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:23.677670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330f2ee-5bde-4680-b2c8-a1e08de165ff None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:23.692028 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd78f3-e793-42b3-b9e8-3d3ad962d8c8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:23.696235 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:23.715941 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:23.717913 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e880cb-4a07-48b1-b528-e39368d8ae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:23.718787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e880cb-4a07-48b1-b528-e39368d8ae87 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:23.719074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e880cb-4a07-48b1-b528-e39368d8ae87 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:23.719355 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e880cb-4a07-48b1-b528-e39368d8ae87 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:23.720353 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e880cb-4a07-48b1-b528-e39368d8ae87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:23.720704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e880cb-4a07-48b1-b528-e39368d8ae87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:23.722264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e880cb-4a07-48b1-b528-e39368d8ae87 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:23.732145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 102/198] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:23.733009 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e880cb-4a07-48b1-b528-e39368d8ae87 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:23.735231 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3746f26-24e2-4207-929b-ff80d98c46ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:23.735936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3746f26-24e2-4207-929b-ff80d98c46ee None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:23.736214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3746f26-24e2-4207-929b-ff80d98c46ee None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:23.737229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3746f26-24e2-4207-929b-ff80d98c46ee None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:23.737348 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3746f26-24e2-4207-929b-ff80d98c46ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:23.737630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3746f26-24e2-4207-929b-ff80d98c46ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:23.739030 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3746f26-24e2-4207-929b-ff80d98c46ee None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:23.748084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 97/199] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:23.749168 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3746f26-24e2-4207-929b-ff80d98c46ee None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:23.865066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e880cb-4a07-48b1-b528-e39368d8ae87 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:23.871574 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3746f26-24e2-4207-929b-ff80d98c46ee None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:23.907964 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65674e83-9bbe-4db8-bd56-f912927e81c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:23.908912 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65674e83-9bbe-4db8-bd56-f912927e81c8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:23.909189 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65674e83-9bbe-4db8-bd56-f912927e81c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:23.909457 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65674e83-9bbe-4db8-bd56-f912927e81c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:23.910304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65674e83-9bbe-4db8-bd56-f912927e81c8 None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce, user.id=a95f00a226ec4eaeac8b48f7391b4090) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:23.910653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65674e83-9bbe-4db8-bd56-f912927e81c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:23.912220 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65674e83-9bbe-4db8-bd56-f912927e81c8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:23.914965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c4815-07b9-4787-ae8f-635f4f3fcdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:23.917126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c4815-07b9-4787-ae8f-635f4f3fcdaa None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:23.917126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c4815-07b9-4787-ae8f-635f4f3fcdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:23.917126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c4815-07b9-4787-ae8f-635f4f3fcdaa None admin] PATH_INFO: `/v3/users/f2b30a14f84442c4a6f9db62e19c24e6` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:23.917943 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c4815-07b9-4787-ae8f-635f4f3fcdaa None admin] RBAC: Authorizing `identity:get_user(user_id=f2b30a14f84442c4a6f9db62e19c24e6)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:23.918663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 103/200] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:23 2022] GET /identity/v3/role_assignments?user.id=a95f00a226ec4eaeac8b48f7391b4090&scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:23.919272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c4815-07b9-4787-ae8f-635f4f3fcdaa None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:23.919442 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65674e83-9bbe-4db8-bd56-f912927e81c8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:23.922027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 98/201] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:23 2022] GET /identity/v3/users/f2b30a14f84442c4a6f9db62e19c24e6 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:23.929873 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c4815-07b9-4787-ae8f-635f4f3fcdaa None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:23.976566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:24.011765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:24.057729 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65674e83-9bbe-4db8-bd56-f912927e81c8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:24.103859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b44c5-46dc-4f91-acb3-3c93dfa5cedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:24.104779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b44c5-46dc-4f91-acb3-3c93dfa5cedf None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:24.105236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b44c5-46dc-4f91-acb3-3c93dfa5cedf None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:24.105520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b44c5-46dc-4f91-acb3-3c93dfa5cedf None admin] PATH_INFO: `/v3/users/a95f00a226ec4eaeac8b48f7391b4090` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:24.108424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b44c5-46dc-4f91-acb3-3c93dfa5cedf None admin] RBAC: Authorizing `identity:get_user(user_id=a95f00a226ec4eaeac8b48f7391b4090)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:24.109934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b44c5-46dc-4f91-acb3-3c93dfa5cedf None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:24.112064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 104/202] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:23 2022] GET /identity/v3/users/a95f00a226ec4eaeac8b48f7391b4090 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:24.118923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b44c5-46dc-4f91-acb3-3c93dfa5cedf None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:24.121372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c4815-07b9-4787-ae8f-635f4f3fcdaa None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:24.168885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7efdf-4e5b-4f31-b03d-c2d38182aaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:24.171339 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7efdf-4e5b-4f31-b03d-c2d38182aaf5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:24.171937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7efdf-4e5b-4f31-b03d-c2d38182aaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:24.173367 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7efdf-4e5b-4f31-b03d-c2d38182aaf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:24.289440 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b44c5-46dc-4f91-acb3-3c93dfa5cedf None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:24.305858 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:24.332480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72452409-1718-4b8a-9b9c-eddd53058820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:24.333184 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72452409-1718-4b8a-9b9c-eddd53058820 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:24.333493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72452409-1718-4b8a-9b9c-eddd53058820 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:24.333772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72452409-1718-4b8a-9b9c-eddd53058820 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:24.341493 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7efdf-4e5b-4f31-b03d-c2d38182aaf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:24.342986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7efdf-4e5b-4f31-b03d-c2d38182aaf5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:24.407769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72452409-1718-4b8a-9b9c-eddd53058820 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:24.409366 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72452409-1718-4b8a-9b9c-eddd53058820 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:24.464752 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:24.560450 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 99/203] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:24.565685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7efdf-4e5b-4f31-b03d-c2d38182aaf5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:24.570892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 105/204] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:24.576032 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72452409-1718-4b8a-9b9c-eddd53058820 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:24.593905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:24.723499 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7efdf-4e5b-4f31-b03d-c2d38182aaf5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:24.763314 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72452409-1718-4b8a-9b9c-eddd53058820 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:24.788976 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd8af5-9e23-4236-860c-c58e9b3df602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:24.789862 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd8af5-9e23-4236-860c-c58e9b3df602 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:24.790143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd8af5-9e23-4236-860c-c58e9b3df602 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:24.790418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd8af5-9e23-4236-860c-c58e9b3df602 None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:24.796559 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd8af5-9e23-4236-860c-c58e9b3df602 None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:24.798061 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd8af5-9e23-4236-860c-c58e9b3df602 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:24.800198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 100/205] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:24 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:24.806258 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd8af5-9e23-4236-860c-c58e9b3df602 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:24.816951 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b52d26-440b-452b-b1c9-4ae7733c9cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:24.818223 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b52d26-440b-452b-b1c9-4ae7733c9cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:24.818964 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b52d26-440b-452b-b1c9-4ae7733c9cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:24.819445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b52d26-440b-452b-b1c9-4ae7733c9cd7 None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:24.820938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b52d26-440b-452b-b1c9-4ae7733c9cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:24.822626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b52d26-440b-452b-b1c9-4ae7733c9cd7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:24.825388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 106/206] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:24 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:24.832506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b52d26-440b-452b-b1c9-4ae7733c9cd7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:24.845493 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:24.939020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:24.971194 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b52d26-440b-452b-b1c9-4ae7733c9cd7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:24.988700 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd8af5-9e23-4236-860c-c58e9b3df602 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:25.049040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473014b-6f0d-4e3f-a5f4-7989df3d3b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:25.049738 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473014b-6f0d-4e3f-a5f4-7989df3d3b8f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:25.050026 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473014b-6f0d-4e3f-a5f4-7989df3d3b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:25.050306 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473014b-6f0d-4e3f-a5f4-7989df3d3b8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:25.051175 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473014b-6f0d-4e3f-a5f4-7989df3d3b8f None admin] RBAC: Adding query filter params (role.id=18bb65296a9c487faf3b57d2b4246578, scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce, user.id=a95f00a226ec4eaeac8b48f7391b4090) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:25.051486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473014b-6f0d-4e3f-a5f4-7989df3d3b8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:25.053115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473014b-6f0d-4e3f-a5f4-7989df3d3b8f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:25.066649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 107/207] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:24 2022] GET /identity/v3/role_assignments?user.id=a95f00a226ec4eaeac8b48f7391b4090&scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce&role.id=18bb65296a9c487faf3b57d2b4246578 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:25.076164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfcb79-2af8-4a97-a9ae-30a4ab643b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:25.076884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfcb79-2af8-4a97-a9ae-30a4ab643b18 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:25.077175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfcb79-2af8-4a97-a9ae-30a4ab643b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:25.077448 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfcb79-2af8-4a97-a9ae-30a4ab643b18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:25.078338 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfcb79-2af8-4a97-a9ae-30a4ab643b18 None admin] RBAC: Adding query filter params (role.id=e8fe982879094fdda82d271ad13509de, scope.project.id=43279107ea034f0ab0fb5daa09dd0e92, user.id=f2b30a14f84442c4a6f9db62e19c24e6) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:25.078656 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfcb79-2af8-4a97-a9ae-30a4ab643b18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:25.080214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfcb79-2af8-4a97-a9ae-30a4ab643b18 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:25.094056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 101/208] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:24 2022] GET /identity/v3/role_assignments?user.id=f2b30a14f84442c4a6f9db62e19c24e6&scope.project.id=43279107ea034f0ab0fb5daa09dd0e92&role.id=e8fe982879094fdda82d271ad13509de => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:26.019280 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843b753-33b7-4b66-ba95-62b81319900a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:26.020010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843b753-33b7-4b66-ba95-62b81319900a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:26.020535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843b753-33b7-4b66-ba95-62b81319900a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:26.022167 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 108/209] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:26.027711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed172601-4c84-448f-bfdc-5c322a148043 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:26.028919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed172601-4c84-448f-bfdc-5c322a148043 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:26.029398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed172601-4c84-448f-bfdc-5c322a148043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:26.046678 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ed172601-4c84-448f-bfdc-5c322a148043 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:26.048205 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ed172601-4c84-448f-bfdc-5c322a148043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:26.075040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a3c84-9a22-4bf2-a8c5-989573cc8404 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:26.076023 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a3c84-9a22-4bf2-a8c5-989573cc8404 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:26.076504 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a3c84-9a22-4bf2-a8c5-989573cc8404 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:26.078345 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 109/210] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:26.084272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4095371-2aca-4fcf-a555-3dd390d846ad None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:26.084795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4095371-2aca-4fcf-a555-3dd390d846ad None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:26.085262 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4095371-2aca-4fcf-a555-3dd390d846ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:26.101872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b4095371-2aca-4fcf-a555-3dd390d846ad None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:26.103377 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b4095371-2aca-4fcf-a555-3dd390d846ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:26.123727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 102/211] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:16:26.148042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed172601-4c84-448f-bfdc-5c322a148043 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:26.164478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:26.180115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 110/212] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:16:26.189770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2fa90-a2b5-44c7-9307-627f05cfa916 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:26.190325 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2fa90-a2b5-44c7-9307-627f05cfa916 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:26.190797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2fa90-a2b5-44c7-9307-627f05cfa916 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:26.192574 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 111/213] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:16:26.200747 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f901-d90c-413a-96b5-56c63319aab4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:26.201366 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f901-d90c-413a-96b5-56c63319aab4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:26.201936 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f901-d90c-413a-96b5-56c63319aab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:26.219014 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-be02f901-d90c-413a-96b5-56c63319aab4 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:26.220618 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-be02f901-d90c-413a-96b5-56c63319aab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:26.258886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed172601-4c84-448f-bfdc-5c322a148043 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:26.294191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcbc2d-9182-434f-b84d-41a1344cd440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:26.294911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcbc2d-9182-434f-b84d-41a1344cd440 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:26.295195 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcbc2d-9182-434f-b84d-41a1344cd440 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:26.295470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcbc2d-9182-434f-b84d-41a1344cd440 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:26.303715 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 112/214] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:16:26.303715 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02f901-d90c-413a-96b5-56c63319aab4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:26.304384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:26.311541 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcbc2d-9182-434f-b84d-41a1344cd440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-8afcbc2d-9182-434f-b84d-41a1344cd440 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:26.321492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:26.322762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:26.324034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:26.324034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:26.324034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:26.324034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:26.324034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:26.324034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:26.324034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:26.324034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:26.324034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:26.324034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:26.324034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:26.324034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:26.327893 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 103/215] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:26.329269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcbc2d-9182-434f-b84d-41a1344cd440 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:26.401638 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:26.419824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02f901-d90c-413a-96b5-56c63319aab4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:26.438823 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcbc2d-9182-434f-b84d-41a1344cd440 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:26.467853 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51269fab-1ae0-4f1b-94d7-4eef5e344151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:26.469112 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51269fab-1ae0-4f1b-94d7-4eef5e344151 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:26.469587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51269fab-1ae0-4f1b-94d7-4eef5e344151 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:26.470345 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51269fab-1ae0-4f1b-94d7-4eef5e344151 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:26.472160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51269fab-1ae0-4f1b-94d7-4eef5e344151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:26.474473 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51269fab-1ae0-4f1b-94d7-4eef5e344151 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:26.479774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 113/216] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:26.480587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51269fab-1ae0-4f1b-94d7-4eef5e344151 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:26.481731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dea5cc-cb6e-4ae2-bc8a-943795b0abd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:26.482434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dea5cc-cb6e-4ae2-bc8a-943795b0abd5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:26.482719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dea5cc-cb6e-4ae2-bc8a-943795b0abd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:26.482996 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dea5cc-cb6e-4ae2-bc8a-943795b0abd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:26.483785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dea5cc-cb6e-4ae2-bc8a-943795b0abd5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:26.484097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dea5cc-cb6e-4ae2-bc8a-943795b0abd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:26.485499 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dea5cc-cb6e-4ae2-bc8a-943795b0abd5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:26.494853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 104/217] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:26.495503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dea5cc-cb6e-4ae2-bc8a-943795b0abd5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:26.559270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:26.592897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51269fab-1ae0-4f1b-94d7-4eef5e344151 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:26.599539 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dea5cc-cb6e-4ae2-bc8a-943795b0abd5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:26.631793 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb2488-24ef-4488-905a-eed3d312e363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:26.632612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb2488-24ef-4488-905a-eed3d312e363 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:26.632888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb2488-24ef-4488-905a-eed3d312e363 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:26.633173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb2488-24ef-4488-905a-eed3d312e363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:26.634495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d85beb-0a6a-4622-8cba-07f634db9351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:26.635332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d85beb-0a6a-4622-8cba-07f634db9351 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:26.635961 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d85beb-0a6a-4622-8cba-07f634db9351 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:26.636264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d85beb-0a6a-4622-8cba-07f634db9351 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:26.636987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d85beb-0a6a-4622-8cba-07f634db9351 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:26.638490 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d85beb-0a6a-4622-8cba-07f634db9351 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:26.643951 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb2488-24ef-4488-905a-eed3d312e363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:26.645361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-64bb2488-24ef-4488-905a-eed3d312e363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:26.652892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:26.654153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:26.660479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:26.660479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:26.660479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:26.660479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:26.660479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:26.660479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:26.660479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:26.660479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:26.660479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:26.660479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:26.660479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:26.660479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:26.660479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 114/218] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:26.660479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb2488-24ef-4488-905a-eed3d312e363 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:26.669021 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 105/219] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:16:26 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:16:26.669866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d85beb-0a6a-4622-8cba-07f634db9351 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:26.821370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb2488-24ef-4488-905a-eed3d312e363 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:26.821687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d85beb-0a6a-4622-8cba-07f634db9351 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:26.860508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:26.865073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c461931-e1f7-4509-bac2-2f4cc22a4efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:26.865756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c461931-e1f7-4509-bac2-2f4cc22a4efe None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:26.866028 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c461931-e1f7-4509-bac2-2f4cc22a4efe None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:26.866273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670c4d4-1e33-4832-97f6-e2fb9a2c176a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:26.866383 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c461931-e1f7-4509-bac2-2f4cc22a4efe None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:26.867081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c461931-e1f7-4509-bac2-2f4cc22a4efe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:26.867382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c461931-e1f7-4509-bac2-2f4cc22a4efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:26.868453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670c4d4-1e33-4832-97f6-e2fb9a2c176a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:26.868453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670c4d4-1e33-4832-97f6-e2fb9a2c176a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:26.868453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670c4d4-1e33-4832-97f6-e2fb9a2c176a None admin] PATH_INFO: `/v3/users/138005e28a90469a99a816c7a5fb7906` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:26.868852 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c461931-e1f7-4509-bac2-2f4cc22a4efe None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:26.878197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 106/220] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:26.884436 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c461931-e1f7-4509-bac2-2f4cc22a4efe None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:26.886750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670c4d4-1e33-4832-97f6-e2fb9a2c176a None admin] RBAC: Authorizing `identity:get_user(user_id=138005e28a90469a99a816c7a5fb7906)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:26.889074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670c4d4-1e33-4832-97f6-e2fb9a2c176a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:26.891758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 115/221] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:26 2022] GET /identity/v3/users/138005e28a90469a99a816c7a5fb7906 => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:26.899768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670c4d4-1e33-4832-97f6-e2fb9a2c176a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:26.953188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:27.021514 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c461931-e1f7-4509-bac2-2f4cc22a4efe None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:27.037497 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670c4d4-1e33-4832-97f6-e2fb9a2c176a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:27.067208 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1e154-62f7-4cd4-9f94-f744146f28ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:27.068866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1e154-62f7-4cd4-9f94-f744146f28ff None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:27.069343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1e154-62f7-4cd4-9f94-f744146f28ff None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:27.069810 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1e154-62f7-4cd4-9f94-f744146f28ff None admin] PATH_INFO: `/v3/users/a95f00a226ec4eaeac8b48f7391b4090` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:27.072129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1e154-62f7-4cd4-9f94-f744146f28ff None admin] RBAC: Authorizing `identity:get_user(user_id=a95f00a226ec4eaeac8b48f7391b4090)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:27.074320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1e154-62f7-4cd4-9f94-f744146f28ff None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:27.076679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 107/222] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:26 2022] GET /identity/v3/users/a95f00a226ec4eaeac8b48f7391b4090 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:27.082575 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1e154-62f7-4cd4-9f94-f744146f28ff None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:27.087551 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be8e05-b902-4cf9-b89f-d2d120e3f56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:27.088256 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8e05-b902-4cf9-b89f-d2d120e3f56b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:27.088542 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8e05-b902-4cf9-b89f-d2d120e3f56b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:27.088823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8e05-b902-4cf9-b89f-d2d120e3f56b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:27.162157 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:27.177558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be8e05-b902-4cf9-b89f-d2d120e3f56b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:27.179584 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be8e05-b902-4cf9-b89f-d2d120e3f56b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:27.207942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1e154-62f7-4cd4-9f94-f744146f28ff None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:27.229413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:27.244244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd74923-ee42-4763-ba12-8d2aae4614a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:27.245154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd74923-ee42-4763-ba12-8d2aae4614a8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:27.245443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd74923-ee42-4763-ba12-8d2aae4614a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:27.245691 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd74923-ee42-4763-ba12-8d2aae4614a8 None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:27.246952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd74923-ee42-4763-ba12-8d2aae4614a8 None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:27.248575 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd74923-ee42-4763-ba12-8d2aae4614a8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:27.250649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 108/223] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:27 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:27.255904 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd74923-ee42-4763-ba12-8d2aae4614a8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:27.322746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 116/224] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:16:27.326638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a24bc-f137-4664-b75a-9f3cadae2e89 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:27.327829 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a24bc-f137-4664-b75a-9f3cadae2e89 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:27.329139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a24bc-f137-4664-b75a-9f3cadae2e89 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:27.330597 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 117/225] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:27.331171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a24bc-f137-4664-b75a-9f3cadae2e89 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:27.412105 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd74923-ee42-4763-ba12-8d2aae4614a8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:27.455488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:27.468301 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fa5c6-e7c4-428b-89e2-b3c265a0eb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:27.469674 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fa5c6-e7c4-428b-89e2-b3c265a0eb3e None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:27.470179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fa5c6-e7c4-428b-89e2-b3c265a0eb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:27.470282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a24bc-f137-4664-b75a-9f3cadae2e89 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:27.470738 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fa5c6-e7c4-428b-89e2-b3c265a0eb3e None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce/users/a95f00a226ec4eaeac8b48f7391b4090/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:27.474154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fa5c6-e7c4-428b-89e2-b3c265a0eb3e None admin] RBAC: Authorizing `identity:create_grant(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce, user_id=a95f00a226ec4eaeac8b48f7391b4090, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:27.476179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fa5c6-e7c4-428b-89e2-b3c265a0eb3e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:27.495424 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 109/226] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:16:27 2022] PUT /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce/users/a95f00a226ec4eaeac8b48f7391b4090/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:16:27.497104 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb34ca-a6b7-4821-aabc-41de5ecb9a35 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:27.497552 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb34ca-a6b7-4821-aabc-41de5ecb9a35 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:27.497989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb34ca-a6b7-4821-aabc-41de5ecb9a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:27.519451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-96cb34ca-a6b7-4821-aabc-41de5ecb9a35 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:27.521562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-96cb34ca-a6b7-4821-aabc-41de5ecb9a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:27.527824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23268d6-170e-4958-9c40-56b9d9e522a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:27.529136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23268d6-170e-4958-9c40-56b9d9e522a9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:27.529479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23268d6-170e-4958-9c40-56b9d9e522a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:27.529819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23268d6-170e-4958-9c40-56b9d9e522a9 None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:27.534327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23268d6-170e-4958-9c40-56b9d9e522a9 None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:27.536000 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23268d6-170e-4958-9c40-56b9d9e522a9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:27.538464 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 118/227] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:27 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:27.544805 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23268d6-170e-4958-9c40-56b9d9e522a9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:27.575002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:27.616695 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 110/228] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:27.669873 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb34ca-a6b7-4821-aabc-41de5ecb9a35 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:27.750631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23268d6-170e-4958-9c40-56b9d9e522a9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:27.796447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb5e58-db4f-4e5c-b2e0-eb04bae9185e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:27.797658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb5e58-db4f-4e5c-b2e0-eb04bae9185e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:27.798523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb5e58-db4f-4e5c-b2e0-eb04bae9185e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:27.799220 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb5e58-db4f-4e5c-b2e0-eb04bae9185e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:27.800543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb5e58-db4f-4e5c-b2e0-eb04bae9185e None admin] RBAC: Adding query filter params (role.id=3fb4236a239b47e3ac59e14b3db524b1, scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce, user.id=138005e28a90469a99a816c7a5fb7906) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:27.801032 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb5e58-db4f-4e5c-b2e0-eb04bae9185e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:27.803345 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb5e58-db4f-4e5c-b2e0-eb04bae9185e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:27.807885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb34ca-a6b7-4821-aabc-41de5ecb9a35 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:27.812283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 119/229] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:27 2022] GET /identity/v3/role_assignments?user.id=138005e28a90469a99a816c7a5fb7906&scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce&role.id=3fb4236a239b47e3ac59e14b3db524b1 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:27.863398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d89fa-462a-4dd3-a769-fcc54f286d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:27.864189 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d89fa-462a-4dd3-a769-fcc54f286d71 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:27.864475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d89fa-462a-4dd3-a769-fcc54f286d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:27.864815 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d89fa-462a-4dd3-a769-fcc54f286d71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:27.876442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d89fa-462a-4dd3-a769-fcc54f286d71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-196d89fa-462a-4dd3-a769-fcc54f286d71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:27.889046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:27.890013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:27.891224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:27.891224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:27.891224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:27.891224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:27.891224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:27.891224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:27.891224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:27.891224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:27.891224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:27.891224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:27.891224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:27.891224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:27.891224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 111/230] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:16:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:27.896725 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb5e58-db4f-4e5c-b2e0-eb04bae9185e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:27.938215 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:28.028374 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb5e58-db4f-4e5c-b2e0-eb04bae9185e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:28.068001 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ab943-a655-4ef1-81fc-78aab63417f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:28.069208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ab943-a655-4ef1-81fc-78aab63417f0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:28.069708 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ab943-a655-4ef1-81fc-78aab63417f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:28.070171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ab943-a655-4ef1-81fc-78aab63417f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:28.071129 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ab943-a655-4ef1-81fc-78aab63417f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:28.071655 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ab943-a655-4ef1-81fc-78aab63417f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:28.073897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ab943-a655-4ef1-81fc-78aab63417f0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:28.083923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 120/231] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:28.091643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d89fa-462a-4dd3-a769-fcc54f286d71 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:28.141016 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:28.209045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d89fa-462a-4dd3-a769-fcc54f286d71 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:28.244220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8eecba-5a08-469c-ab0a-fece1449435d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:28.245123 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8eecba-5a08-469c-ab0a-fece1449435d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:28.245411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8eecba-5a08-469c-ab0a-fece1449435d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:28.245689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8eecba-5a08-469c-ab0a-fece1449435d None admin] PATH_INFO: `/v3/users/a95f00a226ec4eaeac8b48f7391b4090` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:28.246911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8eecba-5a08-469c-ab0a-fece1449435d None admin] RBAC: Authorizing `identity:get_user(user_id=a95f00a226ec4eaeac8b48f7391b4090)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:28.248454 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8eecba-5a08-469c-ab0a-fece1449435d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:28.250171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 112/232] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:28 2022] GET /identity/v3/users/a95f00a226ec4eaeac8b48f7391b4090 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:28.255919 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ab943-a655-4ef1-81fc-78aab63417f0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:28.385877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:28.405150 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ab943-a655-4ef1-81fc-78aab63417f0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:28.451576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6b7a6-1fc9-4a58-8268-9d85eda7900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:28.452504 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6b7a6-1fc9-4a58-8268-9d85eda7900d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:28.452784 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6b7a6-1fc9-4a58-8268-9d85eda7900d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:28.453064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6b7a6-1fc9-4a58-8268-9d85eda7900d None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:28.459633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6b7a6-1fc9-4a58-8268-9d85eda7900d None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:28.459633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6b7a6-1fc9-4a58-8268-9d85eda7900d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:28.459633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 121/233] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:28 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:28.468716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8eecba-5a08-469c-ab0a-fece1449435d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:28.632002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8eecba-5a08-469c-ab0a-fece1449435d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:28.639542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:28.681315 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5437e7-9613-44cb-8a0d-01af87473b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:28.682142 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5437e7-9613-44cb-8a0d-01af87473b99 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:28.682423 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5437e7-9613-44cb-8a0d-01af87473b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:28.682697 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5437e7-9613-44cb-8a0d-01af87473b99 None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce/users/a95f00a226ec4eaeac8b48f7391b4090/roles/18bb65296a9c487faf3b57d2b4246578` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:28.685002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5437e7-9613-44cb-8a0d-01af87473b99 None admin] RBAC: Authorizing `identity:create_grant(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce, user_id=a95f00a226ec4eaeac8b48f7391b4090, role_id=18bb65296a9c487faf3b57d2b4246578)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:28.686476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5437e7-9613-44cb-8a0d-01af87473b99 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:28.703466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 113/234] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:16:28 2022] PUT /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce/users/a95f00a226ec4eaeac8b48f7391b4090/roles/18bb65296a9c487faf3b57d2b4246578 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:16:29.103889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deb6db-31ac-4a56-a43f-bdcc5202176e None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:29.104227 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deb6db-31ac-4a56-a43f-bdcc5202176e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:29.104396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deb6db-31ac-4a56-a43f-bdcc5202176e None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:29.105825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 122/235] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:29.111234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26f906-7b53-46a6-b032-5d1df706d51b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:29.111732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26f906-7b53-46a6-b032-5d1df706d51b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:29.111810 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26f906-7b53-46a6-b032-5d1df706d51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:29.132819 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6b26f906-7b53-46a6-b032-5d1df706d51b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:29.134136 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6b26f906-7b53-46a6-b032-5d1df706d51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:29.229725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 114/236] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:29.262161 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3deb6db-31ac-4a56-a43f-bdcc5202176e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:29.392448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3deb6db-31ac-4a56-a43f-bdcc5202176e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:29.393271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdea6bd-1f95-43ce-a2b6-d241b4c71204 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:29.393565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdea6bd-1f95-43ce-a2b6-d241b4c71204 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:29.393845 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdea6bd-1f95-43ce-a2b6-d241b4c71204 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:29.395481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 115/237] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:29.401077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cb7be-50b8-441f-b442-80cb0b06c132 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:29.401370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cb7be-50b8-441f-b442-80cb0b06c132 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:29.401645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cb7be-50b8-441f-b442-80cb0b06c132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:29.428544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9769d4-b310-457a-9c39-9ede644f9895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:29.429388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9769d4-b310-457a-9c39-9ede644f9895 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:29.429679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9769d4-b310-457a-9c39-9ede644f9895 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:29.429950 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9769d4-b310-457a-9c39-9ede644f9895 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:29.441263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9769d4-b310-457a-9c39-9ede644f9895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:29.452594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-481cb7be-50b8-441f-b442-80cb0b06c132 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:29.453802 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-481cb7be-50b8-441f-b442-80cb0b06c132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8b9769d4-b310-457a-9c39-9ede644f9895 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:29.458927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:29.460046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:29.460823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:29.460823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:29.460823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:29.460823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:29.460823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:29.460823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:29.460823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:29.460823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:29.460823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:29.460823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:29.460823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:29.460823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:29.460823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 123/238] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:29.472297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9769d4-b310-457a-9c39-9ede644f9895 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:29.492112 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:29.588066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9769d4-b310-457a-9c39-9ede644f9895 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:29.625683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 116/239] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:29.632321 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01984043-b44f-434f-b667-31f2d9048a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:29.633019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01984043-b44f-434f-b667-31f2d9048a4e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:29.633302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01984043-b44f-434f-b667-31f2d9048a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:29.633577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01984043-b44f-434f-b667-31f2d9048a4e None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:29.634353 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01984043-b44f-434f-b667-31f2d9048a4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:29.634654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01984043-b44f-434f-b667-31f2d9048a4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:29.636099 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01984043-b44f-434f-b667-31f2d9048a4e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:29.647901 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 124/240] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:29.653891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cb7be-50b8-441f-b442-80cb0b06c132 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:29.690165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:29.692401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01984043-b44f-434f-b667-31f2d9048a4e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:29.790752 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:29.824096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01984043-b44f-434f-b667-31f2d9048a4e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:29.850472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cb7be-50b8-441f-b442-80cb0b06c132 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:29.865173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dbbbb-bae2-4c17-80b3-012e5e59ce54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:29.866095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dbbbb-bae2-4c17-80b3-012e5e59ce54 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:29.866479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dbbbb-bae2-4c17-80b3-012e5e59ce54 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:29.866943 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dbbbb-bae2-4c17-80b3-012e5e59ce54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:29.869473 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090dbbbb-bae2-4c17-80b3-012e5e59ce54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:29.870943 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090dbbbb-bae2-4c17-80b3-012e5e59ce54 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:29.872958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 125/241] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:29.878485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dbbbb-bae2-4c17-80b3-012e5e59ce54 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:29.906756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d048d8-1c9f-45b8-b00d-3f5aa37fe777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:29.908316 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d048d8-1c9f-45b8-b00d-3f5aa37fe777 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:29.909614 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d048d8-1c9f-45b8-b00d-3f5aa37fe777 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:29.910843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d048d8-1c9f-45b8-b00d-3f5aa37fe777 None admin] PATH_INFO: `/v3/users/308fbfd2eb2e41ca9c9ebccbc854e20d` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:29.934514 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d048d8-1c9f-45b8-b00d-3f5aa37fe777 None admin] RBAC: Authorizing `identity:get_user(user_id=308fbfd2eb2e41ca9c9ebccbc854e20d)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:29.937056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d048d8-1c9f-45b8-b00d-3f5aa37fe777 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:29.939674 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 117/242] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:29 2022] GET /identity/v3/users/308fbfd2eb2e41ca9c9ebccbc854e20d => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:29.946675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d048d8-1c9f-45b8-b00d-3f5aa37fe777 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:30.074198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:30.087076 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d048d8-1c9f-45b8-b00d-3f5aa37fe777 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:30.110681 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dbbbb-bae2-4c17-80b3-012e5e59ce54 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:30.122548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437f635-0bb3-4622-8d5d-19ed6aa85cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:30.124080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437f635-0bb3-4622-8d5d-19ed6aa85cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:30.124591 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437f635-0bb3-4622-8d5d-19ed6aa85cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:30.125003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437f635-0bb3-4622-8d5d-19ed6aa85cd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:30.160077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a404c5-7486-412d-bab6-358aec400467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:30.160674 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a404c5-7486-412d-bab6-358aec400467 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:30.161336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a404c5-7486-412d-bab6-358aec400467 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:30.161751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a404c5-7486-412d-bab6-358aec400467 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:30.163181 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a404c5-7486-412d-bab6-358aec400467 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:30.165276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a404c5-7486-412d-bab6-358aec400467 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:30.179468 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:30.197498 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 126/243] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:16:29 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:16:30.199114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20503ccc-e609-4c5f-96af-a7684ea61c8a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:30.199557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20503ccc-e609-4c5f-96af-a7684ea61c8a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:30.199977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20503ccc-e609-4c5f-96af-a7684ea61c8a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:30.201520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 127/244] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:30.210189 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471573c-7009-4a74-ac23-807c049ca42e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:30.210465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471573c-7009-4a74-ac23-807c049ca42e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:30.210750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471573c-7009-4a74-ac23-807c049ca42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:30.231364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8471573c-7009-4a74-ac23-807c049ca42e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:30.232692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8471573c-7009-4a74-ac23-807c049ca42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:30.244884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437f635-0bb3-4622-8d5d-19ed6aa85cd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:30.246510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437f635-0bb3-4622-8d5d-19ed6aa85cd4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:30.340261 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 128/245] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:30.373102 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471573c-7009-4a74-ac23-807c049ca42e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:30.432953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:30.446762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 118/246] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:30.452400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437f635-0bb3-4622-8d5d-19ed6aa85cd4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:30.524126 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471573c-7009-4a74-ac23-807c049ca42e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:30.566464 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:30.575557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437f635-0bb3-4622-8d5d-19ed6aa85cd4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:30.580733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e41d8-94e3-4d31-b43c-b87ffbb97c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:30.581564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e41d8-94e3-4d31-b43c-b87ffbb97c3d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:30.581847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e41d8-94e3-4d31-b43c-b87ffbb97c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:30.582121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e41d8-94e3-4d31-b43c-b87ffbb97c3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:30.597447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e41d8-94e3-4d31-b43c-b87ffbb97c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-710e41d8-94e3-4d31-b43c-b87ffbb97c3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:30.606825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:30.607788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:30.608570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:30.608570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:30.608570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:30.608570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:30.608570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:30.608570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:30.608570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:30.608570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:30.608570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:30.608570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:30.608570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:30.608570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:30.608570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 129/247] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:16:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:16:30.609216 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9826a4-292f-4f1a-b2d1-5bf971f447fb None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:30.609216 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9826a4-292f-4f1a-b2d1-5bf971f447fb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:30.609338 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9826a4-292f-4f1a-b2d1-5bf971f447fb None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:30.610707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 130/248] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:30.615943 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1ce13-3cd4-43a1-9317-d7ff3c5715ab None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:30.616233 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1ce13-3cd4-43a1-9317-d7ff3c5715ab None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:30.616509 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1ce13-3cd4-43a1-9317-d7ff3c5715ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:30.623767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d53a7b-788b-4a5e-88d9-9479f142abd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:30.624832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d53a7b-788b-4a5e-88d9-9479f142abd1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:30.625256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d53a7b-788b-4a5e-88d9-9479f142abd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:30.625689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d53a7b-788b-4a5e-88d9-9479f142abd1 None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:30.627032 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d53a7b-788b-4a5e-88d9-9479f142abd1 None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:30.628722 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d53a7b-788b-4a5e-88d9-9479f142abd1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:30.631391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 119/249] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:30 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:30.633193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d53a7b-788b-4a5e-88d9-9479f142abd1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:30.636824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-24b1ce13-3cd4-43a1-9317-d7ff3c5715ab None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:30.638009 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-24b1ce13-3cd4-43a1-9317-d7ff3c5715ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:30.700680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:30.716743 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 131/250] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:16:30.717682 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1ce13-3cd4-43a1-9317-d7ff3c5715ab None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:30.760635 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d53a7b-788b-4a5e-88d9-9479f142abd1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:30.814909 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25afa85-a748-494b-acc0-d47f81424310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:30.815907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25afa85-a748-494b-acc0-d47f81424310 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:30.816332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25afa85-a748-494b-acc0-d47f81424310 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:30.816751 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25afa85-a748-494b-acc0-d47f81424310 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:30.817687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25afa85-a748-494b-acc0-d47f81424310 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:30.818365 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25afa85-a748-494b-acc0-d47f81424310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:30.820085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25afa85-a748-494b-acc0-d47f81424310 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:30.831363 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 120/251] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:30.832510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25afa85-a748-494b-acc0-d47f81424310 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:30.897195 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1ce13-3cd4-43a1-9317-d7ff3c5715ab None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:30.937269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:30.970640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25afa85-a748-494b-acc0-d47f81424310 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:30.985624 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6c71b-6ce8-4e19-8f02-fe36222c2477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:30.986300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6c71b-6ce8-4e19-8f02-fe36222c2477 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:30.986677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6c71b-6ce8-4e19-8f02-fe36222c2477 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:30.986862 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6c71b-6ce8-4e19-8f02-fe36222c2477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:30.987714 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6c71b-6ce8-4e19-8f02-fe36222c2477 None admin] RBAC: Adding query filter params (role.id=e8fe982879094fdda82d271ad13509de, scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce, user.id=308fbfd2eb2e41ca9c9ebccbc854e20d) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:30.988029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6c71b-6ce8-4e19-8f02-fe36222c2477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:30.988615 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:30.989803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6c71b-6ce8-4e19-8f02-fe36222c2477 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:31.006441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 132/252] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:30 2022] GET /identity/v3/role_assignments?user.id=308fbfd2eb2e41ca9c9ebccbc854e20d&scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce&role.id=e8fe982879094fdda82d271ad13509de => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:31.007261 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6c71b-6ce8-4e19-8f02-fe36222c2477 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:31.020785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8509d-76b7-4e48-9665-a30094d30966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:31.022457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8509d-76b7-4e48-9665-a30094d30966 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:31.022942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8509d-76b7-4e48-9665-a30094d30966 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:31.023416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8509d-76b7-4e48-9665-a30094d30966 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:31.045794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8509d-76b7-4e48-9665-a30094d30966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-35d8509d-76b7-4e48-9665-a30094d30966 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:31.055953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:31.056906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:31.057706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:31.057706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:31.057706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:31.057706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:31.057706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:31.057706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:31.057706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:31.057706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:31.057706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:31.057706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:31.057706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:31.057706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:31.058930 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 121/253] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:31.065076 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8509d-76b7-4e48-9665-a30094d30966 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:31.264349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6c71b-6ce8-4e19-8f02-fe36222c2477 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:31.306427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c4402-a96f-4c3b-8dc1-bc4808102768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:31.307765 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c4402-a96f-4c3b-8dc1-bc4808102768 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:31.308244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c4402-a96f-4c3b-8dc1-bc4808102768 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:31.309631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c4402-a96f-4c3b-8dc1-bc4808102768 None admin] PATH_INFO: `/v3/users/a95f00a226ec4eaeac8b48f7391b4090` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:31.311164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c4402-a96f-4c3b-8dc1-bc4808102768 None admin] RBAC: Authorizing `identity:get_user(user_id=a95f00a226ec4eaeac8b48f7391b4090)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:31.312992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c4402-a96f-4c3b-8dc1-bc4808102768 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:31.315194 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 133/254] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:31 2022] GET /identity/v3/users/a95f00a226ec4eaeac8b48f7391b4090 => generated 283 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:31.321060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c4402-a96f-4c3b-8dc1-bc4808102768 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:31.362734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8509d-76b7-4e48-9665-a30094d30966 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:31.398213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a68d3-1368-41a8-9219-83e0da038a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:31.398894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a68d3-1368-41a8-9219-83e0da038a57 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:31.399169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a68d3-1368-41a8-9219-83e0da038a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:31.399441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a68d3-1368-41a8-9219-83e0da038a57 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:31.400245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a68d3-1368-41a8-9219-83e0da038a57 None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:31.400549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a68d3-1368-41a8-9219-83e0da038a57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:31.401952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a68d3-1368-41a8-9219-83e0da038a57 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:31.411699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 122/255] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:31.413029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f9edf-bc6d-4196-84ad-e4d588a116c4 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:31.413310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f9edf-bc6d-4196-84ad-e4d588a116c4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:31.413583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f9edf-bc6d-4196-84ad-e4d588a116c4 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:31.415075 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 123/256] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:31.419586 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f9edf-bc6d-4196-84ad-e4d588a116c4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:31.440133 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:31.469005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:31.505480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c4402-a96f-4c3b-8dc1-bc4808102768 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:31.549084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f9edf-bc6d-4196-84ad-e4d588a116c4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:31.581085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce9924-c8ff-44e6-b679-01098ef378a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:31.582293 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce9924-c8ff-44e6-b679-01098ef378a2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:31.582799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce9924-c8ff-44e6-b679-01098ef378a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:31.583411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce9924-c8ff-44e6-b679-01098ef378a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:31.586222 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93794363-8fea-4ee1-b464-4669b059af25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:31.587116 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93794363-8fea-4ee1-b464-4669b059af25 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:31.587391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93794363-8fea-4ee1-b464-4669b059af25 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:31.587696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93794363-8fea-4ee1-b464-4669b059af25 None admin] PATH_INFO: `/v3/users/138005e28a90469a99a816c7a5fb7906` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:31.588933 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93794363-8fea-4ee1-b464-4669b059af25 None admin] RBAC: Authorizing `identity:get_user(user_id=138005e28a90469a99a816c7a5fb7906)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:31.590373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93794363-8fea-4ee1-b464-4669b059af25 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:31.595637 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 124/257] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:31 2022] GET /identity/v3/users/138005e28a90469a99a816c7a5fb7906 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:31.595637 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d89573-5cd7-4342-838b-389b87650ebf None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:31.595637 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d89573-5cd7-4342-838b-389b87650ebf None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:31.595637 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d89573-5cd7-4342-838b-389b87650ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:31.612767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c8d89573-5cd7-4342-838b-389b87650ebf None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:31.613955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c8d89573-5cd7-4342-838b-389b87650ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:31.692605 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 125/258] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:31.700575 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d89573-5cd7-4342-838b-389b87650ebf None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:31.745087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce9924-c8ff-44e6-b679-01098ef378a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:31.746933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce9924-c8ff-44e6-b679-01098ef378a2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:31.747418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:31.826441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d89573-5cd7-4342-838b-389b87650ebf None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:31.859037 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:31.865177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b0628-772a-4999-a9a3-4011c1c28159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:31.866128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b0628-772a-4999-a9a3-4011c1c28159 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:31.866407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b0628-772a-4999-a9a3-4011c1c28159 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:31.866679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b0628-772a-4999-a9a3-4011c1c28159 None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:31.868110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b0628-772a-4999-a9a3-4011c1c28159 None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:31.869720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b0628-772a-4999-a9a3-4011c1c28159 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:31.872254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 126/259] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:31 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:31.873285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b0628-772a-4999-a9a3-4011c1c28159 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:31.949481 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 134/260] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:31.950699 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce9924-c8ff-44e6-b679-01098ef378a2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:32.006954 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b0628-772a-4999-a9a3-4011c1c28159 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:32.008896 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:32.074715 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6d68a-a574-43b5-8516-50edff23b9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:32.076021 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6d68a-a574-43b5-8516-50edff23b9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:32.076550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6d68a-a574-43b5-8516-50edff23b9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:32.077048 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6d68a-a574-43b5-8516-50edff23b9f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:32.097506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6d68a-a574-43b5-8516-50edff23b9f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-57e6d68a-a574-43b5-8516-50edff23b9f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:32.106735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:32.107664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:32.108472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:32.108472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:32.108472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:32.108472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:32.108472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:32.108472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:32.108472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:32.108472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:32.108472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:32.108472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:32.108472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:32.108472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:32.110900 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 127/261] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:16:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:32.111910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6d68a-a574-43b5-8516-50edff23b9f8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:32.123660 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce9924-c8ff-44e6-b679-01098ef378a2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:32.160779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3586f3-079b-40f3-b347-ecd202be8f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:32.161844 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3586f3-079b-40f3-b347-ecd202be8f6f None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:32.162121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3586f3-079b-40f3-b347-ecd202be8f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:32.162390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3586f3-079b-40f3-b347-ecd202be8f6f None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce/users/138005e28a90469a99a816c7a5fb7906/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:32.164562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3586f3-079b-40f3-b347-ecd202be8f6f None admin] RBAC: Authorizing `identity:create_grant(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce, user_id=138005e28a90469a99a816c7a5fb7906, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:32.166390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3586f3-079b-40f3-b347-ecd202be8f6f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:32.186287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 135/262] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:16:31 2022] PUT /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce/users/138005e28a90469a99a816c7a5fb7906/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:16:32.188204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3586f3-079b-40f3-b347-ecd202be8f6f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:32.219319 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:32.259995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6d68a-a574-43b5-8516-50edff23b9f8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:32.296664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca1460-e3ee-4a4d-8790-b275c681f217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:32.297894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca1460-e3ee-4a4d-8790-b275c681f217 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:32.298180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca1460-e3ee-4a4d-8790-b275c681f217 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:32.298452 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca1460-e3ee-4a4d-8790-b275c681f217 None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:32.299848 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca1460-e3ee-4a4d-8790-b275c681f217 None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:32.308086 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca1460-e3ee-4a4d-8790-b275c681f217 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:32.310331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 128/263] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:32 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:32.316864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca1460-e3ee-4a4d-8790-b275c681f217 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:32.380124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:32.439804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca1460-e3ee-4a4d-8790-b275c681f217 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:32.483297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3586f3-079b-40f3-b347-ecd202be8f6f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:32.496367 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64f7e9-50b9-4916-ab8a-c1aea7c2d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:32.497056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64f7e9-50b9-4916-ab8a-c1aea7c2d367 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:32.497341 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64f7e9-50b9-4916-ab8a-c1aea7c2d367 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:32.497620 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64f7e9-50b9-4916-ab8a-c1aea7c2d367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:32.498479 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64f7e9-50b9-4916-ab8a-c1aea7c2d367 None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce, user.id=a95f00a226ec4eaeac8b48f7391b4090) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:32.498797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64f7e9-50b9-4916-ab8a-c1aea7c2d367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:32.500331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64f7e9-50b9-4916-ab8a-c1aea7c2d367 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:32.509622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 129/264] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:32 2022] GET /identity/v3/role_assignments?user.id=a95f00a226ec4eaeac8b48f7391b4090&scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:32.546943 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e21c12-6cfa-4b65-8908-4f8a9a0f7958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:32.547683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e21c12-6cfa-4b65-8908-4f8a9a0f7958 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:32.547948 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e21c12-6cfa-4b65-8908-4f8a9a0f7958 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:32.548234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e21c12-6cfa-4b65-8908-4f8a9a0f7958 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:32.549019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e21c12-6cfa-4b65-8908-4f8a9a0f7958 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:32.549332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e21c12-6cfa-4b65-8908-4f8a9a0f7958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:32.550761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e21c12-6cfa-4b65-8908-4f8a9a0f7958 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:32.567343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 136/265] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:32.573611 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64f7e9-50b9-4916-ab8a-c1aea7c2d367 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:32.719848 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:32.731220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64f7e9-50b9-4916-ab8a-c1aea7c2d367 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:32.780409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a471c-dc30-47f6-b7bd-89193b459b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:32.781306 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a471c-dc30-47f6-b7bd-89193b459b35 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:32.781581 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a471c-dc30-47f6-b7bd-89193b459b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:32.781853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a471c-dc30-47f6-b7bd-89193b459b35 None admin] PATH_INFO: `/v3/users/a95f00a226ec4eaeac8b48f7391b4090` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:32.783073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a471c-dc30-47f6-b7bd-89193b459b35 None admin] RBAC: Authorizing `identity:get_user(user_id=a95f00a226ec4eaeac8b48f7391b4090)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:32.784569 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a471c-dc30-47f6-b7bd-89193b459b35 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:32.786270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 130/266] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:32 2022] GET /identity/v3/users/a95f00a226ec4eaeac8b48f7391b4090 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:32.792005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e21c12-6cfa-4b65-8908-4f8a9a0f7958 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:32.888880 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:32.926910 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e21c12-6cfa-4b65-8908-4f8a9a0f7958 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:32.972392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4207f0-cf74-410b-afdf-f8052d63e028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:32.972982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4207f0-cf74-410b-afdf-f8052d63e028 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:32.973273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4207f0-cf74-410b-afdf-f8052d63e028 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:32.973553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4207f0-cf74-410b-afdf-f8052d63e028 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:33.067092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4207f0-cf74-410b-afdf-f8052d63e028 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:33.068677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4207f0-cf74-410b-afdf-f8052d63e028 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:33.160491 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:33.196726 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc280b-9b1f-490d-b904-4d0fca199982 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:33.197346 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc280b-9b1f-490d-b904-4d0fca199982 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:33.197812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc280b-9b1f-490d-b904-4d0fca199982 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:33.199539 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 131/267] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:16:33.203532 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 137/268] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:33.205124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12216fec-e0b1-458d-aecf-c694dd21737c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:33.205607 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12216fec-e0b1-458d-aecf-c694dd21737c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:33.206069 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12216fec-e0b1-458d-aecf-c694dd21737c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:33.219856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e89dd-d72d-4154-9192-a8900fbbf077 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:33.220195 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e89dd-d72d-4154-9192-a8900fbbf077 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:33.220403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e89dd-d72d-4154-9192-a8900fbbf077 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:33.222069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 138/269] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:33.222871 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e89dd-d72d-4154-9192-a8900fbbf077 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:33.232025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-12216fec-e0b1-458d-aecf-c694dd21737c None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:33.233623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-12216fec-e0b1-458d-aecf-c694dd21737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:33.310400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 132/270] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:16:33.312190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197b2dd-7767-4262-a903-a4fc7153a924 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:33.312666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197b2dd-7767-4262-a903-a4fc7153a924 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:33.313129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197b2dd-7767-4262-a903-a4fc7153a924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:33.333507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a197b2dd-7767-4262-a903-a4fc7153a924 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:33.335370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a197b2dd-7767-4262-a903-a4fc7153a924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:33.346865 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e89dd-d72d-4154-9192-a8900fbbf077 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:33.394587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5f464-c515-49b8-8e53-e65a174987e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:33.395986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5f464-c515-49b8-8e53-e65a174987e5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:33.396536 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5f464-c515-49b8-8e53-e65a174987e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:33.396996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5f464-c515-49b8-8e53-e65a174987e5 None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:33.399144 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5f464-c515-49b8-8e53-e65a174987e5 None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:33.401518 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5f464-c515-49b8-8e53-e65a174987e5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:33.409616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 139/271] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:33 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:33.409616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5f464-c515-49b8-8e53-e65a174987e5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:33.418983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 133/272] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:33.419890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197b2dd-7767-4262-a903-a4fc7153a924 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:33.448472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:33.464875 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:33.541051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197b2dd-7767-4262-a903-a4fc7153a924 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:33.549046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5f464-c515-49b8-8e53-e65a174987e5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:33.578036 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1111e-c8b5-42a0-b7a1-ef1f038633ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:33.578832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1111e-c8b5-42a0-b7a1-ef1f038633ff None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:33.579184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1111e-c8b5-42a0-b7a1-ef1f038633ff None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:33.579507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1111e-c8b5-42a0-b7a1-ef1f038633ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:33.580457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1111e-c8b5-42a0-b7a1-ef1f038633ff None admin] RBAC: Adding query filter params (role.id=18bb65296a9c487faf3b57d2b4246578, scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce, user.id=a95f00a226ec4eaeac8b48f7391b4090) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:33.580926 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1111e-c8b5-42a0-b7a1-ef1f038633ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:33.582365 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1111e-c8b5-42a0-b7a1-ef1f038633ff None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:33.595625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 134/273] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:33 2022] GET /identity/v3/role_assignments?user.id=a95f00a226ec4eaeac8b48f7391b4090&scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce&role.id=18bb65296a9c487faf3b57d2b4246578 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:33.595625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1111e-c8b5-42a0-b7a1-ef1f038633ff None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:33.607428 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d8b01-ea32-4bd3-8c13-6ac72778e162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:33.608336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d8b01-ea32-4bd3-8c13-6ac72778e162 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:33.608615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d8b01-ea32-4bd3-8c13-6ac72778e162 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:33.608887 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d8b01-ea32-4bd3-8c13-6ac72778e162 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:33.636100 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d8b01-ea32-4bd3-8c13-6ac72778e162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-490d8b01-ea32-4bd3-8c13-6ac72778e162 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:33.648998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:33.649961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:33.650761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:33.650761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:33.650761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:33.650761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:33.650761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:33.650761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:33.650761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:33.650761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:33.650761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:33.650761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:33.650761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:33.650761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:33.650761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 140/274] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:33.658737 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d8b01-ea32-4bd3-8c13-6ac72778e162 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:33.762812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:33.776998 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1111e-c8b5-42a0-b7a1-ef1f038633ff None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:33.822871 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227151d4-82a3-4fce-a086-72e4fb24397e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:33.823624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227151d4-82a3-4fce-a086-72e4fb24397e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:33.823903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227151d4-82a3-4fce-a086-72e4fb24397e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:33.824923 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227151d4-82a3-4fce-a086-72e4fb24397e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:33.828373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227151d4-82a3-4fce-a086-72e4fb24397e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:33.830708 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227151d4-82a3-4fce-a086-72e4fb24397e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:33.834122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 135/275] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:33.839085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227151d4-82a3-4fce-a086-72e4fb24397e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:33.855822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:33.860243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d8b01-ea32-4bd3-8c13-6ac72778e162 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:33.898040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf7171-3603-456d-89c9-17dc19f61b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:33.899036 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf7171-3603-456d-89c9-17dc19f61b93 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:33.899142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf7171-3603-456d-89c9-17dc19f61b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:33.899455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf7171-3603-456d-89c9-17dc19f61b93 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:33.900303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf7171-3603-456d-89c9-17dc19f61b93 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:33.900683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf7171-3603-456d-89c9-17dc19f61b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:33.902129 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf7171-3603-456d-89c9-17dc19f61b93 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:33.912270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 141/276] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:33.917578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf7171-3603-456d-89c9-17dc19f61b93 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:33.970893 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227151d4-82a3-4fce-a086-72e4fb24397e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:34.018327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af64c-c80f-4906-93c8-e81108564f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:34.019004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af64c-c80f-4906-93c8-e81108564f11 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:34.019279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af64c-c80f-4906-93c8-e81108564f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:34.019551 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af64c-c80f-4906-93c8-e81108564f11 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:34.020356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af64c-c80f-4906-93c8-e81108564f11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:34.021948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af64c-c80f-4906-93c8-e81108564f11 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:34.035348 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf7171-3603-456d-89c9-17dc19f61b93 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:34.045160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 136/277] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:16:33 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:16:34.049157 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8da55-e1e8-47fe-aaf2-2d4e271f9752 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:34.049521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8da55-e1e8-47fe-aaf2-2d4e271f9752 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:34.049872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8da55-e1e8-47fe-aaf2-2d4e271f9752 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:34.051660 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 137/278] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:34.058051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a327c8-f994-4e97-80f0-240b05116e70 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:34.058408 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a327c8-f994-4e97-80f0-240b05116e70 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:34.058712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a327c8-f994-4e97-80f0-240b05116e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:34.077707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-65a327c8-f994-4e97-80f0-240b05116e70 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:34.079008 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-65a327c8-f994-4e97-80f0-240b05116e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:34.082958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:34.086201 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db2b12-e7cb-4c4c-a309-bd6a4d5fcc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:34.087544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db2b12-e7cb-4c4c-a309-bd6a4d5fcc82 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:34.088267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db2b12-e7cb-4c4c-a309-bd6a4d5fcc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:34.088784 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db2b12-e7cb-4c4c-a309-bd6a4d5fcc82 None admin] PATH_INFO: `/v3/users/420d58a584904ba99ae41fac4d654582` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:34.107821 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db2b12-e7cb-4c4c-a309-bd6a4d5fcc82 None admin] RBAC: Authorizing `identity:get_user(user_id=420d58a584904ba99ae41fac4d654582)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:34.109963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db2b12-e7cb-4c4c-a309-bd6a4d5fcc82 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:34.112724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 142/279] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:33 2022] GET /identity/v3/users/420d58a584904ba99ae41fac4d654582 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:34.118654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db2b12-e7cb-4c4c-a309-bd6a4d5fcc82 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:34.145251 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:34.166732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 138/280] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:34.189630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a327c8-f994-4e97-80f0-240b05116e70 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:34.255771 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db2b12-e7cb-4c4c-a309-bd6a4d5fcc82 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:34.304393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdd05e-32e6-4768-b5e6-370a813bf28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:34.305152 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdd05e-32e6-4768-b5e6-370a813bf28c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:34.305434 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdd05e-32e6-4768-b5e6-370a813bf28c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:34.305710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdd05e-32e6-4768-b5e6-370a813bf28c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:34.306557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdd05e-32e6-4768-b5e6-370a813bf28c None admin] RBAC: Adding query filter params (role.id=3fb4236a239b47e3ac59e14b3db524b1, user.id=420d58a584904ba99ae41fac4d654582, scope.system=all) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:34.306859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdd05e-32e6-4768-b5e6-370a813bf28c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:34.308393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdd05e-32e6-4768-b5e6-370a813bf28c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:34.314485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 143/281] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 21 08:16:34 2022] GET /identity/v3/role_assignments?user.id=420d58a584904ba99ae41fac4d654582&scope.system=all&role.id=3fb4236a239b47e3ac59e14b3db524b1 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:34.315567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a327c8-f994-4e97-80f0-240b05116e70 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:34.364982 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc7d33-4da8-4219-bcaf-78e3202477d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:34.366091 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc7d33-4da8-4219-bcaf-78e3202477d5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:34.366514 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc7d33-4da8-4219-bcaf-78e3202477d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:34.366922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc7d33-4da8-4219-bcaf-78e3202477d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:34.377030 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:34.381508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc7d33-4da8-4219-bcaf-78e3202477d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-c0cc7d33-4da8-4219-bcaf-78e3202477d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:34.390081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:34.391221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:34.392112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:34.392112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:34.392112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:34.392112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:34.392112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:34.392112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:34.392112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:34.392112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:34.392112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:34.392112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:34.392112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:34.392112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:34.397919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 139/282] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:16:34.399663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdd05e-32e6-4768-b5e6-370a813bf28c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:34.513354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:34.535389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdd05e-32e6-4768-b5e6-370a813bf28c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:34.571013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a5a63-0801-48ba-9bbb-7ab31ba4ad31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:34.571812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a5a63-0801-48ba-9bbb-7ab31ba4ad31 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:34.572014 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a5a63-0801-48ba-9bbb-7ab31ba4ad31 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:34.572573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a5a63-0801-48ba-9bbb-7ab31ba4ad31 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:34.573033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a5a63-0801-48ba-9bbb-7ab31ba4ad31 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:34.573339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a5a63-0801-48ba-9bbb-7ab31ba4ad31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:34.574741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a5a63-0801-48ba-9bbb-7ab31ba4ad31 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:34.584589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 144/283] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:34.592924 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc7d33-4da8-4219-bcaf-78e3202477d5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:34.659992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323b7dd-2666-407f-a205-95d8057cd55a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:34.660283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323b7dd-2666-407f-a205-95d8057cd55a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:34.660564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323b7dd-2666-407f-a205-95d8057cd55a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:34.662501 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 145/284] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:34.667930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3c383-3d33-4723-b3bd-e456e836b77a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:34.668217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3c383-3d33-4723-b3bd-e456e836b77a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:34.668502 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3c383-3d33-4723-b3bd-e456e836b77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:34.709029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-64f3c383-3d33-4723-b3bd-e456e836b77a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:34.710911 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-64f3c383-3d33-4723-b3bd-e456e836b77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:34.748929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc7d33-4da8-4219-bcaf-78e3202477d5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:34.797162 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3ff38-3c6d-4f95-8f99-9ad3ef587b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:34.803760 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3ff38-3c6d-4f95-8f99-9ad3ef587b09 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:34.804047 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3ff38-3c6d-4f95-8f99-9ad3ef587b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:34.804327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3ff38-3c6d-4f95-8f99-9ad3ef587b09 None admin] PATH_INFO: `/v3/users/308fbfd2eb2e41ca9c9ebccbc854e20d` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:34.805786 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3ff38-3c6d-4f95-8f99-9ad3ef587b09 None admin] RBAC: Authorizing `identity:get_user(user_id=308fbfd2eb2e41ca9c9ebccbc854e20d)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:34.807274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3ff38-3c6d-4f95-8f99-9ad3ef587b09 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:34.808985 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 140/285] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:34 2022] GET /identity/v3/users/308fbfd2eb2e41ca9c9ebccbc854e20d => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:34.815343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3ff38-3c6d-4f95-8f99-9ad3ef587b09 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:34.862838 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 146/286] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:16:34.894473 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3c383-3d33-4723-b3bd-e456e836b77a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:34.918707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:34.981558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3ff38-3c6d-4f95-8f99-9ad3ef587b09 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:34.992277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:35.022336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3c383-3d33-4723-b3bd-e456e836b77a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:35.060032 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962cb8e-7246-4839-8160-becd0bec6f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:35.061121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962cb8e-7246-4839-8160-becd0bec6f99 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:35.061410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962cb8e-7246-4839-8160-becd0bec6f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:35.061690 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962cb8e-7246-4839-8160-becd0bec6f99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:35.072230 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ac3df-0438-4f1b-9d3a-1210acf0869a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:35.072640 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962cb8e-7246-4839-8160-becd0bec6f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:35.073120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ac3df-0438-4f1b-9d3a-1210acf0869a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:35.073405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ac3df-0438-4f1b-9d3a-1210acf0869a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:35.073682 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ac3df-0438-4f1b-9d3a-1210acf0869a None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:35.074893 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ac3df-0438-4f1b-9d3a-1210acf0869a None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:35.076399 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ac3df-0438-4f1b-9d3a-1210acf0869a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:35.078154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 141/287] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:34 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b962cb8e-7246-4839-8160-becd0bec6f99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:35.080904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:35.081740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:35.082922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:35.082922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:35.082922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:35.082922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:35.082922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:35.082922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:35.082922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:35.082922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:35.082922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:35.082922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:35.082922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:35.082922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:35.082922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 147/288] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:35.088932 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962cb8e-7246-4839-8160-becd0bec6f99 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:35.089073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ac3df-0438-4f1b-9d3a-1210acf0869a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:35.206281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962cb8e-7246-4839-8160-becd0bec6f99 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:35.244962 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d858be0-bc0f-4088-a5c0-cf0287712337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:35.245653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d858be0-bc0f-4088-a5c0-cf0287712337 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:35.245936 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d858be0-bc0f-4088-a5c0-cf0287712337 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:35.246213 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d858be0-bc0f-4088-a5c0-cf0287712337 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:35.246980 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d858be0-bc0f-4088-a5c0-cf0287712337 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:35.247290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d858be0-bc0f-4088-a5c0-cf0287712337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:35.249234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d858be0-bc0f-4088-a5c0-cf0287712337 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:35.258670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 148/289] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:35.259281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:35.264706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d858be0-bc0f-4088-a5c0-cf0287712337 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:35.336039 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ac3df-0438-4f1b-9d3a-1210acf0869a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:35.398432 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf196a-2937-474d-a9bf-77258ef71f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:35.400105 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf196a-2937-474d-a9bf-77258ef71f0b None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:35.400393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf196a-2937-474d-a9bf-77258ef71f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:35.400664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf196a-2937-474d-a9bf-77258ef71f0b None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce/users/308fbfd2eb2e41ca9c9ebccbc854e20d/roles/e8fe982879094fdda82d271ad13509de` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:35.407550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf196a-2937-474d-a9bf-77258ef71f0b None admin] RBAC: Authorizing `identity:create_grant(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce, user_id=308fbfd2eb2e41ca9c9ebccbc854e20d, role_id=e8fe982879094fdda82d271ad13509de)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:35.409072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf196a-2937-474d-a9bf-77258ef71f0b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:35.414087 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:35.435870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 142/290] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:16:35 2022] PUT /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce/users/308fbfd2eb2e41ca9c9ebccbc854e20d/roles/e8fe982879094fdda82d271ad13509de => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:16:35.461438 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d858be0-bc0f-4088-a5c0-cf0287712337 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:35.511951 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112f521-f5c0-49c9-8ae2-94dda158a46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:35.512858 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112f521-f5c0-49c9-8ae2-94dda158a46b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:35.513135 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112f521-f5c0-49c9-8ae2-94dda158a46b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:35.513462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112f521-f5c0-49c9-8ae2-94dda158a46b None admin] PATH_INFO: `/v3/users/138005e28a90469a99a816c7a5fb7906` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:35.514747 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112f521-f5c0-49c9-8ae2-94dda158a46b None admin] RBAC: Authorizing `identity:get_user(user_id=138005e28a90469a99a816c7a5fb7906)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:35.516328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112f521-f5c0-49c9-8ae2-94dda158a46b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:35.518521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 149/291] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:35 2022] GET /identity/v3/users/138005e28a90469a99a816c7a5fb7906 => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:35.526009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf196a-2937-474d-a9bf-77258ef71f0b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:35.656435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf196a-2937-474d-a9bf-77258ef71f0b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:35.696125 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579078f-a480-418f-baa4-22a987bf4892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:35.696785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579078f-a480-418f-baa4-22a987bf4892 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:35.697068 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579078f-a480-418f-baa4-22a987bf4892 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:35.697344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579078f-a480-418f-baa4-22a987bf4892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:35.764133 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:35.772772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579078f-a480-418f-baa4-22a987bf4892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:35.774293 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579078f-a480-418f-baa4-22a987bf4892 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:35.912317 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 143/292] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:35.918243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112f521-f5c0-49c9-8ae2-94dda158a46b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:36.016329 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:36.090591 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112f521-f5c0-49c9-8ae2-94dda158a46b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:36.144157 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b95269-1984-48bd-9d53-82e9d9c22845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:36.145434 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95269-1984-48bd-9d53-82e9d9c22845 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:36.145944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95269-1984-48bd-9d53-82e9d9c22845 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:36.146427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95269-1984-48bd-9d53-82e9d9c22845 None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:36.147843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b95269-1984-48bd-9d53-82e9d9c22845 None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:36.149525 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b95269-1984-48bd-9d53-82e9d9c22845 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:36.151425 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 150/293] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:35 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:36.164957 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579078f-a480-418f-baa4-22a987bf4892 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:36.301215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:36.307917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579078f-a480-418f-baa4-22a987bf4892 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:36.349281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a811eb6-c68c-4f36-b262-ba46e950f228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:36.349938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a811eb6-c68c-4f36-b262-ba46e950f228 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:36.350219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a811eb6-c68c-4f36-b262-ba46e950f228 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:36.350495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a811eb6-c68c-4f36-b262-ba46e950f228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:36.351335 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a811eb6-c68c-4f36-b262-ba46e950f228 None admin] RBAC: Adding query filter params (role.id=3fb4236a239b47e3ac59e14b3db524b1, scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce, user.id=138005e28a90469a99a816c7a5fb7906) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:36.351665 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a811eb6-c68c-4f36-b262-ba46e950f228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:36.353112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a811eb6-c68c-4f36-b262-ba46e950f228 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:36.364360 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 144/294] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:36 2022] GET /identity/v3/role_assignments?user.id=138005e28a90469a99a816c7a5fb7906&scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce&role.id=3fb4236a239b47e3ac59e14b3db524b1 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:36.660988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3fb30-66ba-4e65-b5db-c4f89103e0a7 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:36.661813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3fb30-66ba-4e65-b5db-c4f89103e0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:36.662375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3fb30-66ba-4e65-b5db-c4f89103e0a7 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:36.664326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 151/295] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:36.669528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61be9c-d4ee-4a60-b329-ee534549f03b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:36.670416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61be9c-d4ee-4a60-b329-ee534549f03b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:36.670878 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61be9c-d4ee-4a60-b329-ee534549f03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:36.693443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ab61be9c-d4ee-4a60-b329-ee534549f03b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:36.694973 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ab61be9c-d4ee-4a60-b329-ee534549f03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:36.763252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 145/296] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:36.788776 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3fb30-66ba-4e65-b5db-c4f89103e0a7 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:36.925465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3fb30-66ba-4e65-b5db-c4f89103e0a7 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:36.943549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377d177-634f-44d3-b19e-ada2b96ec2e4 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:36.944198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377d177-634f-44d3-b19e-ada2b96ec2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:36.944659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377d177-634f-44d3-b19e-ada2b96ec2e4 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:36.948208 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 146/297] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:36.949740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196e6ae-cbc5-4053-a69b-09cbba8a1756 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:36.950221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196e6ae-cbc5-4053-a69b-09cbba8a1756 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:36.950683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196e6ae-cbc5-4053-a69b-09cbba8a1756 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:36.953978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 147/298] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:36.955576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b62e7-e710-414e-9aa7-d90edd827ffc None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:36.956106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b62e7-e710-414e-9aa7-d90edd827ffc None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:36.956587 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b62e7-e710-414e-9aa7-d90edd827ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:36.960184 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:36.966451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b47ec-6473-4bae-92d6-a4772b125f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:36.967271 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b47ec-6473-4bae-92d6-a4772b125f68 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:36.967559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b47ec-6473-4bae-92d6-a4772b125f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:36.967893 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b47ec-6473-4bae-92d6-a4772b125f68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:36.969088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b47ec-6473-4bae-92d6-a4772b125f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:36.970559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b47ec-6473-4bae-92d6-a4772b125f68 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:36.972408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 152/299] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:36.973407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fc2ab-02ea-4710-8eb6-82051769c9a3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:36.974270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fc2ab-02ea-4710-8eb6-82051769c9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:36.974639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fc2ab-02ea-4710-8eb6-82051769c9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:36.975647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-065b62e7-e710-414e-9aa7-d90edd827ffc None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:36.976962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-065b62e7-e710-414e-9aa7-d90edd827ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:36.997738 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-106fc2ab-02ea-4710-8eb6-82051769c9a3 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:36.998943 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-106fc2ab-02ea-4710-8eb6-82051769c9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:37.046989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 148/300] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:37.053501 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b62e7-e710-414e-9aa7-d90edd827ffc None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:37.071018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 153/301] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:37.071935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fc2ab-02ea-4710-8eb6-82051769c9a3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:37.083784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:37.169730 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b62e7-e710-414e-9aa7-d90edd827ffc None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:37.181914 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fc2ab-02ea-4710-8eb6-82051769c9a3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:37.204273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446e7f6-6b34-4236-86c9-2540b095019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:37.204929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446e7f6-6b34-4236-86c9-2540b095019c None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:37.205207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446e7f6-6b34-4236-86c9-2540b095019c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:37.205473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446e7f6-6b34-4236-86c9-2540b095019c None admin] PATH_INFO: `/v3/groups` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:37.206203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446e7f6-6b34-4236-86c9-2540b095019c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:37.207677 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446e7f6-6b34-4236-86c9-2540b095019c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:37.212384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:37.219190 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cca25-f243-4fa8-864d-3c65dda00465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:37.220063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cca25-f243-4fa8-864d-3c65dda00465 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:37.220326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cca25-f243-4fa8-864d-3c65dda00465 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:37.220607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cca25-f243-4fa8-864d-3c65dda00465 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:37.224385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 149/302] 10.222.0.64 () {60 vars in 1134 bytes} [Thu Jul 21 08:16:37 2022] POST /identity/v3/groups => generated 229 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:16:37.225196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446e7f6-6b34-4236-86c9-2540b095019c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:37.249573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cca25-f243-4fa8-864d-3c65dda00465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-fb3cca25-f243-4fa8-864d-3c65dda00465 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:37.263521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:37.264785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:37.265569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:37.265569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:37.265569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:37.265569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:37.265569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:37.265569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:37.265569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:37.265569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:37.265569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:37.265569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:37.265569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:37.265569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:37.274873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 154/303] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:37.275364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cca25-f243-4fa8-864d-3c65dda00465 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:37.340375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:37.369575 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446e7f6-6b34-4236-86c9-2540b095019c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:37.407133 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cca25-f243-4fa8-864d-3c65dda00465 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:37.410817 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817723b-a688-4957-9369-745e9e251949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:37.412215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817723b-a688-4957-9369-745e9e251949 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:37.412505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817723b-a688-4957-9369-745e9e251949 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:37.412784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817723b-a688-4957-9369-745e9e251949 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:37.425188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817723b-a688-4957-9369-745e9e251949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-d817723b-a688-4957-9369-745e9e251949 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:37.435152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:37.436400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:37.437368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:37.437368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:37.437368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:37.437368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:37.437368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:37.437368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:37.437368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:37.437368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:37.437368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:37.437368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:37.437368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:37.437368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:37.437368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 150/304] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:37.440620 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817723b-a688-4957-9369-745e9e251949 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:37.459170 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bab25-455d-49ae-bb12-5ca5c0d76cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:37.460177 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bab25-455d-49ae-bb12-5ca5c0d76cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:37.460603 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bab25-455d-49ae-bb12-5ca5c0d76cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:37.460873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bab25-455d-49ae-bb12-5ca5c0d76cf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:37.461754 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bab25-455d-49ae-bb12-5ca5c0d76cf2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:37.462169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bab25-455d-49ae-bb12-5ca5c0d76cf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:37.463654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bab25-455d-49ae-bb12-5ca5c0d76cf2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:37.475798 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 155/305] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:37.482417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bab25-455d-49ae-bb12-5ca5c0d76cf2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:37.542435 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:37.587860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817723b-a688-4957-9369-745e9e251949 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:37.594601 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bab25-455d-49ae-bb12-5ca5c0d76cf2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:37.630873 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a274db-b95d-4867-a600-a7aa66405feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:37.631692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b388edc-6d15-4dc6-9df2-010bdcca47e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:37.632008 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a274db-b95d-4867-a600-a7aa66405feb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:37.632439 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a274db-b95d-4867-a600-a7aa66405feb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:37.632580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b388edc-6d15-4dc6-9df2-010bdcca47e0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:37.632861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b388edc-6d15-4dc6-9df2-010bdcca47e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:37.633136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b388edc-6d15-4dc6-9df2-010bdcca47e0 None admin] PATH_INFO: `/v3/users/0fffb6d009fa46109b5c4f45b2707257` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:37.633276 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a274db-b95d-4867-a600-a7aa66405feb None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:37.634169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a274db-b95d-4867-a600-a7aa66405feb None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:37.634616 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a274db-b95d-4867-a600-a7aa66405feb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:37.636267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a274db-b95d-4867-a600-a7aa66405feb None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:37.645687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 151/306] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:37.649116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b388edc-6d15-4dc6-9df2-010bdcca47e0 None admin] RBAC: Authorizing `identity:get_user(user_id=0fffb6d009fa46109b5c4f45b2707257)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:37.650688 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b388edc-6d15-4dc6-9df2-010bdcca47e0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:37.651415 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a274db-b95d-4867-a600-a7aa66405feb None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:37.653147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 156/307] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:37 2022] GET /identity/v3/users/0fffb6d009fa46109b5c4f45b2707257 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:37.655558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:37.658809 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b388edc-6d15-4dc6-9df2-010bdcca47e0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:37.755785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a274db-b95d-4867-a600-a7aa66405feb None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:37.770362 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b388edc-6d15-4dc6-9df2-010bdcca47e0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:37.783386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:37.792642 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dcb17-23f8-495a-bcc3-d528f588fe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:37.793871 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dcb17-23f8-495a-bcc3-d528f588fe94 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:37.794331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dcb17-23f8-495a-bcc3-d528f588fe94 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:37.794789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dcb17-23f8-495a-bcc3-d528f588fe94 None admin] PATH_INFO: `/v3/users/420d58a584904ba99ae41fac4d654582` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:37.796237 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dcb17-23f8-495a-bcc3-d528f588fe94 None admin] RBAC: Authorizing `identity:get_user(user_id=420d58a584904ba99ae41fac4d654582)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:37.797914 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dcb17-23f8-495a-bcc3-d528f588fe94 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:37.800111 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 152/308] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:37 2022] GET /identity/v3/users/420d58a584904ba99ae41fac4d654582 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:37.805860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dcb17-23f8-495a-bcc3-d528f588fe94 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:37.816492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8fdb5-6bd8-4095-9e56-b7ea30c61497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:37.817167 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8fdb5-6bd8-4095-9e56-b7ea30c61497 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:37.817652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8fdb5-6bd8-4095-9e56-b7ea30c61497 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:37.818030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8fdb5-6bd8-4095-9e56-b7ea30c61497 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:37.819047 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8fdb5-6bd8-4095-9e56-b7ea30c61497 None admin] RBAC: Adding query filter params (role.id=e8fe982879094fdda82d271ad13509de, user.id=0fffb6d009fa46109b5c4f45b2707257, scope.system=all) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:37.819365 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8fdb5-6bd8-4095-9e56-b7ea30c61497 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:37.821002 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8fdb5-6bd8-4095-9e56-b7ea30c61497 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:37.832144 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 157/309] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 21 08:16:37 2022] GET /identity/v3/role_assignments?user.id=0fffb6d009fa46109b5c4f45b2707257&scope.system=all&role.id=e8fe982879094fdda82d271ad13509de => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:37.837206 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384a419-a900-4b33-811e-6370fd235753 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:37.837493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384a419-a900-4b33-811e-6370fd235753 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:37.837773 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384a419-a900-4b33-811e-6370fd235753 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:37.839378 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 158/310] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:16:37.845093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0ab10-f7ac-4d6b-bb93-b360ad46cf20 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:37.845371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0ab10-f7ac-4d6b-bb93-b360ad46cf20 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:37.845658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0ab10-f7ac-4d6b-bb93-b360ad46cf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:37.863136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4ed0ab10-f7ac-4d6b-bb93-b360ad46cf20 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:37.864408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4ed0ab10-f7ac-4d6b-bb93-b360ad46cf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:37.887954 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:37.924121 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dcb17-23f8-495a-bcc3-d528f588fe94 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:37.948037 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 159/311] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:16:37.962604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be48f0-4f1c-418b-b04a-bdf49898bf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:37.964059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be48f0-4f1c-418b-b04a-bdf49898bf91 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:37.964558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be48f0-4f1c-418b-b04a-bdf49898bf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:37.965066 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be48f0-4f1c-418b-b04a-bdf49898bf91 None admin] PATH_INFO: `/v3/system/users/420d58a584904ba99ae41fac4d654582/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:37.966893 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0ab10-f7ac-4d6b-bb93-b360ad46cf20 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:37.967142 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be48f0-4f1c-418b-b04a-bdf49898bf91 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=420d58a584904ba99ae41fac4d654582, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:37.968906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be48f0-4f1c-418b-b04a-bdf49898bf91 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:37.982595 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 153/312] 10.222.0.64 () {58 vars in 1334 bytes} [Thu Jul 21 08:16:37 2022] PUT /identity/v3/system/users/420d58a584904ba99ae41fac4d654582/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:16:38.097982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0ab10-f7ac-4d6b-bb93-b360ad46cf20 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:38.101394 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:38.137633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c644c8-835b-4e99-a15b-1471547870a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:38.138536 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c644c8-835b-4e99-a15b-1471547870a1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:38.138871 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c644c8-835b-4e99-a15b-1471547870a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:38.139151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c644c8-835b-4e99-a15b-1471547870a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:38.151316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c644c8-835b-4e99-a15b-1471547870a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-47c644c8-835b-4e99-a15b-1471547870a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:38.159548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:38.160445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:38.161371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:38.161371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:38.161371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:38.161371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:38.161371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:38.161371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:38.161371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:38.161371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:38.161371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:38.161371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:38.161371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:38.161371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:38.161371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 160/313] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:16:38.166778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be48f0-4f1c-418b-b04a-bdf49898bf91 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:38.270061 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be48f0-4f1c-418b-b04a-bdf49898bf91 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:38.304466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b378d-ea53-43dc-9518-f86c9cf08369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:38.305236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b378d-ea53-43dc-9518-f86c9cf08369 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:38.305521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b378d-ea53-43dc-9518-f86c9cf08369 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:38.305798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b378d-ea53-43dc-9518-f86c9cf08369 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:38.306561 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b378d-ea53-43dc-9518-f86c9cf08369 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:38.306867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b378d-ea53-43dc-9518-f86c9cf08369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:38.308297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b378d-ea53-43dc-9518-f86c9cf08369 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:38.309838 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:38.318965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 154/314] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:38.324342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c644c8-835b-4e99-a15b-1471547870a1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:38.432516 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c644c8-835b-4e99-a15b-1471547870a1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:38.469829 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d64ab9-8a0c-4324-89fa-c6be4ade24c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:38.470772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d64ab9-8a0c-4324-89fa-c6be4ade24c8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:38.471060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d64ab9-8a0c-4324-89fa-c6be4ade24c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:38.471344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d64ab9-8a0c-4324-89fa-c6be4ade24c8 None admin] PATH_INFO: `/v3/users/308fbfd2eb2e41ca9c9ebccbc854e20d` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:38.472641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d64ab9-8a0c-4324-89fa-c6be4ade24c8 None admin] RBAC: Authorizing `identity:get_user(user_id=308fbfd2eb2e41ca9c9ebccbc854e20d)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:38.474545 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d64ab9-8a0c-4324-89fa-c6be4ade24c8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:38.476574 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 161/315] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:38 2022] GET /identity/v3/users/308fbfd2eb2e41ca9c9ebccbc854e20d => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:38.481887 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b378d-ea53-43dc-9518-f86c9cf08369 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:38.587772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b378d-ea53-43dc-9518-f86c9cf08369 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:38.626518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10321333-b56f-4a1d-bd6f-c2051dd9c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:38.627175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10321333-b56f-4a1d-bd6f-c2051dd9c823 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:38.627457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10321333-b56f-4a1d-bd6f-c2051dd9c823 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:38.627809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10321333-b56f-4a1d-bd6f-c2051dd9c823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:38.690189 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:38.696767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10321333-b56f-4a1d-bd6f-c2051dd9c823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:38.698311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10321333-b56f-4a1d-bd6f-c2051dd9c823 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:38.797204 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 155/316] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:38.803038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d64ab9-8a0c-4324-89fa-c6be4ade24c8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:38.835022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:38.910029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d64ab9-8a0c-4324-89fa-c6be4ade24c8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:38.946455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c985297-dcd7-4219-9043-fa4a3a095557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:38.947245 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985297-dcd7-4219-9043-fa4a3a095557 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:38.947527 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985297-dcd7-4219-9043-fa4a3a095557 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:38.947831 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985297-dcd7-4219-9043-fa4a3a095557 None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:38.949021 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c985297-dcd7-4219-9043-fa4a3a095557 None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:38.950499 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c985297-dcd7-4219-9043-fa4a3a095557 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:38.952244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 162/317] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:38 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:38.958716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10321333-b56f-4a1d-bd6f-c2051dd9c823 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:39.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:39.062804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10321333-b56f-4a1d-bd6f-c2051dd9c823 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:39.098072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e3c34-7407-4c73-94de-fdde73e9cc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:39.098808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e3c34-7407-4c73-94de-fdde73e9cc4a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:39.099091 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e3c34-7407-4c73-94de-fdde73e9cc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:39.099366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e3c34-7407-4c73-94de-fdde73e9cc4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:39.100243 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e3c34-7407-4c73-94de-fdde73e9cc4a None admin] RBAC: Adding query filter params (role.id=e8fe982879094fdda82d271ad13509de, scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce, user.id=308fbfd2eb2e41ca9c9ebccbc854e20d) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:39.100551 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e3c34-7407-4c73-94de-fdde73e9cc4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:39.102011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e3c34-7407-4c73-94de-fdde73e9cc4a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:39.108568 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 156/318] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:38 2022] GET /identity/v3/role_assignments?user.id=308fbfd2eb2e41ca9c9ebccbc854e20d&scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce&role.id=e8fe982879094fdda82d271ad13509de => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:39.449559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352174-3204-4aeb-b266-8aa0a8e2b842 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:39.449936 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352174-3204-4aeb-b266-8aa0a8e2b842 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:39.450106 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352174-3204-4aeb-b266-8aa0a8e2b842 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:39.451696 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 163/319] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:39.456904 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f9aac-93f8-46a2-817e-9c983f4477d3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:39.457187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f9aac-93f8-46a2-817e-9c983f4477d3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:39.457461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f9aac-93f8-46a2-817e-9c983f4477d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:39.475049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ea9f9aac-93f8-46a2-817e-9c983f4477d3 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:39.476269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ea9f9aac-93f8-46a2-817e-9c983f4477d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:39.545399 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 157/320] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:39.568018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39352174-3204-4aeb-b266-8aa0a8e2b842 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:39.671349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:39.676128 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39352174-3204-4aeb-b266-8aa0a8e2b842 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:39.710622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8379-d9cc-47bf-b902-afc93c16b125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:39.711341 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8379-d9cc-47bf-b902-afc93c16b125 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:39.711612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8379-d9cc-47bf-b902-afc93c16b125 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:39.711908 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8379-d9cc-47bf-b902-afc93c16b125 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:39.713068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde8379-d9cc-47bf-b902-afc93c16b125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:39.714625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde8379-d9cc-47bf-b902-afc93c16b125 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:39.716474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 164/321] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:39.722065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f9aac-93f8-46a2-817e-9c983f4477d3 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:39.814107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:39.825725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f9aac-93f8-46a2-817e-9c983f4477d3 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:39.861305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199e861-86f5-4fb9-bc11-19a841d61c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:39.861972 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199e861-86f5-4fb9-bc11-19a841d61c11 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:39.862247 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199e861-86f5-4fb9-bc11-19a841d61c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:39.862516 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199e861-86f5-4fb9-bc11-19a841d61c11 None admin] PATH_INFO: `/v3/groups` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:39.863214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199e861-86f5-4fb9-bc11-19a841d61c11 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:39.864812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199e861-86f5-4fb9-bc11-19a841d61c11 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:39.879542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 158/322] 10.222.0.64 () {60 vars in 1134 bytes} [Thu Jul 21 08:16:39 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:16:39.981012 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cede0-07a1-4040-ba16-f4f75e5e9788 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:39.981522 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cede0-07a1-4040-ba16-f4f75e5e9788 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:39.981522 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cede0-07a1-4040-ba16-f4f75e5e9788 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:39.983052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 165/323] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:39.988679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6f537-030f-44ab-bf7d-fd0234054b39 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:39.988974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6f537-030f-44ab-bf7d-fd0234054b39 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:39.989304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6f537-030f-44ab-bf7d-fd0234054b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:40.007646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-fab6f537-030f-44ab-bf7d-fd0234054b39 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:40.008859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fab6f537-030f-44ab-bf7d-fd0234054b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:40.085955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 159/324] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:40.109022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cede0-07a1-4040-ba16-f4f75e5e9788 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:40.164498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77a025-651d-4f4e-b073-6a4652746bc0 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:40.164939 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77a025-651d-4f4e-b073-6a4652746bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:40.165217 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77a025-651d-4f4e-b073-6a4652746bc0 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:40.166601 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 160/325] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:16:40.172296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a429d-885a-4feb-8eac-2bf1821ff4f5 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:40.172868 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a429d-885a-4feb-8eac-2bf1821ff4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:40.173351 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a429d-885a-4feb-8eac-2bf1821ff4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:40.194354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3c5a429d-885a-4feb-8eac-2bf1821ff4f5 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:40.195571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3c5a429d-885a-4feb-8eac-2bf1821ff4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:40.225051 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cede0-07a1-4040-ba16-f4f75e5e9788 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:40.265332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a0463-90b7-45a4-b9d8-ccbdc412cb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:40.266066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a0463-90b7-45a4-b9d8-ccbdc412cb33 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:40.266344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a0463-90b7-45a4-b9d8-ccbdc412cb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:40.266883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a0463-90b7-45a4-b9d8-ccbdc412cb33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:40.278892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 161/326] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:40.285270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a0463-90b7-45a4-b9d8-ccbdc412cb33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-0d9a0463-90b7-45a4-b9d8-ccbdc412cb33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:40.296840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:40.297780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:40.298643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:40.298643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:40.298643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:40.298643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:40.298643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:40.298643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:40.298643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:40.298643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:40.298643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:40.298643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:40.298643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:40.298643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:40.298643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 166/327] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:40.303096 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a429d-885a-4feb-8eac-2bf1821ff4f5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:40.305543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a0463-90b7-45a4-b9d8-ccbdc412cb33 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:40.317608 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:40.345945 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:40.441611 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a429d-885a-4feb-8eac-2bf1821ff4f5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:40.444342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a0463-90b7-45a4-b9d8-ccbdc412cb33 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:40.488517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7cbe9-112a-4697-8ba2-7e7db1e1b2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:40.489553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7cbe9-112a-4697-8ba2-7e7db1e1b2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:40.489908 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7cbe9-112a-4697-8ba2-7e7db1e1b2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:40.492071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7cbe9-112a-4697-8ba2-7e7db1e1b2b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:40.492071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7cbe9-112a-4697-8ba2-7e7db1e1b2b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:40.492071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7cbe9-112a-4697-8ba2-7e7db1e1b2b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:40.493014 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7cbe9-112a-4697-8ba2-7e7db1e1b2b9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:40.494007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a8931-d6a5-45c9-973a-b7851c6f2976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:40.495039 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a8931-d6a5-45c9-973a-b7851c6f2976 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:40.495546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a8931-d6a5-45c9-973a-b7851c6f2976 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:40.496034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a8931-d6a5-45c9-973a-b7851c6f2976 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:40.503379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 167/328] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:40.508803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7cbe9-112a-4697-8ba2-7e7db1e1b2b9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:40.509566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a8931-d6a5-45c9-973a-b7851c6f2976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-3b8a8931-d6a5-45c9-973a-b7851c6f2976 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:40.517884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:40.518840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:40.519641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:40.519641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:40.519641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:40.519641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:40.519641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:40.519641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:40.519641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:40.519641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:40.519641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:40.519641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:40.519641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:40.519641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:40.526982 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 162/329] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:40.528981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a8931-d6a5-45c9-973a-b7851c6f2976 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:40.612261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:40.627964 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:40.637182 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7cbe9-112a-4697-8ba2-7e7db1e1b2b9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:40.652410 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a8931-d6a5-45c9-973a-b7851c6f2976 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:40.679993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70033b-e16d-4ef5-b077-ef8aa9a3c5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:40.681300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70033b-e16d-4ef5-b077-ef8aa9a3c5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:40.681803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70033b-e16d-4ef5-b077-ef8aa9a3c5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:40.682295 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70033b-e16d-4ef5-b077-ef8aa9a3c5d8 None admin] PATH_INFO: `/v3/users/0fffb6d009fa46109b5c4f45b2707257` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:40.684847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70033b-e16d-4ef5-b077-ef8aa9a3c5d8 None admin] RBAC: Authorizing `identity:get_user(user_id=0fffb6d009fa46109b5c4f45b2707257)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:40.686515 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70033b-e16d-4ef5-b077-ef8aa9a3c5d8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:40.688411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 168/330] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:40 2022] GET /identity/v3/users/0fffb6d009fa46109b5c4f45b2707257 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:40.693256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7749c9-30df-411d-a75e-6c6c1608e7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:40.693446 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7749c9-30df-411d-a75e-6c6c1608e7ea None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:40.693704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7749c9-30df-411d-a75e-6c6c1608e7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:40.693911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7749c9-30df-411d-a75e-6c6c1608e7ea None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:40.694681 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7749c9-30df-411d-a75e-6c6c1608e7ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:40.694993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7749c9-30df-411d-a75e-6c6c1608e7ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:40.695403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70033b-e16d-4ef5-b077-ef8aa9a3c5d8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:40.696410 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7749c9-30df-411d-a75e-6c6c1608e7ea None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:40.713835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 163/331] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:40.723812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7749c9-30df-411d-a75e-6c6c1608e7ea None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:40.835307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70033b-e16d-4ef5-b077-ef8aa9a3c5d8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:40.866442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7749c9-30df-411d-a75e-6c6c1608e7ea None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:40.870924 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600735f2-63ec-4d72-82d8-e977de61e31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:40.871884 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600735f2-63ec-4d72-82d8-e977de61e31e None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:40.872166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600735f2-63ec-4d72-82d8-e977de61e31e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:40.872444 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600735f2-63ec-4d72-82d8-e977de61e31e None admin] PATH_INFO: `/v3/system/users/0fffb6d009fa46109b5c4f45b2707257/roles/e8fe982879094fdda82d271ad13509de` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:40.874055 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600735f2-63ec-4d72-82d8-e977de61e31e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0fffb6d009fa46109b5c4f45b2707257, role_id=e8fe982879094fdda82d271ad13509de)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:40.875516 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600735f2-63ec-4d72-82d8-e977de61e31e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:40.889566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 169/332] 10.222.0.64 () {58 vars in 1334 bytes} [Thu Jul 21 08:16:40 2022] PUT /identity/v3/system/users/0fffb6d009fa46109b5c4f45b2707257/roles/e8fe982879094fdda82d271ad13509de => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:16:40.903792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:40.909706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc15e6-b905-45b3-a38e-6d6ea4ba845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:40.910699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc15e6-b905-45b3-a38e-6d6ea4ba845b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:40.911143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc15e6-b905-45b3-a38e-6d6ea4ba845b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:40.911425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc15e6-b905-45b3-a38e-6d6ea4ba845b None admin] PATH_INFO: `/v3/users/420d58a584904ba99ae41fac4d654582` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:40.912944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc15e6-b905-45b3-a38e-6d6ea4ba845b None admin] RBAC: Authorizing `identity:get_user(user_id=420d58a584904ba99ae41fac4d654582)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:40.914587 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc15e6-b905-45b3-a38e-6d6ea4ba845b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:40.916873 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 164/333] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:40 2022] GET /identity/v3/users/420d58a584904ba99ae41fac4d654582 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:40.924056 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600735f2-63ec-4d72-82d8-e977de61e31e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:40.960327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:41.053589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600735f2-63ec-4d72-82d8-e977de61e31e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:41.099902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b196fba-a722-47cd-928f-e56744fd9701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:41.100502 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b196fba-a722-47cd-928f-e56744fd9701 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:41.100786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b196fba-a722-47cd-928f-e56744fd9701 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:41.101060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b196fba-a722-47cd-928f-e56744fd9701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:41.101906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b196fba-a722-47cd-928f-e56744fd9701 None admin] RBAC: Adding query filter params (role.id=3fb4236a239b47e3ac59e14b3db524b1, user.id=420d58a584904ba99ae41fac4d654582, scope.system=all) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:41.102220 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b196fba-a722-47cd-928f-e56744fd9701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:41.103749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b196fba-a722-47cd-928f-e56744fd9701 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:41.117847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 170/334] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 21 08:16:40 2022] GET /identity/v3/role_assignments?user.id=420d58a584904ba99ae41fac4d654582&scope.system=all&role.id=3fb4236a239b47e3ac59e14b3db524b1 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:42.638435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e63ea8-9032-482b-91d0-a31c13c06dd9 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:42.638980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e63ea8-9032-482b-91d0-a31c13c06dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:42.638980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e63ea8-9032-482b-91d0-a31c13c06dd9 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:42.640410 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 165/335] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:42.645920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3159c-2435-4df8-9e63-d9ad481cef7b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:42.646354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3159c-2435-4df8-9e63-d9ad481cef7b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:42.646513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3159c-2435-4df8-9e63-d9ad481cef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:42.668603 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-75f3159c-2435-4df8-9e63-d9ad481cef7b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:42.669816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-75f3159c-2435-4df8-9e63-d9ad481cef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:42.758142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 171/336] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:42.795993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e63ea8-9032-482b-91d0-a31c13c06dd9 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:42.945236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e63ea8-9032-482b-91d0-a31c13c06dd9 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:42.957279 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeec6a-7cbd-4bd7-ba75-3a0e54ac492b None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:42.957577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeec6a-7cbd-4bd7-ba75-3a0e54ac492b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:42.957904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeec6a-7cbd-4bd7-ba75-3a0e54ac492b None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:42.959304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 172/337] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:42.968949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56094706-c758-4635-b88f-56eff4f5fbed None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:42.969244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56094706-c758-4635-b88f-56eff4f5fbed None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:42.969529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56094706-c758-4635-b88f-56eff4f5fbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:42.985206 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c9c50-5d2c-48db-b8a2-d47aa2a90914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:42.986036 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c9c50-5d2c-48db-b8a2-d47aa2a90914 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:42.986325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c9c50-5d2c-48db-b8a2-d47aa2a90914 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:42.986594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c9c50-5d2c-48db-b8a2-d47aa2a90914 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:43.006820 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-56094706-c758-4635-b88f-56eff4f5fbed None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:43.008067 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-56094706-c758-4635-b88f-56eff4f5fbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:43.010822 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c9c50-5d2c-48db-b8a2-d47aa2a90914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-c70c9c50-5d2c-48db-b8a2-d47aa2a90914 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:43.018902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:43.019794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:43.020937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:43.020937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:43.020937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:43.020937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:43.020937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:43.020937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:43.020937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:43.020937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:43.020937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:43.020937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:43.020937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:43.020937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:43.021973 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 166/338] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:16:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:43.028091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:43.030791 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c9c50-5d2c-48db-b8a2-d47aa2a90914 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:43.135381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:43.137748 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 173/339] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:43.168283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56094706-c758-4635-b88f-56eff4f5fbed None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:43.230601 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c9c50-5d2c-48db-b8a2-d47aa2a90914 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:43.297292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56094706-c758-4635-b88f-56eff4f5fbed None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:43.328333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481ed63-41ae-46c6-9b7e-29a789254cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:43.329021 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481ed63-41ae-46c6-9b7e-29a789254cda None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:43.329301 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481ed63-41ae-46c6-9b7e-29a789254cda None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:43.329576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481ed63-41ae-46c6-9b7e-29a789254cda None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:43.330341 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481ed63-41ae-46c6-9b7e-29a789254cda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:43.330652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481ed63-41ae-46c6-9b7e-29a789254cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:43.332091 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481ed63-41ae-46c6-9b7e-29a789254cda None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:43.351299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 167/340] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:43.351846 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405f61e-0861-4d8c-923a-e6a6cd99d66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:43.352777 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405f61e-0861-4d8c-923a-e6a6cd99d66b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:43.353063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405f61e-0861-4d8c-923a-e6a6cd99d66b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:43.353336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405f61e-0861-4d8c-923a-e6a6cd99d66b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:43.360873 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481ed63-41ae-46c6-9b7e-29a789254cda None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:43.370160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:43.376812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405f61e-0861-4d8c-923a-e6a6cd99d66b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b405f61e-0861-4d8c-923a-e6a6cd99d66b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:43.389277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:43.390212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:43.390982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:43.390982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:43.390982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:43.390982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:43.390982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:43.390982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:43.390982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:43.390982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:43.390982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:43.390982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:43.390982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:43.390982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:43.393441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 174/341] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:43.413320 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405f61e-0861-4d8c-923a-e6a6cd99d66b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:43.510451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481ed63-41ae-46c6-9b7e-29a789254cda None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:43.537624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:43.554552 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85294f-487f-4bbb-a12b-49d5323b5c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:43.555131 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85294f-487f-4bbb-a12b-49d5323b5c42 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:43.555415 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85294f-487f-4bbb-a12b-49d5323b5c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:43.555736 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85294f-487f-4bbb-a12b-49d5323b5c42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:43.608575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405f61e-0861-4d8c-923a-e6a6cd99d66b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:43.643930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a220723-7c79-47e0-bde1-feeb913b41c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:43.644611 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a220723-7c79-47e0-bde1-feeb913b41c9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:43.644890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a220723-7c79-47e0-bde1-feeb913b41c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:43.645255 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a220723-7c79-47e0-bde1-feeb913b41c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:43.646013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a220723-7c79-47e0-bde1-feeb913b41c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:43.646539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a220723-7c79-47e0-bde1-feeb913b41c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:43.647734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a220723-7c79-47e0-bde1-feeb913b41c9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:43.657447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 175/342] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:43.666247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a220723-7c79-47e0-bde1-feeb913b41c9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:43.692065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85294f-487f-4bbb-a12b-49d5323b5c42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:43.697019 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85294f-487f-4bbb-a12b-49d5323b5c42 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:43.774537 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:43.819332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a220723-7c79-47e0-bde1-feeb913b41c9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:43.854439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17588e40-5111-4497-8e8b-7df1407b245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:43.855147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17588e40-5111-4497-8e8b-7df1407b245f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:43.855424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17588e40-5111-4497-8e8b-7df1407b245f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:43.855755 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17588e40-5111-4497-8e8b-7df1407b245f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:43.906590 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 168/343] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:16:43.929131 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85294f-487f-4bbb-a12b-49d5323b5c42 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:43.941428 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17588e40-5111-4497-8e8b-7df1407b245f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:43.945256 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17588e40-5111-4497-8e8b-7df1407b245f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:43.977254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:44.012152 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:44.057794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 176/344] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:44.064865 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17588e40-5111-4497-8e8b-7df1407b245f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:44.128392 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85294f-487f-4bbb-a12b-49d5323b5c42 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:44.203890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f2868-b15a-45af-816f-b08a8bf2cccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:44.204690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f2868-b15a-45af-816f-b08a8bf2cccc None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.204970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f2868-b15a-45af-816f-b08a8bf2cccc None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.205330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f2868-b15a-45af-816f-b08a8bf2cccc None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.206547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f2868-b15a-45af-816f-b08a8bf2cccc None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:44.209222 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f2868-b15a-45af-816f-b08a8bf2cccc None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:44.210834 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 169/345] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:43 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:44.212108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafac85-e6da-4c7c-bf69-7858471ed46d None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.212391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafac85-e6da-4c7c-bf69-7858471ed46d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.212663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafac85-e6da-4c7c-bf69-7858471ed46d None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.214124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 170/346] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:44.220158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178582c-0f28-4203-bb24-f71fff578d4d None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.220158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178582c-0f28-4203-bb24-f71fff578d4d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.220356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178582c-0f28-4203-bb24-f71fff578d4d None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.221661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 171/347] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:44.222486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178582c-0f28-4203-bb24-f71fff578d4d None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:44.245571 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17588e40-5111-4497-8e8b-7df1407b245f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:44.283774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c87d25-0f4e-4c23-956c-5364bcc689ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:44.284954 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c87d25-0f4e-4c23-956c-5364bcc689ce None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.285213 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c87d25-0f4e-4c23-956c-5364bcc689ce None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.285752 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c87d25-0f4e-4c23-956c-5364bcc689ce None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.287376 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c87d25-0f4e-4c23-956c-5364bcc689ce None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:44.288891 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c87d25-0f4e-4c23-956c-5364bcc689ce None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:44.291543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 177/348] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:44 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:44.293385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c239cf-fc88-4de7-84e2-1ef9eb05044c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.293673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c239cf-fc88-4de7-84e2-1ef9eb05044c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.293936 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c239cf-fc88-4de7-84e2-1ef9eb05044c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.316845 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-78c239cf-fc88-4de7-84e2-1ef9eb05044c None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:44.318508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-78c239cf-fc88-4de7-84e2-1ef9eb05044c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:44.333083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:44.344393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178582c-0f28-4203-bb24-f71fff578d4d None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:44.355301 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:44.389743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaae3b3-e8bf-4475-ad01-ff3251cbe011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:44.390606 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaae3b3-e8bf-4475-ad01-ff3251cbe011 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.390881 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaae3b3-e8bf-4475-ad01-ff3251cbe011 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.391146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaae3b3-e8bf-4475-ad01-ff3251cbe011 None admin] PATH_INFO: `/v3/groups/1233459c76d449b19a6f1af5f3855e32` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.400576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaae3b3-e8bf-4475-ad01-ff3251cbe011 None admin] RBAC: Authorizing `identity:get_group(group_id=1233459c76d449b19a6f1af5f3855e32)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:44.401598 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaae3b3-e8bf-4475-ad01-ff3251cbe011 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:44.403851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 172/349] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 08:16:44 2022] GET /identity/v3/groups/1233459c76d449b19a6f1af5f3855e32 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:44.405035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c0112-7ac1-4299-876a-b96c6fe4891a None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.405331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c0112-7ac1-4299-876a-b96c6fe4891a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.405608 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c0112-7ac1-4299-876a-b96c6fe4891a None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.406848 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 173/350] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:44.409956 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62889f8c-d88e-41c2-8e24-9e29f3c3cdf0 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.410076 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62889f8c-d88e-41c2-8e24-9e29f3c3cdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.410308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62889f8c-d88e-41c2-8e24-9e29f3c3cdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.418438 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 178/351] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:44.423629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c239cf-fc88-4de7-84e2-1ef9eb05044c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:44.431875 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-62889f8c-d88e-41c2-8e24-9e29f3c3cdf0 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:44.433079 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-62889f8c-d88e-41c2-8e24-9e29f3c3cdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:44.520328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 174/352] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:44.522048 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724345b6-5c63-4eee-9ad8-61fec074299d None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.522343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724345b6-5c63-4eee-9ad8-61fec074299d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.522621 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724345b6-5c63-4eee-9ad8-61fec074299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.544895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-724345b6-5c63-4eee-9ad8-61fec074299d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:44.546101 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-724345b6-5c63-4eee-9ad8-61fec074299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:44.584318 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c239cf-fc88-4de7-84e2-1ef9eb05044c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:44.630349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98cdc6-fe6b-49e5-9a0e-35fc2f26d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:44.631233 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98cdc6-fe6b-49e5-9a0e-35fc2f26d367 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.631513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98cdc6-fe6b-49e5-9a0e-35fc2f26d367 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.631829 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98cdc6-fe6b-49e5-9a0e-35fc2f26d367 None admin] PATH_INFO: `/v3/groups/1233459c76d449b19a6f1af5f3855e32` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.632404 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 175/353] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:44.633622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724345b6-5c63-4eee-9ad8-61fec074299d None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:44.634008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98cdc6-fe6b-49e5-9a0e-35fc2f26d367 None admin] RBAC: Authorizing `identity:get_group(group_id=1233459c76d449b19a6f1af5f3855e32)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:44.635911 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98cdc6-fe6b-49e5-9a0e-35fc2f26d367 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:44.638109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 179/354] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 08:16:44 2022] GET /identity/v3/groups/1233459c76d449b19a6f1af5f3855e32 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:44.638987 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98cdc6-fe6b-49e5-9a0e-35fc2f26d367 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:44.655166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:44.676669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:44.764797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724345b6-5c63-4eee-9ad8-61fec074299d None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:44.766987 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98cdc6-fe6b-49e5-9a0e-35fc2f26d367 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:44.812614 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc580e-537a-45b2-8bdf-31438edaa5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:44.813280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc580e-537a-45b2-8bdf-31438edaa5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.813562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc580e-537a-45b2-8bdf-31438edaa5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.813839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc580e-537a-45b2-8bdf-31438edaa5a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.814279 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ee728-404e-4fff-a4cd-4be221337158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:44.814678 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc580e-537a-45b2-8bdf-31438edaa5a3 None admin] RBAC: Adding query filter params (group.id=1233459c76d449b19a6f1af5f3855e32, role.id=18bb65296a9c487faf3b57d2b4246578, scope.project.id=43279107ea034f0ab0fb5daa09dd0e92) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:44.814993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc580e-537a-45b2-8bdf-31438edaa5a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:44.815386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee728-404e-4fff-a4cd-4be221337158 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.815815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee728-404e-4fff-a4cd-4be221337158 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.816184 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee728-404e-4fff-a4cd-4be221337158 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.816471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc580e-537a-45b2-8bdf-31438edaa5a3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:44.828337 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 176/355] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 08:16:44 2022] GET /identity/v3/role_assignments?group.id=1233459c76d449b19a6f1af5f3855e32&scope.project.id=43279107ea034f0ab0fb5daa09dd0e92&role.id=18bb65296a9c487faf3b57d2b4246578 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:44.829347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc580e-537a-45b2-8bdf-31438edaa5a3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:44.830488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ee728-404e-4fff-a4cd-4be221337158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-058ee728-404e-4fff-a4cd-4be221337158 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:44.840114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:44.841123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:44.841934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:44.841934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:44.841934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:44.841934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:44.841934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:44.841934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:44.841934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:44.841934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:44.841934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:44.841934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:44.841934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:16:44.841934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:44.842538 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 180/356] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:44.843787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ee728-404e-4fff-a4cd-4be221337158 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:44.935894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:44.966734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc580e-537a-45b2-8bdf-31438edaa5a3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:44.979998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:45.002097 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ee728-404e-4fff-a4cd-4be221337158 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:45.012820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb261e-fad9-4a1a-80ff-3b9986dc183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:45.014069 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb261e-fad9-4a1a-80ff-3b9986dc183e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:45.014351 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb261e-fad9-4a1a-80ff-3b9986dc183e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:45.014626 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb261e-fad9-4a1a-80ff-3b9986dc183e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:45.033157 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb261e-fad9-4a1a-80ff-3b9986dc183e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-51cb261e-fad9-4a1a-80ff-3b9986dc183e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:45.045602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:45.046558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:45.047353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:45.047353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:45.047353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:45.047353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:45.047353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:45.047353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:45.047353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:45.047353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:45.047353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:45.047353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:45.047353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:45.047353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:45.048470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 177/357] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:16:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:45.054551 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb261e-fad9-4a1a-80ff-3b9986dc183e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:45.057622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2db42-dd0d-4c7d-b516-aa3f0b85e0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:45.058335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2db42-dd0d-4c7d-b516-aa3f0b85e0af None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:45.058620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2db42-dd0d-4c7d-b516-aa3f0b85e0af None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:45.058899 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2db42-dd0d-4c7d-b516-aa3f0b85e0af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:45.061335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2db42-dd0d-4c7d-b516-aa3f0b85e0af None admin] RBAC: Adding query filter params (group.id=1233459c76d449b19a6f1af5f3855e32, role.id=3fb4236a239b47e3ac59e14b3db524b1, scope.project.id=43279107ea034f0ab0fb5daa09dd0e92) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:45.061335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2db42-dd0d-4c7d-b516-aa3f0b85e0af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:45.061646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2db42-dd0d-4c7d-b516-aa3f0b85e0af None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:45.068976 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 181/358] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 08:16:44 2022] GET /identity/v3/role_assignments?group.id=1233459c76d449b19a6f1af5f3855e32&scope.project.id=43279107ea034f0ab0fb5daa09dd0e92&role.id=3fb4236a239b47e3ac59e14b3db524b1 => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:45.069653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2db42-dd0d-4c7d-b516-aa3f0b85e0af None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:45.201644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb261e-fad9-4a1a-80ff-3b9986dc183e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:45.204270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2db42-dd0d-4c7d-b516-aa3f0b85e0af None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:45.254889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bed067-bdb5-473c-8d46-5623c37a87ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:45.256542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bed067-bdb5-473c-8d46-5623c37a87ed None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:45.256542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bed067-bdb5-473c-8d46-5623c37a87ed None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:45.256542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bed067-bdb5-473c-8d46-5623c37a87ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:45.265691 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fc8c9-b69e-4f87-89b7-32d2fb75297e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:45.266705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fc8c9-b69e-4f87-89b7-32d2fb75297e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:45.267147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fc8c9-b69e-4f87-89b7-32d2fb75297e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:45.267649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fc8c9-b69e-4f87-89b7-32d2fb75297e None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:45.268820 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fc8c9-b69e-4f87-89b7-32d2fb75297e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:45.269313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fc8c9-b69e-4f87-89b7-32d2fb75297e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:45.272008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fc8c9-b69e-4f87-89b7-32d2fb75297e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:45.273836 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:45.275259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bed067-bdb5-473c-8d46-5623c37a87ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-13bed067-bdb5-473c-8d46-5623c37a87ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:45.284261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:45.285940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:45.287387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:45.287387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:45.287387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:45.287387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:45.287387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:45.287387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:45.287387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:45.287387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:45.287387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:45.287387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:45.287387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:45.287387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:45.287387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 178/360] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:45.287387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961762c6-9ee4-4368-b300-f89faf24a488 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:45.288888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961762c6-9ee4-4368-b300-f89faf24a488 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:45.289010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 182/360] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:45.289010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fc8c9-b69e-4f87-89b7-32d2fb75297e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:45.293466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961762c6-9ee4-4368-b300-f89faf24a488 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:45.295270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 179/361] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:45.296106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961762c6-9ee4-4368-b300-f89faf24a488 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:45.311587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:45.433954 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fc8c9-b69e-4f87-89b7-32d2fb75297e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:45.456948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961762c6-9ee4-4368-b300-f89faf24a488 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:45.478870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd82b96-9dd8-49c9-b6d8-20dc3f36b882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:45.479567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd82b96-9dd8-49c9-b6d8-20dc3f36b882 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:45.479882 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd82b96-9dd8-49c9-b6d8-20dc3f36b882 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:45.480266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd82b96-9dd8-49c9-b6d8-20dc3f36b882 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:45.481533 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd82b96-9dd8-49c9-b6d8-20dc3f36b882 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:45.482009 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd82b96-9dd8-49c9-b6d8-20dc3f36b882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:45.484919 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd82b96-9dd8-49c9-b6d8-20dc3f36b882 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:45.495586 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beaaafa-818b-4c2e-a4ad-14fb99a1be38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:45.496510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaaafa-818b-4c2e-a4ad-14fb99a1be38 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:45.497122 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 183/362] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:45.497418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaaafa-818b-4c2e-a4ad-14fb99a1be38 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:45.497418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaaafa-818b-4c2e-a4ad-14fb99a1be38 None admin] PATH_INFO: `/v3/users/0fffb6d009fa46109b5c4f45b2707257` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:45.497832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd82b96-9dd8-49c9-b6d8-20dc3f36b882 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:45.498373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beaaafa-818b-4c2e-a4ad-14fb99a1be38 None admin] RBAC: Authorizing `identity:get_user(user_id=0fffb6d009fa46109b5c4f45b2707257)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:45.500021 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beaaafa-818b-4c2e-a4ad-14fb99a1be38 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:45.502230 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 180/363] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:16:45 2022] GET /identity/v3/users/0fffb6d009fa46109b5c4f45b2707257 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:45.503454 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2286c0f-548b-4d3e-8ed4-7e9cd50d191e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:45.508243 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2286c0f-548b-4d3e-8ed4-7e9cd50d191e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:45.508597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2286c0f-548b-4d3e-8ed4-7e9cd50d191e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:45.529279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f2286c0f-548b-4d3e-8ed4-7e9cd50d191e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:45.530517 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f2286c0f-548b-4d3e-8ed4-7e9cd50d191e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:45.590478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:45.599119 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:45.606912 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 181/364] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:45.608200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2286c0f-548b-4d3e-8ed4-7e9cd50d191e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:45.624054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd82b96-9dd8-49c9-b6d8-20dc3f36b882 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:45.666409 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b9b01-7b7e-4e18-942f-b9aa5e1cf9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:45.668152 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b9b01-7b7e-4e18-942f-b9aa5e1cf9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:45.668679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b9b01-7b7e-4e18-942f-b9aa5e1cf9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:45.669152 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b9b01-7b7e-4e18-942f-b9aa5e1cf9d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:45.670124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b9b01-7b7e-4e18-942f-b9aa5e1cf9d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:45.670742 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b9b01-7b7e-4e18-942f-b9aa5e1cf9d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:45.673241 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b9b01-7b7e-4e18-942f-b9aa5e1cf9d0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:45.684631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 184/365] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:45.686939 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b9b01-7b7e-4e18-942f-b9aa5e1cf9d0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:45.722592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2286c0f-548b-4d3e-8ed4-7e9cd50d191e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:45.760816 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523d6a5-08ca-4031-a74c-90cf619a36e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:45.761559 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523d6a5-08ca-4031-a74c-90cf619a36e2 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:45.761840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523d6a5-08ca-4031-a74c-90cf619a36e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:45.762114 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523d6a5-08ca-4031-a74c-90cf619a36e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:45.821727 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b9b01-7b7e-4e18-942f-b9aa5e1cf9d0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:45.832307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:45.840534 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523d6a5-08ca-4031-a74c-90cf619a36e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:45.842034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523d6a5-08ca-4031-a74c-90cf619a36e2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:45.874803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe1b9c-9264-4905-82ad-4501354eaee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:45.876469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe1b9c-9264-4905-82ad-4501354eaee6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:45.876966 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe1b9c-9264-4905-82ad-4501354eaee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:45.877658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe1b9c-9264-4905-82ad-4501354eaee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:45.879220 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe1b9c-9264-4905-82ad-4501354eaee6 None admin] RBAC: Adding query filter params (role.id=e8fe982879094fdda82d271ad13509de, user.id=0fffb6d009fa46109b5c4f45b2707257, scope.system=all) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:45.879973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe1b9c-9264-4905-82ad-4501354eaee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:45.881745 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe1b9c-9264-4905-82ad-4501354eaee6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:45.898131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 185/366] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 21 08:16:45 2022] GET /identity/v3/role_assignments?user.id=0fffb6d009fa46109b5c4f45b2707257&scope.system=all&role.id=e8fe982879094fdda82d271ad13509de => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:45.898579 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:45.901488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe1b9c-9264-4905-82ad-4501354eaee6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:45.988453 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 182/367] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:45.989581 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523d6a5-08ca-4031-a74c-90cf619a36e2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:46.035954 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe1b9c-9264-4905-82ad-4501354eaee6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:46.075357 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b32e5-fc12-4594-9296-df3fdada4a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:46.076608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b32e5-fc12-4594-9296-df3fdada4a8c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:46.077091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b32e5-fc12-4594-9296-df3fdada4a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:46.077579 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b32e5-fc12-4594-9296-df3fdada4a8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:46.097059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b32e5-fc12-4594-9296-df3fdada4a8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-1f7b32e5-fc12-4594-9296-df3fdada4a8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:46.113383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:46.114550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:46.115342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:46.115342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:46.115342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:46.115342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:46.115342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:46.115342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:46.115342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:46.115342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:46.115342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:46.115342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:46.115342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:46.115342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:46.118297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:46.120275 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 186/368] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:16:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:46.122670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b32e5-fc12-4594-9296-df3fdada4a8c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:46.131206 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523d6a5-08ca-4031-a74c-90cf619a36e2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:46.193715 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e827-8f5b-46b0-b7eb-164a6dc9cce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:46.194391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e827-8f5b-46b0-b7eb-164a6dc9cce6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:46.194671 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e827-8f5b-46b0-b7eb-164a6dc9cce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:46.194948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e827-8f5b-46b0-b7eb-164a6dc9cce6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:46.239278 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:46.310324 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3e827-8f5b-46b0-b7eb-164a6dc9cce6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:46.312014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3e827-8f5b-46b0-b7eb-164a6dc9cce6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:46.321047 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b32e5-fc12-4594-9296-df3fdada4a8c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:46.361046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c8131-582e-411e-ab8d-689d50a71a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:46.362257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c8131-582e-411e-ab8d-689d50a71a6f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:46.362741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c8131-582e-411e-ab8d-689d50a71a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:46.363187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c8131-582e-411e-ab8d-689d50a71a6f None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:46.364998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c8131-582e-411e-ab8d-689d50a71a6f None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:46.366650 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c8131-582e-411e-ab8d-689d50a71a6f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:46.369112 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 187/369] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:46 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:46.370144 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c8131-582e-411e-ab8d-689d50a71a6f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:46.420096 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:46.428330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 183/370] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:46.429798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e827-8f5b-46b0-b7eb-164a6dc9cce6 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:46.491120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c8131-582e-411e-ab8d-689d50a71a6f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:46.518548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:46.531839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ed392-59a9-4a7b-a6a4-513bbce16090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:46.532689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ed392-59a9-4a7b-a6a4-513bbce16090 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:46.533069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ed392-59a9-4a7b-a6a4-513bbce16090 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:46.533441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ed392-59a9-4a7b-a6a4-513bbce16090 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:46.534406 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ed392-59a9-4a7b-a6a4-513bbce16090 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:46.534938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ed392-59a9-4a7b-a6a4-513bbce16090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:46.536809 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ed392-59a9-4a7b-a6a4-513bbce16090 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:46.548643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 188/371] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:46.548913 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ed392-59a9-4a7b-a6a4-513bbce16090 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:46.553119 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e827-8f5b-46b0-b7eb-164a6dc9cce6 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:46.594344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5758b33-ed99-48ea-8bc5-c44b9321b0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:46.595628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5758b33-ed99-48ea-8bc5-c44b9321b0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:46.596106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5758b33-ed99-48ea-8bc5-c44b9321b0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:46.596543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5758b33-ed99-48ea-8bc5-c44b9321b0f4 None admin] PATH_INFO: `/v3/groups/1233459c76d449b19a6f1af5f3855e32` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:46.598064 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5758b33-ed99-48ea-8bc5-c44b9321b0f4 None admin] RBAC: Authorizing `identity:get_group(group_id=1233459c76d449b19a6f1af5f3855e32)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:46.599943 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5758b33-ed99-48ea-8bc5-c44b9321b0f4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:46.602340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 184/372] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 08:16:46 2022] GET /identity/v3/groups/1233459c76d449b19a6f1af5f3855e32 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:46.603421 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5758b33-ed99-48ea-8bc5-c44b9321b0f4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:46.658818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ed392-59a9-4a7b-a6a4-513bbce16090 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:46.672232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:46.697933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcc7d8-f998-41ad-8665-a1323001443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:46.698914 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcc7d8-f998-41ad-8665-a1323001443b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:46.699265 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcc7d8-f998-41ad-8665-a1323001443b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:46.699620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcc7d8-f998-41ad-8665-a1323001443b None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:46.700884 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcc7d8-f998-41ad-8665-a1323001443b None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:46.702537 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcc7d8-f998-41ad-8665-a1323001443b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:46.704758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 189/373] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:46 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:46.705796 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcc7d8-f998-41ad-8665-a1323001443b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:46.716097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5758b33-ed99-48ea-8bc5-c44b9321b0f4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:46.752696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242621e0-ae68-45bc-ab8d-2702429317f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:46.753702 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242621e0-ae68-45bc-ab8d-2702429317f8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:46.754148 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242621e0-ae68-45bc-ab8d-2702429317f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:46.754625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242621e0-ae68-45bc-ab8d-2702429317f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:46.766213 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:46.814011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcc7d8-f998-41ad-8665-a1323001443b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:46.828585 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242621e0-ae68-45bc-ab8d-2702429317f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:46.830425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242621e0-ae68-45bc-ab8d-2702429317f8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:46.850358 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc002d-d2b8-4ca6-b4a4-332b81177619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:46.851119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc002d-d2b8-4ca6-b4a4-332b81177619 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:46.851398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc002d-d2b8-4ca6-b4a4-332b81177619 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:46.851699 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc002d-d2b8-4ca6-b4a4-332b81177619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:46.852539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc002d-d2b8-4ca6-b4a4-332b81177619 None admin] RBAC: Adding query filter params (group.id=1233459c76d449b19a6f1af5f3855e32, role.id=18bb65296a9c487faf3b57d2b4246578, scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:46.852853 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc002d-d2b8-4ca6-b4a4-332b81177619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:46.855330 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc002d-d2b8-4ca6-b4a4-332b81177619 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:46.861526 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 190/374] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 08:16:46 2022] GET /identity/v3/role_assignments?group.id=1233459c76d449b19a6f1af5f3855e32&scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce&role.id=18bb65296a9c487faf3b57d2b4246578 => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:46.862341 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc002d-d2b8-4ca6-b4a4-332b81177619 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:46.898700 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:46.945344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 185/375] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:46.951572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242621e0-ae68-45bc-ab8d-2702429317f8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:46.978316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc002d-d2b8-4ca6-b4a4-332b81177619 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:46.998520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:47.018797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812f50b-4df2-4a46-b16b-f683ee59f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:47.019588 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812f50b-4df2-4a46-b16b-f683ee59f918 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:47.019894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812f50b-4df2-4a46-b16b-f683ee59f918 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:47.020296 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812f50b-4df2-4a46-b16b-f683ee59f918 None admin] PATH_INFO: `/v3/groups/1233459c76d449b19a6f1af5f3855e32` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:47.021381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812f50b-4df2-4a46-b16b-f683ee59f918 None admin] RBAC: Authorizing `identity:get_group(group_id=1233459c76d449b19a6f1af5f3855e32)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:47.023027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812f50b-4df2-4a46-b16b-f683ee59f918 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:47.025008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 191/376] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 08:16:46 2022] GET /identity/v3/groups/1233459c76d449b19a6f1af5f3855e32 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:47.033312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812f50b-4df2-4a46-b16b-f683ee59f918 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:47.067141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242621e0-ae68-45bc-ab8d-2702429317f8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:47.108507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6c00f-3443-4aff-a3a8-6051a0023830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:47.110084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6c00f-3443-4aff-a3a8-6051a0023830 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:47.110653 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6c00f-3443-4aff-a3a8-6051a0023830 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:47.111203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6c00f-3443-4aff-a3a8-6051a0023830 None admin] PATH_INFO: `/v3/projects/8dac71dc397d4676b170c1cf9092d9e5` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:47.112651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6c00f-3443-4aff-a3a8-6051a0023830 None admin] RBAC: Authorizing `identity:get_project(project_id=8dac71dc397d4676b170c1cf9092d9e5)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:47.114634 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6c00f-3443-4aff-a3a8-6051a0023830 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:47.116780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 186/377] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:46 2022] GET /identity/v3/projects/8dac71dc397d4676b170c1cf9092d9e5 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:47.122706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6c00f-3443-4aff-a3a8-6051a0023830 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:47.147792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812f50b-4df2-4a46-b16b-f683ee59f918 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:47.159567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:47.187777 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b82a21-2a70-4431-82a2-23c95f152d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:47.188511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b82a21-2a70-4431-82a2-23c95f152d47 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:47.188795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b82a21-2a70-4431-82a2-23c95f152d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:47.189070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b82a21-2a70-4431-82a2-23c95f152d47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:47.190033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b82a21-2a70-4431-82a2-23c95f152d47 None admin] RBAC: Adding query filter params (group.id=1233459c76d449b19a6f1af5f3855e32, role.id=3fb4236a239b47e3ac59e14b3db524b1, scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:47.190340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b82a21-2a70-4431-82a2-23c95f152d47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:47.191911 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b82a21-2a70-4431-82a2-23c95f152d47 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:47.199012 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 192/378] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 08:16:47 2022] GET /identity/v3/role_assignments?group.id=1233459c76d449b19a6f1af5f3855e32&scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce&role.id=3fb4236a239b47e3ac59e14b3db524b1 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:47.244622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6c00f-3443-4aff-a3a8-6051a0023830 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:47.286976 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268dfc9-e265-4b10-b81a-23b3924f5f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:47.288285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268dfc9-e265-4b10-b81a-23b3924f5f35 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:47.288770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268dfc9-e265-4b10-b81a-23b3924f5f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:47.289245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268dfc9-e265-4b10-b81a-23b3924f5f35 None admin] PATH_INFO: `/v3/groups/20bf2bff7e744e0da3a4ae84fcea7d2c` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:47.295465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268dfc9-e265-4b10-b81a-23b3924f5f35 None admin] RBAC: Authorizing `identity:get_group(group_id=20bf2bff7e744e0da3a4ae84fcea7d2c)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:47.297333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268dfc9-e265-4b10-b81a-23b3924f5f35 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:47.299370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 187/379] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 08:16:47 2022] GET /identity/v3/groups/20bf2bff7e744e0da3a4ae84fcea7d2c => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:47.306485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b82a21-2a70-4431-82a2-23c95f152d47 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:47.385938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:47.433798 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b82a21-2a70-4431-82a2-23c95f152d47 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:47.468672 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfda61b-fdad-4bc3-b890-dfa0052d2b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:47.469343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfda61b-fdad-4bc3-b890-dfa0052d2b20 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:47.469628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfda61b-fdad-4bc3-b890-dfa0052d2b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:47.469894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfda61b-fdad-4bc3-b890-dfa0052d2b20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:47.470739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfda61b-fdad-4bc3-b890-dfa0052d2b20 None admin] RBAC: Adding query filter params (group.id=20bf2bff7e744e0da3a4ae84fcea7d2c, role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=8dac71dc397d4676b170c1cf9092d9e5) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:47.471041 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfda61b-fdad-4bc3-b890-dfa0052d2b20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:47.474410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfda61b-fdad-4bc3-b890-dfa0052d2b20 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:47.481345 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 193/380] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 08:16:47 2022] GET /identity/v3/role_assignments?group.id=20bf2bff7e744e0da3a4ae84fcea7d2c&scope.project.id=8dac71dc397d4676b170c1cf9092d9e5&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:47.621389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e52fde-be28-43e8-b972-a22549ee061b None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:47.622006 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e52fde-be28-43e8-b972-a22549ee061b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:47.622491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e52fde-be28-43e8-b972-a22549ee061b None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:47.624134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 188/381] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:47.629941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669b3f1-5634-4f36-9237-37ada32f7b38 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:47.630486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669b3f1-5634-4f36-9237-37ada32f7b38 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:47.630963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669b3f1-5634-4f36-9237-37ada32f7b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:47.649444 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1669b3f1-5634-4f36-9237-37ada32f7b38 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:47.651146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1669b3f1-5634-4f36-9237-37ada32f7b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:47.744978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 194/382] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:47.774298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e52fde-be28-43e8-b972-a22549ee061b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:47.971028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57586106-ba61-4583-9539-0f0c8f6e9e31 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:47.971424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57586106-ba61-4583-9539-0f0c8f6e9e31 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:47.971627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57586106-ba61-4583-9539-0f0c8f6e9e31 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:47.972976 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 195/383] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:16:47.993393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98ca60-6c6c-4a5c-8da2-657389d9d581 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:47.993739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98ca60-6c6c-4a5c-8da2-657389d9d581 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:47.993962 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98ca60-6c6c-4a5c-8da2-657389d9d581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:48.016313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6a98ca60-6c6c-4a5c-8da2-657389d9d581 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:48.018695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6a98ca60-6c6c-4a5c-8da2-657389d9d581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:48.020570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:48.045882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e52fde-be28-43e8-b972-a22549ee061b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:48.102459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:48.150088 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885f3a7-0bf8-40f8-be10-e731e372332e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:48.150913 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885f3a7-0bf8-40f8-be10-e731e372332e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:48.152025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885f3a7-0bf8-40f8-be10-e731e372332e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:48.152025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885f3a7-0bf8-40f8-be10-e731e372332e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:48.162155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 196/384] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:16:48.203043 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885f3a7-0bf8-40f8-be10-e731e372332e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:48.204397 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98ca60-6c6c-4a5c-8da2-657389d9d581 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-4885f3a7-0bf8-40f8-be10-e731e372332e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:48.217283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:48.218279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:48.219118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:48.219118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:48.219118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:48.219118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:48.219118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:48.219118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:48.219118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:48.219118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:48.219118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:48.219118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:48.219118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:48.219118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:48.219118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 189/385] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:48.228779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885f3a7-0bf8-40f8-be10-e731e372332e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:48.362278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885f3a7-0bf8-40f8-be10-e731e372332e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:48.400875 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f18b3-f586-491c-8d48-864b5471a89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:48.402062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f18b3-f586-491c-8d48-864b5471a89c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:48.403727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f18b3-f586-491c-8d48-864b5471a89c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:48.404375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f18b3-f586-491c-8d48-864b5471a89c None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:48.406452 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f18b3-f586-491c-8d48-864b5471a89c None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:48.407160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f18b3-f586-491c-8d48-864b5471a89c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:48.409584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f18b3-f586-491c-8d48-864b5471a89c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:48.425637 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 190/386] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:48.437569 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f18b3-f586-491c-8d48-864b5471a89c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:48.444495 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98ca60-6c6c-4a5c-8da2-657389d9d581 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:48.492082 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:48.524292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfee1a-9df1-4886-a4d0-687821b2a3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:48.527053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfee1a-9df1-4886-a4d0-687821b2a3de None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:48.528332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfee1a-9df1-4886-a4d0-687821b2a3de None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:48.530931 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfee1a-9df1-4886-a4d0-687821b2a3de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:48.558040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfee1a-9df1-4886-a4d0-687821b2a3de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-c1dfee1a-9df1-4886-a4d0-687821b2a3de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:48.568710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:48.569644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:48.570424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:48.570424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:48.570424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:48.570424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:48.570424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:48.570424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:48.570424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:48.570424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:48.570424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:48.570424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:48.570424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:48.570424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:48.580010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 197/387] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:16:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:48.584626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfee1a-9df1-4886-a4d0-687821b2a3de None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:48.631297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f18b3-f586-491c-8d48-864b5471a89c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:48.657020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:48.676194 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c28091-e503-4fd9-88a4-d07503928fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:48.678158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c28091-e503-4fd9-88a4-d07503928fed None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:48.678453 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c28091-e503-4fd9-88a4-d07503928fed None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:48.678732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c28091-e503-4fd9-88a4-d07503928fed None admin] PATH_INFO: `/v3/groups/1233459c76d449b19a6f1af5f3855e32` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:48.681010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c28091-e503-4fd9-88a4-d07503928fed None admin] RBAC: Authorizing `identity:get_group(group_id=1233459c76d449b19a6f1af5f3855e32)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:48.682779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c28091-e503-4fd9-88a4-d07503928fed None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:48.684598 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 191/388] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 08:16:48 2022] GET /identity/v3/groups/1233459c76d449b19a6f1af5f3855e32 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:48.691538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c28091-e503-4fd9-88a4-d07503928fed None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:48.821621 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfee1a-9df1-4886-a4d0-687821b2a3de None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:48.823821 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:48.845082 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c28091-e503-4fd9-88a4-d07503928fed None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:48.886125 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c6c0a-a51f-4e7d-b77a-c50a6017379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:48.887071 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c6c0a-a51f-4e7d-b77a-c50a6017379e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:48.887350 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c6c0a-a51f-4e7d-b77a-c50a6017379e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:48.887636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c6c0a-a51f-4e7d-b77a-c50a6017379e None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:48.889900 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c6c0a-a51f-4e7d-b77a-c50a6017379e None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:48.891355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c6c0a-a51f-4e7d-b77a-c50a6017379e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:48.894134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 192/389] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:48 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:48.902891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c6c0a-a51f-4e7d-b77a-c50a6017379e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:48.909811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00419886-eabf-4643-b89e-9309313728b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:48.910514 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00419886-eabf-4643-b89e-9309313728b1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:48.910797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00419886-eabf-4643-b89e-9309313728b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:48.911089 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00419886-eabf-4643-b89e-9309313728b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:48.911961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00419886-eabf-4643-b89e-9309313728b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:48.912266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00419886-eabf-4643-b89e-9309313728b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:48.913665 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00419886-eabf-4643-b89e-9309313728b1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:48.932248 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 198/390] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:48.937453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00419886-eabf-4643-b89e-9309313728b1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:49.074121 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c6c0a-a51f-4e7d-b77a-c50a6017379e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:49.112506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27bc53-dd94-4340-913b-035064c50081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:49.113885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27bc53-dd94-4340-913b-035064c50081 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:49.114564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27bc53-dd94-4340-913b-035064c50081 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:49.115046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27bc53-dd94-4340-913b-035064c50081 None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92/groups/1233459c76d449b19a6f1af5f3855e32/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:49.117355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27bc53-dd94-4340-913b-035064c50081 None admin] RBAC: Authorizing `identity:create_grant(project_id=43279107ea034f0ab0fb5daa09dd0e92, group_id=1233459c76d449b19a6f1af5f3855e32, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:49.119031 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27bc53-dd94-4340-913b-035064c50081 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:49.139670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 193/391] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 21 08:16:48 2022] PUT /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92/groups/1233459c76d449b19a6f1af5f3855e32/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:16:49.165333 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:49.175821 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00419886-eabf-4643-b89e-9309313728b1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:49.227144 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0dc15b-f1ae-439c-886f-f35b0c7a550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:49.228050 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dc15b-f1ae-439c-886f-f35b0c7a550e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:49.228325 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dc15b-f1ae-439c-886f-f35b0c7a550e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:49.228597 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dc15b-f1ae-439c-886f-f35b0c7a550e None admin] PATH_INFO: `/v3/groups/1233459c76d449b19a6f1af5f3855e32` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:49.229822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0dc15b-f1ae-439c-886f-f35b0c7a550e None admin] RBAC: Authorizing `identity:get_group(group_id=1233459c76d449b19a6f1af5f3855e32)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:49.231362 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0dc15b-f1ae-439c-886f-f35b0c7a550e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:49.233200 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 199/392] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 08:16:48 2022] GET /identity/v3/groups/1233459c76d449b19a6f1af5f3855e32 => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:49.239538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27bc53-dd94-4340-913b-035064c50081 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:49.265456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:49.382370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27bc53-dd94-4340-913b-035064c50081 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:49.418423 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c174ad-8599-4a82-9ce5-0e9e42a3b8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:49.419742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c174ad-8599-4a82-9ce5-0e9e42a3b8ff None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:49.420239 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c174ad-8599-4a82-9ce5-0e9e42a3b8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:49.420712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c174ad-8599-4a82-9ce5-0e9e42a3b8ff None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:49.422169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c174ad-8599-4a82-9ce5-0e9e42a3b8ff None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:49.423868 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c174ad-8599-4a82-9ce5-0e9e42a3b8ff None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:49.426147 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 194/393] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:49 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:49.432522 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0dc15b-f1ae-439c-886f-f35b0c7a550e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:49.572218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0dc15b-f1ae-439c-886f-f35b0c7a550e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:49.613176 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d0a60-637b-4189-ab59-a7bcd37f1f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:49.614432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d0a60-637b-4189-ab59-a7bcd37f1f4c None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:49.614751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d0a60-637b-4189-ab59-a7bcd37f1f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:49.615030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d0a60-637b-4189-ab59-a7bcd37f1f4c None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92/groups/1233459c76d449b19a6f1af5f3855e32/roles/18bb65296a9c487faf3b57d2b4246578` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:49.617274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d0a60-637b-4189-ab59-a7bcd37f1f4c None admin] RBAC: Authorizing `identity:create_grant(project_id=43279107ea034f0ab0fb5daa09dd0e92, group_id=1233459c76d449b19a6f1af5f3855e32, role_id=18bb65296a9c487faf3b57d2b4246578)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:49.618729 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d0a60-637b-4189-ab59-a7bcd37f1f4c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:49.644689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 200/394] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 21 08:16:49 2022] PUT /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92/groups/1233459c76d449b19a6f1af5f3855e32/roles/18bb65296a9c487faf3b57d2b4246578 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:16:49.792204 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1cc1-21bf-4f2f-b2bd-5a33fabe1cfe None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:49.792614 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1cc1-21bf-4f2f-b2bd-5a33fabe1cfe None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:49.792897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1cc1-21bf-4f2f-b2bd-5a33fabe1cfe None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:49.794623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 195/395] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:49.800514 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeea24-3fcf-4a77-a2e7-2350d48157fa None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:49.800802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeea24-3fcf-4a77-a2e7-2350d48157fa None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:49.801103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeea24-3fcf-4a77-a2e7-2350d48157fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:49.833132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5cdeea24-3fcf-4a77-a2e7-2350d48157fa None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:49.834456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5cdeea24-3fcf-4a77-a2e7-2350d48157fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:49.856197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:49.929952 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 201/396] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:49.969147 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1cc1-21bf-4f2f-b2bd-5a33fabe1cfe None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:50.072890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:50.097158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1cc1-21bf-4f2f-b2bd-5a33fabe1cfe None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:50.107272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af0a5e-d177-41fd-87e2-21feb4cf47ad None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:50.107623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af0a5e-d177-41fd-87e2-21feb4cf47ad None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:50.107862 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af0a5e-d177-41fd-87e2-21feb4cf47ad None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:50.109554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 202/397] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:50.110537 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029f729-3007-4f76-ba6d-b0633b8f381f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:50.110818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029f729-3007-4f76-ba6d-b0633b8f381f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:50.111093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029f729-3007-4f76-ba6d-b0633b8f381f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:50.113225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 203/398] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:50.119382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4d449-5a74-41a7-b67e-cf8b151af169 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:50.119968 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4d449-5a74-41a7-b67e-cf8b151af169 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:50.120528 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4d449-5a74-41a7-b67e-cf8b151af169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:50.138485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-64f4d449-5a74-41a7-b67e-cf8b151af169 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:50.140034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-64f4d449-5a74-41a7-b67e-cf8b151af169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:50.148336 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382ea66-cd5d-4eff-ad78-67eaf4fa2996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:50.149170 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382ea66-cd5d-4eff-ad78-67eaf4fa2996 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:50.149453 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382ea66-cd5d-4eff-ad78-67eaf4fa2996 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:50.149732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382ea66-cd5d-4eff-ad78-67eaf4fa2996 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:50.165018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382ea66-cd5d-4eff-ad78-67eaf4fa2996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-2382ea66-cd5d-4eff-ad78-67eaf4fa2996 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:50.177041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:50.177950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:50.178732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:50.178732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:50.178732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:50.178732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:50.178732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:50.178732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:50.178732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:50.178732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:50.178732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:50.178732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:50.178732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:50.178732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:50.178732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 196/399] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:16:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:50.179942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6041b1-ef36-4c30-8043-91e9d40097e9 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:50.179942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6041b1-ef36-4c30-8043-91e9d40097e9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:50.180151 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6041b1-ef36-4c30-8043-91e9d40097e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:50.201643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8d6041b1-ef36-4c30-8043-91e9d40097e9 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:50.203145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8d6041b1-ef36-4c30-8043-91e9d40097e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:50.228091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 204/400] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:50.229275 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4d449-5a74-41a7-b67e-cf8b151af169 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:50.289852 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 197/401] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:50.291028 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6041b1-ef36-4c30-8043-91e9d40097e9 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:50.369087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:50.377778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:50.392926 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4d449-5a74-41a7-b67e-cf8b151af169 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:50.408771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6041b1-ef36-4c30-8043-91e9d40097e9 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:50.442873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324b863-21cf-42d8-a3e0-15060e3797f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:50.443441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423871eb-3493-46d5-92df-fc803c106f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:50.443557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324b863-21cf-42d8-a3e0-15060e3797f9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:50.444041 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324b863-21cf-42d8-a3e0-15060e3797f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:50.444381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324b863-21cf-42d8-a3e0-15060e3797f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:50.445049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423871eb-3493-46d5-92df-fc803c106f56 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:50.445193 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324b863-21cf-42d8-a3e0-15060e3797f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:50.445619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324b863-21cf-42d8-a3e0-15060e3797f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:50.445788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423871eb-3493-46d5-92df-fc803c106f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:50.446248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423871eb-3493-46d5-92df-fc803c106f56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:50.447570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324b863-21cf-42d8-a3e0-15060e3797f9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:50.460257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 205/402] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:50.465646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423871eb-3493-46d5-92df-fc803c106f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:50.465861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324b863-21cf-42d8-a3e0-15060e3797f9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-423871eb-3493-46d5-92df-fc803c106f56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:50.474214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:50.475120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:50.475916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:50.475916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:50.475916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:50.475916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:50.475916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:50.475916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:50.475916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:50.475916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:50.475916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:50.475916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:50.475916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:50.475916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:50.478651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 198/403] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:50.479823 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423871eb-3493-46d5-92df-fc803c106f56 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:50.594988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324b863-21cf-42d8-a3e0-15060e3797f9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:50.608897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423871eb-3493-46d5-92df-fc803c106f56 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:50.639818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:50.640947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e754a-e99c-4bef-a862-ecee8650f0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:50.642365 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e754a-e99c-4bef-a862-ecee8650f0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:50.642953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e754a-e99c-4bef-a862-ecee8650f0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:50.643373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e754a-e99c-4bef-a862-ecee8650f0c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:50.646758 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73359ce6-41bd-4776-aa96-a3ed95a6bf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:50.647873 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359ce6-41bd-4776-aa96-a3ed95a6bf6f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:50.648258 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359ce6-41bd-4776-aa96-a3ed95a6bf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:50.648624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359ce6-41bd-4776-aa96-a3ed95a6bf6f None admin] PATH_INFO: `/v3/groups/1233459c76d449b19a6f1af5f3855e32` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:50.650099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73359ce6-41bd-4776-aa96-a3ed95a6bf6f None admin] RBAC: Authorizing `identity:get_group(group_id=1233459c76d449b19a6f1af5f3855e32)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:50.651782 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73359ce6-41bd-4776-aa96-a3ed95a6bf6f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:50.654225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 199/404] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 08:16:50 2022] GET /identity/v3/groups/1233459c76d449b19a6f1af5f3855e32 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:50.655223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73359ce6-41bd-4776-aa96-a3ed95a6bf6f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:50.659997 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e754a-e99c-4bef-a862-ecee8650f0c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a62e754a-e99c-4bef-a862-ecee8650f0c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:50.668131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:50.669063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:50.670300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:50.670300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:50.670300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:50.670300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:50.670300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:50.670300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:50.670300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:50.670300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:50.670300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:50.670300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:50.670300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:50.670300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:50.674451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 206/405] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:16:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:50.675205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e754a-e99c-4bef-a862-ecee8650f0c0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:50.685543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:50.782805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73359ce6-41bd-4776-aa96-a3ed95a6bf6f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:50.790858 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e754a-e99c-4bef-a862-ecee8650f0c0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:50.824909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d447b-6362-4a9e-8eb1-86fd4d2939d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:50.826140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d447b-6362-4a9e-8eb1-86fd4d2939d3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:50.826508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d447b-6362-4a9e-8eb1-86fd4d2939d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:50.826783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a483167-3a47-4f93-88fe-d0b641d89638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:50.826970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d447b-6362-4a9e-8eb1-86fd4d2939d3 None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:50.827770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a483167-3a47-4f93-88fe-d0b641d89638 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:50.828184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a483167-3a47-4f93-88fe-d0b641d89638 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:50.828441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d447b-6362-4a9e-8eb1-86fd4d2939d3 None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:50.828765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a483167-3a47-4f93-88fe-d0b641d89638 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:50.829657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a483167-3a47-4f93-88fe-d0b641d89638 None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:50.830094 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a483167-3a47-4f93-88fe-d0b641d89638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:50.830288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d447b-6362-4a9e-8eb1-86fd4d2939d3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:50.831763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a483167-3a47-4f93-88fe-d0b641d89638 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:50.832215 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 207/406] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:50 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:50.833147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d447b-6362-4a9e-8eb1-86fd4d2939d3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:50.847587 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 200/407] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:50.849087 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a483167-3a47-4f93-88fe-d0b641d89638 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:50.920390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:50.928654 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:50.956371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d447b-6362-4a9e-8eb1-86fd4d2939d3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:50.979734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a483167-3a47-4f93-88fe-d0b641d89638 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:50.992614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31fa37-3d7f-4e45-9c6f-57c531918f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:50.993311 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31fa37-3d7f-4e45-9c6f-57c531918f82 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:50.993687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31fa37-3d7f-4e45-9c6f-57c531918f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:50.994053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31fa37-3d7f-4e45-9c6f-57c531918f82 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:50.994905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31fa37-3d7f-4e45-9c6f-57c531918f82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:50.995322 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31fa37-3d7f-4e45-9c6f-57c531918f82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:50.996967 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31fa37-3d7f-4e45-9c6f-57c531918f82 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:51.010610 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 208/408] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:51.011802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31fa37-3d7f-4e45-9c6f-57c531918f82 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:51.023627 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6ab86-77b5-4904-a9b2-5c240fabd4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:51.025256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6ab86-77b5-4904-a9b2-5c240fabd4ab None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:51.026006 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6ab86-77b5-4904-a9b2-5c240fabd4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:51.026291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6ab86-77b5-4904-a9b2-5c240fabd4ab None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce/groups/1233459c76d449b19a6f1af5f3855e32/roles/18bb65296a9c487faf3b57d2b4246578` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:51.029597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6ab86-77b5-4904-a9b2-5c240fabd4ab None admin] RBAC: Authorizing `identity:create_grant(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce, group_id=1233459c76d449b19a6f1af5f3855e32, role_id=18bb65296a9c487faf3b57d2b4246578)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:51.031792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6ab86-77b5-4904-a9b2-5c240fabd4ab None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:51.051252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 201/409] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 21 08:16:50 2022] PUT /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce/groups/1233459c76d449b19a6f1af5f3855e32/roles/18bb65296a9c487faf3b57d2b4246578 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:16:51.052798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6ab86-77b5-4904-a9b2-5c240fabd4ab None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:51.127532 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31fa37-3d7f-4e45-9c6f-57c531918f82 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:51.193219 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e44c3-4bce-4c19-8c2e-603b645af79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:51.196595 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e44c3-4bce-4c19-8c2e-603b645af79b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:51.199164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e44c3-4bce-4c19-8c2e-603b645af79b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:51.199748 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e44c3-4bce-4c19-8c2e-603b645af79b None admin] PATH_INFO: `/v3/groups/1233459c76d449b19a6f1af5f3855e32` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:51.201439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e44c3-4bce-4c19-8c2e-603b645af79b None admin] RBAC: Authorizing `identity:get_group(group_id=1233459c76d449b19a6f1af5f3855e32)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:51.206149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e44c3-4bce-4c19-8c2e-603b645af79b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:51.211650 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 209/410] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 08:16:51 2022] GET /identity/v3/groups/1233459c76d449b19a6f1af5f3855e32 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:51.216371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e44c3-4bce-4c19-8c2e-603b645af79b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:51.223892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:51.247834 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6ab86-77b5-4904-a9b2-5c240fabd4ab None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:51.278347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:51.292629 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba75b3-e1e8-4501-9436-dbd4f34a2a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:51.293895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba75b3-e1e8-4501-9436-dbd4f34a2a69 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:51.294272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba75b3-e1e8-4501-9436-dbd4f34a2a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:51.294649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba75b3-e1e8-4501-9436-dbd4f34a2a69 None admin] PATH_INFO: `/v3/groups/20bf2bff7e744e0da3a4ae84fcea7d2c` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:51.296402 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba75b3-e1e8-4501-9436-dbd4f34a2a69 None admin] RBAC: Authorizing `identity:get_group(group_id=20bf2bff7e744e0da3a4ae84fcea7d2c)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:51.298225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba75b3-e1e8-4501-9436-dbd4f34a2a69 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:51.300035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 202/411] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 08:16:51 2022] GET /identity/v3/groups/20bf2bff7e744e0da3a4ae84fcea7d2c => generated 229 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:51.306490 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba75b3-e1e8-4501-9436-dbd4f34a2a69 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:51.371839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e44c3-4bce-4c19-8c2e-603b645af79b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:51.428980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba75b3-e1e8-4501-9436-dbd4f34a2a69 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:51.432354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc33140-a9b0-4a3d-9eb7-b2b547efbf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:51.433390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc33140-a9b0-4a3d-9eb7-b2b547efbf19 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:51.433766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc33140-a9b0-4a3d-9eb7-b2b547efbf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:51.435811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc33140-a9b0-4a3d-9eb7-b2b547efbf19 None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:51.435811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc33140-a9b0-4a3d-9eb7-b2b547efbf19 None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:51.445390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc33140-a9b0-4a3d-9eb7-b2b547efbf19 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:51.447719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 210/412] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:51 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:51.458794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc33140-a9b0-4a3d-9eb7-b2b547efbf19 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:51.471761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb000387-46b5-4119-b297-9023d47237ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:51.472648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb000387-46b5-4119-b297-9023d47237ea None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:51.472993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb000387-46b5-4119-b297-9023d47237ea None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:51.473271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb000387-46b5-4119-b297-9023d47237ea None admin] PATH_INFO: `/v3/projects/8dac71dc397d4676b170c1cf9092d9e5` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:51.474580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb000387-46b5-4119-b297-9023d47237ea None admin] RBAC: Authorizing `identity:get_project(project_id=8dac71dc397d4676b170c1cf9092d9e5)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:51.478793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb000387-46b5-4119-b297-9023d47237ea None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:51.480592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 203/413] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:51 2022] GET /identity/v3/projects/8dac71dc397d4676b170c1cf9092d9e5 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:51.486599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb000387-46b5-4119-b297-9023d47237ea None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:51.587213 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:51.605554 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:51.643345 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc33140-a9b0-4a3d-9eb7-b2b547efbf19 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:51.666485 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb000387-46b5-4119-b297-9023d47237ea None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:51.681949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31de91-a119-4f5e-85a3-6f2b44cd092a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:51.683082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31de91-a119-4f5e-85a3-6f2b44cd092a None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:51.683650 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31de91-a119-4f5e-85a3-6f2b44cd092a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:51.684064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31de91-a119-4f5e-85a3-6f2b44cd092a None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce/groups/1233459c76d449b19a6f1af5f3855e32/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:51.686412 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31de91-a119-4f5e-85a3-6f2b44cd092a None admin] RBAC: Authorizing `identity:create_grant(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce, group_id=1233459c76d449b19a6f1af5f3855e32, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:51.688272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31de91-a119-4f5e-85a3-6f2b44cd092a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:51.711704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643f5cc-881c-47bc-bf68-aed6e22e1c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:51.711704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643f5cc-881c-47bc-bf68-aed6e22e1c38 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:51.711704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643f5cc-881c-47bc-bf68-aed6e22e1c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:51.711704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643f5cc-881c-47bc-bf68-aed6e22e1c38 None admin] PATH_INFO: `/v3/projects/8dac71dc397d4676b170c1cf9092d9e5/groups/20bf2bff7e744e0da3a4ae84fcea7d2c/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:51.712292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 211/414] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 21 08:16:51 2022] PUT /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce/groups/1233459c76d449b19a6f1af5f3855e32/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:16:51.712749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643f5cc-881c-47bc-bf68-aed6e22e1c38 None admin] RBAC: Authorizing `identity:create_grant(project_id=8dac71dc397d4676b170c1cf9092d9e5, group_id=20bf2bff7e744e0da3a4ae84fcea7d2c, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:51.714321 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34d610-9559-4364-b72c-ab4b76d1d9be None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:51.714669 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643f5cc-881c-47bc-bf68-aed6e22e1c38 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:51.715075 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34d610-9559-4364-b72c-ab4b76d1d9be None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:51.715488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34d610-9559-4364-b72c-ab4b76d1d9be None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:51.718489 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 212/415] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:51.723329 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55a4cb-0557-4260-a6f8-2bbd992d7e6a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:51.724112 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55a4cb-0557-4260-a6f8-2bbd992d7e6a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:51.724592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55a4cb-0557-4260-a6f8-2bbd992d7e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:51.745584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 204/416] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 21 08:16:51 2022] PUT /identity/v3/projects/8dac71dc397d4676b170c1cf9092d9e5/groups/20bf2bff7e744e0da3a4ae84fcea7d2c/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:16:51.754588 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8e55a4cb-0557-4260-a6f8-2bbd992d7e6a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:51.755995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8e55a4cb-0557-4260-a6f8-2bbd992d7e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:51.888694 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 213/417] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:16:51.923404 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643f5cc-881c-47bc-bf68-aed6e22e1c38 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:52.029041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643f5cc-881c-47bc-bf68-aed6e22e1c38 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:52.059977 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:52.068401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59eaf4d-c330-4de2-8f25-727af8025225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:52.069266 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eaf4d-c330-4de2-8f25-727af8025225 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:52.069551 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eaf4d-c330-4de2-8f25-727af8025225 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:52.069827 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eaf4d-c330-4de2-8f25-727af8025225 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:52.086333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59eaf4d-c330-4de2-8f25-727af8025225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-a59eaf4d-c330-4de2-8f25-727af8025225 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:52.094774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:52.095686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:52.096886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:52.096886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:52.096886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:52.096886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:52.096886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:52.096886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:52.096886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:52.096886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:52.096886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:52.096886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:52.096886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:52.096886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:52.096886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 205/418] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:52.104718 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55a4cb-0557-4260-a6f8-2bbd992d7e6a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:52.189449 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:52.230860 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55a4cb-0557-4260-a6f8-2bbd992d7e6a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:52.265946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526d293-a4ab-4fd9-80d8-ddc3568283db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:52.266627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526d293-a4ab-4fd9-80d8-ddc3568283db None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:52.266909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526d293-a4ab-4fd9-80d8-ddc3568283db None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:52.267191 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526d293-a4ab-4fd9-80d8-ddc3568283db None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:52.267986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526d293-a4ab-4fd9-80d8-ddc3568283db None admin] RBAC: Adding query filter params (name=member) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:52.268295 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526d293-a4ab-4fd9-80d8-ddc3568283db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:52.269681 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526d293-a4ab-4fd9-80d8-ddc3568283db None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:52.279022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 214/419] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:52.284165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59eaf4d-c330-4de2-8f25-727af8025225 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:52.329672 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18687188-9ca4-439e-9c72-0f50d68ecc79 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:52.330014 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18687188-9ca4-439e-9c72-0f50d68ecc79 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:52.330300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18687188-9ca4-439e-9c72-0f50d68ecc79 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:52.331931 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 215/420] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:52.337443 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6106e-391e-4bcb-a3bc-8d0f55afe105 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:52.337733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6106e-391e-4bcb-a3bc-8d0f55afe105 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:52.338011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6106e-391e-4bcb-a3bc-8d0f55afe105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:52.367184 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-37e6106e-391e-4bcb-a3bc-8d0f55afe105 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:52.368438 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-37e6106e-391e-4bcb-a3bc-8d0f55afe105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:52.471009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59eaf4d-c330-4de2-8f25-727af8025225 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:52.500453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 216/421] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:52.524998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6106e-391e-4bcb-a3bc-8d0f55afe105 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:52.543549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c48b11-3235-4d80-8dc1-630dd563b454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:52.544239 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c48b11-3235-4d80-8dc1-630dd563b454 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:52.544513 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c48b11-3235-4d80-8dc1-630dd563b454 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:52.544785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c48b11-3235-4d80-8dc1-630dd563b454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:52.597639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:52.621596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:52.662441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c48b11-3235-4d80-8dc1-630dd563b454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:52.663950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c48b11-3235-4d80-8dc1-630dd563b454 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:52.687270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6106e-391e-4bcb-a3bc-8d0f55afe105 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:52.737567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960085d-2eeb-4d1b-94e6-aeb86edeb634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:52.738305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960085d-2eeb-4d1b-94e6-aeb86edeb634 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:52.738706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960085d-2eeb-4d1b-94e6-aeb86edeb634 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:52.738969 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960085d-2eeb-4d1b-94e6-aeb86edeb634 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:52.762631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960085d-2eeb-4d1b-94e6-aeb86edeb634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-c960085d-2eeb-4d1b-94e6-aeb86edeb634 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:52.782837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:52.783812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:52.785132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:52.785132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:52.785132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:52.785132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:52.785132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:52.785132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:52.785132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:52.785132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:52.785132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:52.785132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:52.785132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:52.785132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:52.785132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 217/422] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:16:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:52.790142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960085d-2eeb-4d1b-94e6-aeb86edeb634 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:52.848262 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 206/423] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:52.850793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c48b11-3235-4d80-8dc1-630dd563b454 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:52.955978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:52.967634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960085d-2eeb-4d1b-94e6-aeb86edeb634 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:52.989495 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:52.990976 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c48b11-3235-4d80-8dc1-630dd563b454 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:53.022203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c05ffb-8777-4027-bc54-9b8caa4a5e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:53.023241 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c05ffb-8777-4027-bc54-9b8caa4a5e0c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:53.023683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c05ffb-8777-4027-bc54-9b8caa4a5e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:53.024077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c05ffb-8777-4027-bc54-9b8caa4a5e0c None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:53.025001 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c05ffb-8777-4027-bc54-9b8caa4a5e0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:53.025309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c05ffb-8777-4027-bc54-9b8caa4a5e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:53.027737 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c05ffb-8777-4027-bc54-9b8caa4a5e0c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:53.045156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207786e4-f36e-4e60-b193-c3a64a0b85d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:53.046053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207786e4-f36e-4e60-b193-c3a64a0b85d7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:53.046328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207786e4-f36e-4e60-b193-c3a64a0b85d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:53.046599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207786e4-f36e-4e60-b193-c3a64a0b85d7 None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:53.049208 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207786e4-f36e-4e60-b193-c3a64a0b85d7 None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:53.050762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207786e4-f36e-4e60-b193-c3a64a0b85d7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:53.053111 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 207/424] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:52 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:53.054243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 218/425] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:53.058604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207786e4-f36e-4e60-b193-c3a64a0b85d7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:53.063569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c05ffb-8777-4027-bc54-9b8caa4a5e0c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:53.236131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c05ffb-8777-4027-bc54-9b8caa4a5e0c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:53.239580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207786e4-f36e-4e60-b193-c3a64a0b85d7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:53.298423 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385884b-48b8-410d-8dbf-14056250b50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:53.299293 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385884b-48b8-410d-8dbf-14056250b50d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:53.299576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385884b-48b8-410d-8dbf-14056250b50d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:53.299873 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385884b-48b8-410d-8dbf-14056250b50d None admin] PATH_INFO: `/v3/groups/1233459c76d449b19a6f1af5f3855e32` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:53.303026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385884b-48b8-410d-8dbf-14056250b50d None admin] RBAC: Authorizing `identity:get_group(group_id=1233459c76d449b19a6f1af5f3855e32)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:53.304516 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385884b-48b8-410d-8dbf-14056250b50d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:53.307754 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c3c06-0de2-4903-bf52-f52b918a300b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:53.308424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c3c06-0de2-4903-bf52-f52b918a300b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:53.308705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c3c06-0de2-4903-bf52-f52b918a300b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:53.308983 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c3c06-0de2-4903-bf52-f52b918a300b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:53.311184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 208/426] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 08:16:53 2022] GET /identity/v3/groups/1233459c76d449b19a6f1af5f3855e32 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:53.312815 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385884b-48b8-410d-8dbf-14056250b50d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:53.339958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:53.388504 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:53.424529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c3c06-0de2-4903-bf52-f52b918a300b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:53.426108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c3c06-0de2-4903-bf52-f52b918a300b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:53.476769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385884b-48b8-410d-8dbf-14056250b50d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:53.514900 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260f057-cbee-42d0-b055-4957215c626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:53.515494 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260f057-cbee-42d0-b055-4957215c626c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:53.515811 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260f057-cbee-42d0-b055-4957215c626c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:53.516095 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260f057-cbee-42d0-b055-4957215c626c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:53.516956 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260f057-cbee-42d0-b055-4957215c626c None admin] RBAC: Adding query filter params (group.id=1233459c76d449b19a6f1af5f3855e32, role.id=3fb4236a239b47e3ac59e14b3db524b1, scope.project.id=43279107ea034f0ab0fb5daa09dd0e92) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:53.517278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260f057-cbee-42d0-b055-4957215c626c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:53.518807 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260f057-cbee-42d0-b055-4957215c626c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:53.525862 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 209/427] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 08:16:53 2022] GET /identity/v3/role_assignments?group.id=1233459c76d449b19a6f1af5f3855e32&scope.project.id=43279107ea034f0ab0fb5daa09dd0e92&role.id=3fb4236a239b47e3ac59e14b3db524b1 => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:53.541474 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab14b8a-0694-40cf-a14e-920f831060a9 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:53.541808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab14b8a-0694-40cf-a14e-920f831060a9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:53.542031 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab14b8a-0694-40cf-a14e-920f831060a9 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:53.543472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 210/428] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:16:53.561690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22747935-fb71-4fda-978a-d393969810e1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:53.562029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22747935-fb71-4fda-978a-d393969810e1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:53.562250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22747935-fb71-4fda-978a-d393969810e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:53.589404 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-22747935-fb71-4fda-978a-d393969810e1 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:53.590665 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-22747935-fb71-4fda-978a-d393969810e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:53.669302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 219/429] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:16:53.676770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c3c06-0de2-4903-bf52-f52b918a300b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:53.727395 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 211/430] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:53.752704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22747935-fb71-4fda-978a-d393969810e1 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:53.765695 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:53.772398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:53.801035 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c3c06-0de2-4903-bf52-f52b918a300b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:53.841034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe6a23-712a-4b05-8bcc-d1b0adcfd19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:53.841964 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe6a23-712a-4b05-8bcc-d1b0adcfd19a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:53.842250 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe6a23-712a-4b05-8bcc-d1b0adcfd19a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:53.842528 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe6a23-712a-4b05-8bcc-d1b0adcfd19a None admin] PATH_INFO: `/v3/projects/43279107ea034f0ab0fb5daa09dd0e92` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:53.843769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe6a23-712a-4b05-8bcc-d1b0adcfd19a None admin] RBAC: Authorizing `identity:get_project(project_id=43279107ea034f0ab0fb5daa09dd0e92)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:53.845537 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe6a23-712a-4b05-8bcc-d1b0adcfd19a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:53.850431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 220/431] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:53 2022] GET /identity/v3/projects/43279107ea034f0ab0fb5daa09dd0e92 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:53.854999 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe6a23-712a-4b05-8bcc-d1b0adcfd19a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:53.890605 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22747935-fb71-4fda-978a-d393969810e1 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:53.938181 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c66ff-9ddf-4a9c-a00d-4844b48f9691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:53.939732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c66ff-9ddf-4a9c-a00d-4844b48f9691 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:53.940051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c66ff-9ddf-4a9c-a00d-4844b48f9691 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:53.940334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c66ff-9ddf-4a9c-a00d-4844b48f9691 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:53.957423 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c66ff-9ddf-4a9c-a00d-4844b48f9691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-7d1c66ff-9ddf-4a9c-a00d-4844b48f9691 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:53.965970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:53.966901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:53.967747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:53.967747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:53.967747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:53.967747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:53.967747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:53.967747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:53.967747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:53.967747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:53.967747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:53.967747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:53.967747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:16:53.967747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:53.972357 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 212/432] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:16:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:53.976303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c66ff-9ddf-4a9c-a00d-4844b48f9691 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:53.976693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe6a23-712a-4b05-8bcc-d1b0adcfd19a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:54.028919 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c9d97-78aa-47c1-b1ad-109b5260a22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:54.029725 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c9d97-78aa-47c1-b1ad-109b5260a22d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.030002 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c9d97-78aa-47c1-b1ad-109b5260a22d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.030303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c9d97-78aa-47c1-b1ad-109b5260a22d None admin] PATH_INFO: `/v3/groups/1233459c76d449b19a6f1af5f3855e32` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.033546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c9d97-78aa-47c1-b1ad-109b5260a22d None admin] RBAC: Authorizing `identity:get_group(group_id=1233459c76d449b19a6f1af5f3855e32)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:54.035079 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c9d97-78aa-47c1-b1ad-109b5260a22d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:54.040428 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 221/433] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 08:16:53 2022] GET /identity/v3/groups/1233459c76d449b19a6f1af5f3855e32 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:54.047296 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c9d97-78aa-47c1-b1ad-109b5260a22d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:54.066880 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:54.081864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:54.128227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c66ff-9ddf-4a9c-a00d-4844b48f9691 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:54.164849 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c9d97-78aa-47c1-b1ad-109b5260a22d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:54.176691 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee8e59-1b62-4696-8c6a-148d181bd937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:54.177945 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee8e59-1b62-4696-8c6a-148d181bd937 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.178505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee8e59-1b62-4696-8c6a-148d181bd937 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.179049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee8e59-1b62-4696-8c6a-148d181bd937 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.179984 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee8e59-1b62-4696-8c6a-148d181bd937 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:54.180606 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee8e59-1b62-4696-8c6a-148d181bd937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:54.182828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee8e59-1b62-4696-8c6a-148d181bd937 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:54.193828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 213/434] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:54.196803 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb13d93-b270-4bbc-a532-071ff593c6e8 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.196803 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb13d93-b270-4bbc-a532-071ff593c6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.196803 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb13d93-b270-4bbc-a532-071ff593c6e8 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.197559 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 214/435] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:54.202397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb13d93-b270-4bbc-a532-071ff593c6e8 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:54.211787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92db62-fa21-449f-a373-1c6e90e0aee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:54.213182 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92db62-fa21-449f-a373-1c6e90e0aee4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.213464 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92db62-fa21-449f-a373-1c6e90e0aee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.213738 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92db62-fa21-449f-a373-1c6e90e0aee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.214934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92db62-fa21-449f-a373-1c6e90e0aee4 None admin] RBAC: Adding query filter params (group.id=1233459c76d449b19a6f1af5f3855e32, role.id=18bb65296a9c487faf3b57d2b4246578, scope.project.id=43279107ea034f0ab0fb5daa09dd0e92) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:54.215246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92db62-fa21-449f-a373-1c6e90e0aee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:54.217067 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92db62-fa21-449f-a373-1c6e90e0aee4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:54.225294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 222/436] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 08:16:54 2022] GET /identity/v3/role_assignments?group.id=1233459c76d449b19a6f1af5f3855e32&scope.project.id=43279107ea034f0ab0fb5daa09dd0e92&role.id=18bb65296a9c487faf3b57d2b4246578 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:54.226598 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076e08-3741-467b-af39-e6d150e64e2c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.226882 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076e08-3741-467b-af39-e6d150e64e2c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.227162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076e08-3741-467b-af39-e6d150e64e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.252027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-23076e08-3741-467b-af39-e6d150e64e2c None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:54.253297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-23076e08-3741-467b-af39-e6d150e64e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:54.349234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb13d93-b270-4bbc-a532-071ff593c6e8 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:54.353724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 223/437] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:54.355401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1e03c-8a4e-4ab7-95e4-04d5e7533ef1 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.355895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1e03c-8a4e-4ab7-95e4-04d5e7533ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.356336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1e03c-8a4e-4ab7-95e4-04d5e7533ef1 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.358164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 224/438] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:54.365547 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aabe09-d1fa-47cc-8baa-052b8547b7bd None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.366246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aabe09-d1fa-47cc-8baa-052b8547b7bd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.366689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aabe09-d1fa-47cc-8baa-052b8547b7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.380707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:54.388950 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-06aabe09-d1fa-47cc-8baa-052b8547b7bd None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:54.390157 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-06aabe09-d1fa-47cc-8baa-052b8547b7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:54.398803 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:54.406928 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109020a3-9b3a-46ff-8732-79e88afb3f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:54.407582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109020a3-9b3a-46ff-8732-79e88afb3f94 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.407889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109020a3-9b3a-46ff-8732-79e88afb3f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.408160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109020a3-9b3a-46ff-8732-79e88afb3f94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.471629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 225/439] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:54.473535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aabe09-d1fa-47cc-8baa-052b8547b7bd None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:54.490361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109020a3-9b3a-46ff-8732-79e88afb3f94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:54.492415 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109020a3-9b3a-46ff-8732-79e88afb3f94 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:54.602852 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aabe09-d1fa-47cc-8baa-052b8547b7bd None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:54.624551 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 215/440] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:16:54.625742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109020a3-9b3a-46ff-8732-79e88afb3f94 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:54.642917 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db97c5c-5c8f-4167-b025-cc9417761131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:54.643879 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db97c5c-5c8f-4167-b025-cc9417761131 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.644164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db97c5c-5c8f-4167-b025-cc9417761131 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.644438 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db97c5c-5c8f-4167-b025-cc9417761131 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.647102 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:54.655877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db97c5c-5c8f-4167-b025-cc9417761131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:54.656712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8db97c5c-5c8f-4167-b025-cc9417761131 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:54.663930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:54.664856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:54.665634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:54.665634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:54.665634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:54.665634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:54.665634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:54.665634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:54.665634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:54.665634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:54.665634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:54.665634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:54.665634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:16:54.665634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:54.665634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 226/441] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:54.666487 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db97c5c-5c8f-4167-b025-cc9417761131 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:54.727091 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109020a3-9b3a-46ff-8732-79e88afb3f94 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:54.762444 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce952e-c89d-41c2-b2b6-57c3f7cd4e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:54.763238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce952e-c89d-41c2-b2b6-57c3f7cd4e94 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.763505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce952e-c89d-41c2-b2b6-57c3f7cd4e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.763817 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce952e-c89d-41c2-b2b6-57c3f7cd4e94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.769458 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db97c5c-5c8f-4167-b025-cc9417761131 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:54.773788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce952e-c89d-41c2-b2b6-57c3f7cd4e94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-c1ce952e-c89d-41c2-b2b6-57c3f7cd4e94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:54.781761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:54.782743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:54.783553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:54.783553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:54.783553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:54.783553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:54.783553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:54.783553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:54.783553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:54.783553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:54.783553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:54.783553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:54.783553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:54.783553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:54.783553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 216/442] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:16:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:54.784268 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce952e-c89d-41c2-b2b6-57c3f7cd4e94 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:54.808207 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c550d-dd6b-4f92-b241-b156867a1045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:54.809070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c550d-dd6b-4f92-b241-b156867a1045 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.809346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c550d-dd6b-4f92-b241-b156867a1045 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.809616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c550d-dd6b-4f92-b241-b156867a1045 None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.810824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c550d-dd6b-4f92-b241-b156867a1045 None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:54.812327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c550d-dd6b-4f92-b241-b156867a1045 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:54.814018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 227/443] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:54 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:54.814764 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c550d-dd6b-4f92-b241-b156867a1045 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:54.875313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:54.876116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:54.886295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce952e-c89d-41c2-b2b6-57c3f7cd4e94 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:54.913349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c550d-dd6b-4f92-b241-b156867a1045 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:54.919616 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3be98-3441-4866-a688-d38c25ce3946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:54.920311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3be98-3441-4866-a688-d38c25ce3946 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.920581 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3be98-3441-4866-a688-d38c25ce3946 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.920870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3be98-3441-4866-a688-d38c25ce3946 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.921625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3be98-3441-4866-a688-d38c25ce3946 None admin] RBAC: Adding query filter params (name=member) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:54.921933 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3be98-3441-4866-a688-d38c25ce3946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:54.923319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3be98-3441-4866-a688-d38c25ce3946 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:54.931499 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 217/444] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:16:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:54.932301 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3be98-3441-4866-a688-d38c25ce3946 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:54.950623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8c6bc-da2f-4580-a426-81c2852fec3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:54.951320 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8c6bc-da2f-4580-a426-81c2852fec3c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.951626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8c6bc-da2f-4580-a426-81c2852fec3c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.951891 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8c6bc-da2f-4580-a426-81c2852fec3c None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.952655 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8c6bc-da2f-4580-a426-81c2852fec3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:54.952972 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8c6bc-da2f-4580-a426-81c2852fec3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:54.954403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8c6bc-da2f-4580-a426-81c2852fec3c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:54.962943 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 228/445] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:54.963760 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8c6bc-da2f-4580-a426-81c2852fec3c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:55.031259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3be98-3441-4866-a688-d38c25ce3946 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:55.061354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8c6bc-da2f-4580-a426-81c2852fec3c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:55.064610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3df4aa-65bf-4889-a883-e4fd019c0ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:55.065477 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3df4aa-65bf-4889-a883-e4fd019c0ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:55.065765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3df4aa-65bf-4889-a883-e4fd019c0ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:55.066041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3df4aa-65bf-4889-a883-e4fd019c0ee8 None admin] PATH_INFO: `/v3/groups/1233459c76d449b19a6f1af5f3855e32` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:55.067287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3df4aa-65bf-4889-a883-e4fd019c0ee8 None admin] RBAC: Authorizing `identity:get_group(group_id=1233459c76d449b19a6f1af5f3855e32)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:55.068782 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3df4aa-65bf-4889-a883-e4fd019c0ee8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:55.070445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 218/446] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 08:16:54 2022] GET /identity/v3/groups/1233459c76d449b19a6f1af5f3855e32 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:55.071205 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3df4aa-65bf-4889-a883-e4fd019c0ee8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:55.086805 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:55.096725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:55.102920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2a9f7-7778-47ad-9631-3f1839869d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:55.103578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2a9f7-7778-47ad-9631-3f1839869d27 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:55.103897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2a9f7-7778-47ad-9631-3f1839869d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:55.104178 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2a9f7-7778-47ad-9631-3f1839869d27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:55.171618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3df4aa-65bf-4889-a883-e4fd019c0ee8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:55.172423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2a9f7-7778-47ad-9631-3f1839869d27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:55.173944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2a9f7-7778-47ad-9631-3f1839869d27 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:55.204732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e65375-6750-4f37-b678-38e57978901f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:55.205376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e65375-6750-4f37-b678-38e57978901f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:55.205657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e65375-6750-4f37-b678-38e57978901f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:55.205941 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e65375-6750-4f37-b678-38e57978901f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:55.267964 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 229/447] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:55.269015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2a9f7-7778-47ad-9631-3f1839869d27 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:55.270995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e65375-6750-4f37-b678-38e57978901f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:55.272754 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e65375-6750-4f37-b678-38e57978901f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:55.293041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:55.296240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:55.366901 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2a9f7-7778-47ad-9631-3f1839869d27 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:55.369848 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 219/448] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:16:55.370725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e65375-6750-4f37-b678-38e57978901f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:55.399963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce2037-29d2-4e72-b862-33cc7819312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:55.400634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce2037-29d2-4e72-b862-33cc7819312a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:55.400897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce2037-29d2-4e72-b862-33cc7819312a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:55.401198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce2037-29d2-4e72-b862-33cc7819312a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:55.402326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce2037-29d2-4e72-b862-33cc7819312a None admin] RBAC: Adding query filter params (group.id=1233459c76d449b19a6f1af5f3855e32, role.id=18bb65296a9c487faf3b57d2b4246578, scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:55.402612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce2037-29d2-4e72-b862-33cc7819312a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:55.404086 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce2037-29d2-4e72-b862-33cc7819312a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:55.409920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 230/449] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 08:16:55 2022] GET /identity/v3/role_assignments?group.id=1233459c76d449b19a6f1af5f3855e32&scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce&role.id=18bb65296a9c487faf3b57d2b4246578 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:55.410728 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce2037-29d2-4e72-b862-33cc7819312a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:55.478620 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e65375-6750-4f37-b678-38e57978901f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:55.502149 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:55.518601 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b802a0-fda7-4d1b-824c-fa0744318c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:55.519474 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b802a0-fda7-4d1b-824c-fa0744318c7b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:55.519840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b802a0-fda7-4d1b-824c-fa0744318c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:55.520118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b802a0-fda7-4d1b-824c-fa0744318c7b None admin] PATH_INFO: `/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:55.521441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b802a0-fda7-4d1b-824c-fa0744318c7b None admin] RBAC: Authorizing `identity:get_project(project_id=227a6f78d2b64a49b50f5dd3bae9a0ce)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:55.522905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b802a0-fda7-4d1b-824c-fa0744318c7b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:55.524914 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 220/450] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:55 2022] GET /identity/v3/projects/227a6f78d2b64a49b50f5dd3bae9a0ce => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:55.527507 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:55.531291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b802a0-fda7-4d1b-824c-fa0744318c7b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:55.541058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce2037-29d2-4e72-b862-33cc7819312a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:55.581052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f3e0-c11d-4879-a0ba-1f0fdd327ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:55.581935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f3e0-c11d-4879-a0ba-1f0fdd327ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:55.582380 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f3e0-c11d-4879-a0ba-1f0fdd327ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:55.585298 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f3e0-c11d-4879-a0ba-1f0fdd327ee8 None admin] PATH_INFO: `/v3/projects/8dac71dc397d4676b170c1cf9092d9e5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:55.585298 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694f3e0-c11d-4879-a0ba-1f0fdd327ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=8dac71dc397d4676b170c1cf9092d9e5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:55.585467 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694f3e0-c11d-4879-a0ba-1f0fdd327ee8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:55.587107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 231/451] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:16:55 2022] GET /identity/v3/projects/8dac71dc397d4676b170c1cf9092d9e5 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:55.593676 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f3e0-c11d-4879-a0ba-1f0fdd327ee8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:55.640022 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b802a0-fda7-4d1b-824c-fa0744318c7b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:55.673405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce51aa-906c-4a85-a400-55d06502b6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:55.674288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce51aa-906c-4a85-a400-55d06502b6ea None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:55.674574 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce51aa-906c-4a85-a400-55d06502b6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:55.674847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce51aa-906c-4a85-a400-55d06502b6ea None admin] PATH_INFO: `/v3/groups/1233459c76d449b19a6f1af5f3855e32` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:55.676198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce51aa-906c-4a85-a400-55d06502b6ea None admin] RBAC: Authorizing `identity:get_group(group_id=1233459c76d449b19a6f1af5f3855e32)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:55.677842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce51aa-906c-4a85-a400-55d06502b6ea None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:55.679519 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 221/452] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 08:16:55 2022] GET /identity/v3/groups/1233459c76d449b19a6f1af5f3855e32 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:55.685320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce51aa-906c-4a85-a400-55d06502b6ea None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:55.698223 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f3e0-c11d-4879-a0ba-1f0fdd327ee8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:55.731912 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126bf06-ba07-4527-87ba-cf5ff7bc3813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:55.732705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126bf06-ba07-4527-87ba-cf5ff7bc3813 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:55.732991 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126bf06-ba07-4527-87ba-cf5ff7bc3813 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:55.733268 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126bf06-ba07-4527-87ba-cf5ff7bc3813 None admin] PATH_INFO: `/v3/groups/20bf2bff7e744e0da3a4ae84fcea7d2c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:55.734654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126bf06-ba07-4527-87ba-cf5ff7bc3813 None admin] RBAC: Authorizing `identity:get_group(group_id=20bf2bff7e744e0da3a4ae84fcea7d2c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:55.736432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126bf06-ba07-4527-87ba-cf5ff7bc3813 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:55.738070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 232/453] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 08:16:55 2022] GET /identity/v3/groups/20bf2bff7e744e0da3a4ae84fcea7d2c => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:55.741511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:55.744188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126bf06-ba07-4527-87ba-cf5ff7bc3813 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:55.771907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:55.786234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce51aa-906c-4a85-a400-55d06502b6ea None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:55.819995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595491ca-4a9c-4f8c-a239-5063b4b41854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:55.820621 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595491ca-4a9c-4f8c-a239-5063b4b41854 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:55.821345 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595491ca-4a9c-4f8c-a239-5063b4b41854 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:55.821622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595491ca-4a9c-4f8c-a239-5063b4b41854 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:55.822459 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595491ca-4a9c-4f8c-a239-5063b4b41854 None admin] RBAC: Adding query filter params (group.id=1233459c76d449b19a6f1af5f3855e32, role.id=3fb4236a239b47e3ac59e14b3db524b1, scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:55.823118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595491ca-4a9c-4f8c-a239-5063b4b41854 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:55.824585 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595491ca-4a9c-4f8c-a239-5063b4b41854 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:55.830476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 222/454] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 08:16:55 2022] GET /identity/v3/role_assignments?group.id=1233459c76d449b19a6f1af5f3855e32&scope.project.id=227a6f78d2b64a49b50f5dd3bae9a0ce&role.id=3fb4236a239b47e3ac59e14b3db524b1 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:55.847449 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126bf06-ba07-4527-87ba-cf5ff7bc3813 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:55.885275 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1772b4-ae69-4d6b-a140-459fab7e4eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:55.885966 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1772b4-ae69-4d6b-a140-459fab7e4eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:55.886233 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1772b4-ae69-4d6b-a140-459fab7e4eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:55.886521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1772b4-ae69-4d6b-a140-459fab7e4eb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:55.887373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1772b4-ae69-4d6b-a140-459fab7e4eb1 None admin] RBAC: Adding query filter params (group.id=20bf2bff7e744e0da3a4ae84fcea7d2c, role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=8dac71dc397d4676b170c1cf9092d9e5) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:55.887727 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1772b4-ae69-4d6b-a140-459fab7e4eb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:55.889195 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1772b4-ae69-4d6b-a140-459fab7e4eb1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:55.896138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 233/455] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 08:16:55 2022] GET /identity/v3/role_assignments?group.id=20bf2bff7e744e0da3a4ae84fcea7d2c&scope.project.id=8dac71dc397d4676b170c1cf9092d9e5&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:58.569203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592aa06-1c99-4def-a42a-d736ce347ee5 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:58.570225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592aa06-1c99-4def-a42a-d736ce347ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:58.570722 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592aa06-1c99-4def-a42a-d736ce347ee5 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:58.572597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 223/456] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:58.578580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8cd2-3b54-4dfa-974a-fb0aebbc8f94 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:58.579395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8cd2-3b54-4dfa-974a-fb0aebbc8f94 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:58.579896 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8cd2-3b54-4dfa-974a-fb0aebbc8f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:58.604615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-740f8cd2-3b54-4dfa-974a-fb0aebbc8f94 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:58.606179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-740f8cd2-3b54-4dfa-974a-fb0aebbc8f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:58.701418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31de78-950d-4958-978c-4a9c2b7941db None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:58.702011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 234/457] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:58.702222 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31de78-950d-4958-978c-4a9c2b7941db None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:58.702603 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31de78-950d-4958-978c-4a9c2b7941db None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:58.704350 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 224/458] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:58.716973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16168849-6434-4a5b-a8a1-68607d0a509f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:58.717261 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16168849-6434-4a5b-a8a1-68607d0a509f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:58.717547 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16168849-6434-4a5b-a8a1-68607d0a509f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:58.727925 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31de78-950d-4958-978c-4a9c2b7941db None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:58.748198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-16168849-6434-4a5b-a8a1-68607d0a509f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:58.750374 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-16168849-6434-4a5b-a8a1-68607d0a509f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:58.787260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:58.858687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 235/459] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:58.880929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16168849-6434-4a5b-a8a1-68607d0a509f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:58.956385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31de78-950d-4958-978c-4a9c2b7941db None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:58.995737 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:58.996897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16168849-6434-4a5b-a8a1-68607d0a509f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:59.036707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3f5e9-9c27-49a9-8a9b-7e89f7831a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:59.037863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f5e9-9c27-49a9-8a9b-7e89f7831a12 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:59.038345 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f5e9-9c27-49a9-8a9b-7e89f7831a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:59.038848 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f5e9-9c27-49a9-8a9b-7e89f7831a12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:59.040305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095469c-ed48-4170-91b7-d202bdf9a890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:59.041118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095469c-ed48-4170-91b7-d202bdf9a890 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:59.041397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095469c-ed48-4170-91b7-d202bdf9a890 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:59.041872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095469c-ed48-4170-91b7-d202bdf9a890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:59.051467 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3f5e9-9c27-49a9-8a9b-7e89f7831a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:59.053348 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3f5e9-9c27-49a9-8a9b-7e89f7831a12 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:59.066644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095469c-ed48-4170-91b7-d202bdf9a890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:59.068100 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095469c-ed48-4170-91b7-d202bdf9a890 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:59.075140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-c6d3f5e9-9c27-49a9-8a9b-7e89f7831a12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:59.075140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:59.075140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:59.075140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:59.075140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:59.075140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:59.075140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:59.075140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:59.075140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:59.075140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:59.075140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:59.075140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:59.075140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:16:59.075140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:16:59.075140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:59.076025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:59.076872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:16:59.076872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:16:59.076872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:59.076872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:59.079451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 236/460] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:59.088604 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3f5e9-9c27-49a9-8a9b-7e89f7831a12 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:59.091828 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:59.100565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-b095469c-ed48-4170-91b7-d202bdf9a890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:59.100565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:59.100565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:59.100565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:59.100565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:59.100565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:59.100565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:59.100565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:59.100565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:59.100565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:59.100565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:59.100565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:59.100565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:16:59.100565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:16:59.100565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:59.101688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:59.102746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:16:59.102746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:16:59.102746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:59.102746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:59.104980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 225/461] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:59.111352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095469c-ed48-4170-91b7-d202bdf9a890 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:59.202685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3f5e9-9c27-49a9-8a9b-7e89f7831a12 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:59.245466 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313ebd9-da69-414d-bec2-8c878a7e6892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:59.246487 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313ebd9-da69-414d-bec2-8c878a7e6892 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:59.247008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313ebd9-da69-414d-bec2-8c878a7e6892 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:59.247494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313ebd9-da69-414d-bec2-8c878a7e6892 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:59.248459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313ebd9-da69-414d-bec2-8c878a7e6892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:59.248962 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313ebd9-da69-414d-bec2-8c878a7e6892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:59.250578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313ebd9-da69-414d-bec2-8c878a7e6892 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:59.259184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095469c-ed48-4170-91b7-d202bdf9a890 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:59.272849 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 237/462] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:59.274505 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e04a1-dcc9-473d-bf8c-c53a3b65ee44 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:59.274989 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e04a1-dcc9-473d-bf8c-c53a3b65ee44 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:59.275460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e04a1-dcc9-473d-bf8c-c53a3b65ee44 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:59.277272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 238/463] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:59.278153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e04a1-dcc9-473d-bf8c-c53a3b65ee44 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:59.297621 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23156b0e-40a6-4d54-9991-c84ebe41d357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:59.298287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23156b0e-40a6-4d54-9991-c84ebe41d357 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:59.298661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23156b0e-40a6-4d54-9991-c84ebe41d357 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:59.299213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23156b0e-40a6-4d54-9991-c84ebe41d357 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:59.300522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23156b0e-40a6-4d54-9991-c84ebe41d357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:59.301390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23156b0e-40a6-4d54-9991-c84ebe41d357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:59.303048 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23156b0e-40a6-4d54-9991-c84ebe41d357 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:59.319725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 226/464] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:59.319725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518c4b3-ae31-4194-b50c-9bff80bdfe81 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:59.319725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518c4b3-ae31-4194-b50c-9bff80bdfe81 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:59.319725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518c4b3-ae31-4194-b50c-9bff80bdfe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:59.335967 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9518c4b3-ae31-4194-b50c-9bff80bdfe81 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:59.337156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9518c4b3-ae31-4194-b50c-9bff80bdfe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:59.344643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:59.364576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:59.388478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e04a1-dcc9-473d-bf8c-c53a3b65ee44 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:59.403931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 227/465] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:59.405604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77474405-208a-49d2-8b49-5da7c3a657ec None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:59.405888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77474405-208a-49d2-8b49-5da7c3a657ec None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:59.406163 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77474405-208a-49d2-8b49-5da7c3a657ec None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:59.407706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 228/466] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:59.408396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77474405-208a-49d2-8b49-5da7c3a657ec None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:59.437703 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783dff-ea56-41fb-aff7-2f7262928e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:59.439257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783dff-ea56-41fb-aff7-2f7262928e33 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:59.439875 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783dff-ea56-41fb-aff7-2f7262928e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:59.440484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783dff-ea56-41fb-aff7-2f7262928e33 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:59.441659 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9783dff-ea56-41fb-aff7-2f7262928e33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:59.443948 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9783dff-ea56-41fb-aff7-2f7262928e33 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:59.475627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 239/467] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:16:59 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:16:59.475627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4bbeb-805c-4f65-b323-7ae33d529fa2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:59.475627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4bbeb-805c-4f65-b323-7ae33d529fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:59.475627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4bbeb-805c-4f65-b323-7ae33d529fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:59.491636 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-46d4bbeb-805c-4f65-b323-7ae33d529fa2 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:59.493732 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-46d4bbeb-805c-4f65-b323-7ae33d529fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:59.538010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77474405-208a-49d2-8b49-5da7c3a657ec None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:59.579728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab88088-4553-41d6-acf7-6a075168fbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:59.580646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 240/468] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:16:59.581014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab88088-4553-41d6-acf7-6a075168fbc8 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:59.581014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab88088-4553-41d6-acf7-6a075168fbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:59.581479 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab88088-4553-41d6-acf7-6a075168fbc8 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:59.581578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4bbeb-805c-4f65-b323-7ae33d529fa2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:59.582523 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab88088-4553-41d6-acf7-6a075168fbc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:59.584225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab88088-4553-41d6-acf7-6a075168fbc8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:59.612413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 229/469] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:16:59 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:16:59.613672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab88088-4553-41d6-acf7-6a075168fbc8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:59.654904 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:59.670717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:59.753643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4bbeb-805c-4f65-b323-7ae33d529fa2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:59.772010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab88088-4553-41d6-acf7-6a075168fbc8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:59.808408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e69fe-7d98-4552-bd2c-ae40cf9c4251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:59.809792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e69fe-7d98-4552-bd2c-ae40cf9c4251 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:59.810079 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e69fe-7d98-4552-bd2c-ae40cf9c4251 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:59.810355 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e69fe-7d98-4552-bd2c-ae40cf9c4251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:59.813982 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3331657-ff60-4921-84e9-0512742a873e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:59.815233 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3331657-ff60-4921-84e9-0512742a873e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:59.815513 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3331657-ff60-4921-84e9-0512742a873e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:59.815842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3331657-ff60-4921-84e9-0512742a873e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:59.824139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e69fe-7d98-4552-bd2c-ae40cf9c4251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:59.825653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e69fe-7d98-4552-bd2c-ae40cf9c4251 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:59.829268 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3331657-ff60-4921-84e9-0512742a873e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:59.830793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3331657-ff60-4921-84e9-0512742a873e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:59.846312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-094e69fe-7d98-4552-bd2c-ae40cf9c4251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:59.846312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:59.846312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:59.846312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:59.846312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:59.846312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:59.846312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:59.846312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:59.846312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:59.846312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:59.846312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:59.846312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:59.846312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:16:59.846312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:16:59.846312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:59.847198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:59.848249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:16:59.848249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:16:59.848249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:59.848249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:16:59.848249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 241/470] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:59.850743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-f3331657-ff60-4921-84e9-0512742a873e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:59.850743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:59.850743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:59.850743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:59.850743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:59.850743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:59.850743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:59.850743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:59.850743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:59.850743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:59.850743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:59.850743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:59.850743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:16:59.850743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:16:59.850743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:59.851527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:59.852391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:16:59.852391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:16:59.852391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:59.852391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:16:59.852391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 230/471] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:16:59.858366 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e69fe-7d98-4552-bd2c-ae40cf9c4251 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:59.869811 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3331657-ff60-4921-84e9-0512742a873e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:59.969288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:00.012025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:00.013761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3331657-ff60-4921-84e9-0512742a873e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:00.016120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e69fe-7d98-4552-bd2c-ae40cf9c4251 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:00.078988 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602887d5-ad1d-49b0-8786-61cb6be03a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:00.079572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602887d5-ad1d-49b0-8786-61cb6be03a85 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:00.079874 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602887d5-ad1d-49b0-8786-61cb6be03a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:00.080149 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602887d5-ad1d-49b0-8786-61cb6be03a85 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:00.080883 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602887d5-ad1d-49b0-8786-61cb6be03a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:00.081188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602887d5-ad1d-49b0-8786-61cb6be03a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:00.082673 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602887d5-ad1d-49b0-8786-61cb6be03a85 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:00.084981 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce102b4-9276-4eea-aa4d-f920e4ec05bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:00.085646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce102b4-9276-4eea-aa4d-f920e4ec05bc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:00.085988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce102b4-9276-4eea-aa4d-f920e4ec05bc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:00.086259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce102b4-9276-4eea-aa4d-f920e4ec05bc None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:00.087045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce102b4-9276-4eea-aa4d-f920e4ec05bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:00.087349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce102b4-9276-4eea-aa4d-f920e4ec05bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:00.088743 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce102b4-9276-4eea-aa4d-f920e4ec05bc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:00.109751 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 231/472] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:00.115699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602887d5-ad1d-49b0-8786-61cb6be03a85 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:00.116127 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 242/473] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:00.120195 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce102b4-9276-4eea-aa4d-f920e4ec05bc None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:00.244198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602887d5-ad1d-49b0-8786-61cb6be03a85 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:00.263898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce102b4-9276-4eea-aa4d-f920e4ec05bc None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:00.281580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:00.291630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe5734-f869-4687-8e45-2ff1561ca8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:00.291630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe5734-f869-4687-8e45-2ff1561ca8f9 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:00.291630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe5734-f869-4687-8e45-2ff1561ca8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:00.291630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe5734-f869-4687-8e45-2ff1561ca8f9 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:00.292116 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe5734-f869-4687-8e45-2ff1561ca8f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:00.293851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe5734-f869-4687-8e45-2ff1561ca8f9 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:00.303238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c472d-f1aa-4b07-8f52-9876d472fe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:00.304556 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c472d-f1aa-4b07-8f52-9876d472fe6a None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:00.305063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c472d-f1aa-4b07-8f52-9876d472fe6a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:00.305616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c472d-f1aa-4b07-8f52-9876d472fe6a None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:00.306721 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c472d-f1aa-4b07-8f52-9876d472fe6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:00.308590 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c472d-f1aa-4b07-8f52-9876d472fe6a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:00.318231 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 232/474] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:17:00 2022] POST /identity/v3/users => generated 249 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:00.320837 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ba949-3c8a-4e31-a9ef-b2db9c952a9e None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:00.321570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ba949-3c8a-4e31-a9ef-b2db9c952a9e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:00.321934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ba949-3c8a-4e31-a9ef-b2db9c952a9e None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:00.323998 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 233/475] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:00.330036 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a6401-4df3-4cec-977b-bcb04f2d5200 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:00.330567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a6401-4df3-4cec-977b-bcb04f2d5200 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:00.330843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a6401-4df3-4cec-977b-bcb04f2d5200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:00.337031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 243/476] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:17:00 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:00.366919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-321a6401-4df3-4cec-977b-bcb04f2d5200 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:00.368207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-321a6401-4df3-4cec-977b-bcb04f2d5200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:00.498141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 234/477] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:00.533007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c472d-f1aa-4b07-8f52-9876d472fe6a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:00.556309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:00.655264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c472d-f1aa-4b07-8f52-9876d472fe6a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:00.695305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb52b3b-10cb-41aa-a7e9-b8851da07d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:00.696030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb52b3b-10cb-41aa-a7e9-b8851da07d5c None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:00.696323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb52b3b-10cb-41aa-a7e9-b8851da07d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:00.696601 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb52b3b-10cb-41aa-a7e9-b8851da07d5c None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:00.697399 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb52b3b-10cb-41aa-a7e9-b8851da07d5c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:00.698800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb52b3b-10cb-41aa-a7e9-b8851da07d5c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:00.706416 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.sql.core [None req-bfb52b3b-10cb-41aa-a7e9-b8851da07d5c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 08:17:00.706416 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 08:17:00.706416 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [parameters: {'id': 'd506116d1dfd454587c8d62fca0275ea', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 08:17:00.706416 dv-cinder-850320-1-smb devstack@keystone.service[80237]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80237) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 08:17:00.722984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-bfb52b3b-10cb-41aa-a7e9-b8851da07d5c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 08:17:00.722984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:00.722984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:17:00.722984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:17:00.722984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:17:00.722984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:17:00.722984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:17:00.722984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:17:00.722984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:17:00.722984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:17:00.722984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:17:00.722984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:17:00.722984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:17:00.722984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result.read() Jul 21 08:17:00.722984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:17:00.724130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application yield resource Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise self.value Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application session.commit() Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 08:17:00.725145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.session.flush() Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application compat.raise_( Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 08:17:00.726007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:17:00.727208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result.read() Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:17:00.728088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [parameters: {'id': 'd506116d1dfd454587c8d62fca0275ea', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:00.729995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 08:17:00.732290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:00.734339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 244/478] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 21 08:17:00 2022] POST /identity/v3/roles => generated 144 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:00.734483 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a6401-4df3-4cec-977b-bcb04f2d5200 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:00.839109 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a6401-4df3-4cec-977b-bcb04f2d5200 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:00.857793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:00.885760 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2a79d-9e4e-4f07-a297-d7e53987518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:00.886625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2a79d-9e4e-4f07-a297-d7e53987518c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:00.886914 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2a79d-9e4e-4f07-a297-d7e53987518c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:00.887191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2a79d-9e4e-4f07-a297-d7e53987518c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:00.905225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2a79d-9e4e-4f07-a297-d7e53987518c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-cce2a79d-9e4e-4f07-a297-d7e53987518c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:00.913526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:00.914397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:00.915171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:00.915171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:00.915171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:00.915171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:00.915171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:00.915171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:00.915171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:00.915171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:00.915171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:00.915171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:00.915171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:17:00.915171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:00.915171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 235/479] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:17:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:00.920708 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb52b3b-10cb-41aa-a7e9-b8851da07d5c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:01.042851 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:01.066481 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb52b3b-10cb-41aa-a7e9-b8851da07d5c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:01.118138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcad04d-c620-4bcf-ad6d-6ecdc343553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:01.118819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcad04d-c620-4bcf-ad6d-6ecdc343553c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:01.119103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcad04d-c620-4bcf-ad6d-6ecdc343553c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:01.119380 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcad04d-c620-4bcf-ad6d-6ecdc343553c None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:01.120170 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcad04d-c620-4bcf-ad6d-6ecdc343553c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:01.120477 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcad04d-c620-4bcf-ad6d-6ecdc343553c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:01.121856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcad04d-c620-4bcf-ad6d-6ecdc343553c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:01.135825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 245/480] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:01.836216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34cc8e-56b8-43c1-88d4-60307ca5010e None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:01.836741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34cc8e-56b8-43c1-88d4-60307ca5010e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:01.836741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34cc8e-56b8-43c1-88d4-60307ca5010e None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:01.838308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 236/481] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:01.843832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df30766-11e3-42bc-b731-ec8de8633fe2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:01.844288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df30766-11e3-42bc-b731-ec8de8633fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:01.844423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df30766-11e3-42bc-b731-ec8de8633fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:01.885174 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2df30766-11e3-42bc-b731-ec8de8633fe2 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:01.886390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2df30766-11e3-42bc-b731-ec8de8633fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:01.989932 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 246/482] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:17:02.026408 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34cc8e-56b8-43c1-88d4-60307ca5010e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:02.142688 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf28ea3-f724-47f1-84c5-7d978ee91803 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:02.142893 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf28ea3-f724-47f1-84c5-7d978ee91803 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:02.143168 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf28ea3-f724-47f1-84c5-7d978ee91803 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:02.145115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 247/483] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:02.150905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2533386-7a2c-4b13-92d9-6c4f90a7b772 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:02.151269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2533386-7a2c-4b13-92d9-6c4f90a7b772 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:02.151471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2533386-7a2c-4b13-92d9-6c4f90a7b772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:02.177290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e2533386-7a2c-4b13-92d9-6c4f90a7b772 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:02.178507 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e2533386-7a2c-4b13-92d9-6c4f90a7b772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:02.193588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34cc8e-56b8-43c1-88d4-60307ca5010e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:02.252968 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dbd21-083f-48bc-9fb4-5dfe7c0db2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:02.253803 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dbd21-083f-48bc-9fb4-5dfe7c0db2bb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:02.254149 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dbd21-083f-48bc-9fb4-5dfe7c0db2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:02.254592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dbd21-083f-48bc-9fb4-5dfe7c0db2bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:02.274122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dbd21-083f-48bc-9fb4-5dfe7c0db2bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-663dbd21-083f-48bc-9fb4-5dfe7c0db2bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:02.288376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:02.289310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:02.290103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:02.290103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:02.290103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:02.290103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:02.290103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:02.290103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:02.290103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:02.290103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:02.290103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:02.290103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:02.290103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:02.290103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:02.297356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 237/484] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:02.298264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dbd21-083f-48bc-9fb4-5dfe7c0db2bb None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:02.314226 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 248/485] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:17:02.352669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2533386-7a2c-4b13-92d9-6c4f90a7b772 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:02.357272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:02.370815 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:02.443896 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dbd21-083f-48bc-9fb4-5dfe7c0db2bb None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:02.481035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4f530-1364-4105-9931-76f5d7eb973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:02.481697 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4f530-1364-4105-9931-76f5d7eb973a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:02.481982 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4f530-1364-4105-9931-76f5d7eb973a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:02.482259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4f530-1364-4105-9931-76f5d7eb973a None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:02.483022 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4f530-1364-4105-9931-76f5d7eb973a None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:02.483330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4f530-1364-4105-9931-76f5d7eb973a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:02.484764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4f530-1364-4105-9931-76f5d7eb973a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:02.501008 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 238/486] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:02.510331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4f530-1364-4105-9931-76f5d7eb973a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:02.564492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2533386-7a2c-4b13-92d9-6c4f90a7b772 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:02.637714 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca855970-4b55-4e3a-8f0e-7a6e9edb4cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:02.638547 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca855970-4b55-4e3a-8f0e-7a6e9edb4cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:02.638833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca855970-4b55-4e3a-8f0e-7a6e9edb4cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:02.639112 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca855970-4b55-4e3a-8f0e-7a6e9edb4cf5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:02.664005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca855970-4b55-4e3a-8f0e-7a6e9edb4cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ca855970-4b55-4e3a-8f0e-7a6e9edb4cf5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:02.671905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:02.672782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:02.673559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:02.673559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:02.673559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:02.673559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:02.673559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:02.673559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:02.673559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:02.673559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:02.673559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:02.673559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:02.673559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:02.673559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:02.684550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 249/487] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:02.685512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca855970-4b55-4e3a-8f0e-7a6e9edb4cf5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:02.695859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:02.704539 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4f530-1364-4105-9931-76f5d7eb973a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:02.774402 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b8047-6f07-4974-886b-668c6480aae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:02.775245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b8047-6f07-4974-886b-668c6480aae1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:02.775769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b8047-6f07-4974-886b-668c6480aae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:02.776273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b8047-6f07-4974-886b-668c6480aae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:02.794140 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b8047-6f07-4974-886b-668c6480aae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:02.795797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b8047-6f07-4974-886b-668c6480aae1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:02.812563 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:02.819886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-aa0b8047-6f07-4974-886b-668c6480aae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:02.819886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:02.819886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:02.819886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:02.819886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:02.819886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:02.819886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:02.819886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:02.819886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:02.819886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:02.819886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:02.819886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:02.819886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:02.819886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:02.819886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:02.820745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:02.821596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:02.821596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:02.821596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:02.821596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:02.821596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 239/488] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:02.826704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b8047-6f07-4974-886b-668c6480aae1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:02.871860 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca855970-4b55-4e3a-8f0e-7a6e9edb4cf5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:02.908537 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edc0c9-bc55-458e-9ca6-52ed45c6a4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:02.909222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edc0c9-bc55-458e-9ca6-52ed45c6a4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:02.909508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edc0c9-bc55-458e-9ca6-52ed45c6a4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:02.909786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edc0c9-bc55-458e-9ca6-52ed45c6a4c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:02.910624 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edc0c9-bc55-458e-9ca6-52ed45c6a4c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:02.910937 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edc0c9-bc55-458e-9ca6-52ed45c6a4c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:02.912473 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edc0c9-bc55-458e-9ca6-52ed45c6a4c3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:02.922316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 250/489] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:02.931701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edc0c9-bc55-458e-9ca6-52ed45c6a4c3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:02.990956 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b8047-6f07-4974-886b-668c6480aae1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:03.025308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e72e6-624b-4538-9ffa-e659e08d12fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:03.025983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e72e6-624b-4538-9ffa-e659e08d12fa None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.026271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e72e6-624b-4538-9ffa-e659e08d12fa None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.026552 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e72e6-624b-4538-9ffa-e659e08d12fa None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.027633 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e72e6-624b-4538-9ffa-e659e08d12fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:03.027953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e72e6-624b-4538-9ffa-e659e08d12fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:03.029502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e72e6-624b-4538-9ffa-e659e08d12fa None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:03.042225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 240/490] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:03.047528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e72e6-624b-4538-9ffa-e659e08d12fa None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:03.063627 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:03.138242 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edc0c9-bc55-458e-9ca6-52ed45c6a4c3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:03.170994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:03.186242 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af746115-a3b0-435b-b0f6-9fb29ef00dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:03.186647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e72e6-624b-4538-9ffa-e659e08d12fa None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:03.187051 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af746115-a3b0-435b-b0f6-9fb29ef00dea None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.187336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af746115-a3b0-435b-b0f6-9fb29ef00dea None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.187639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af746115-a3b0-435b-b0f6-9fb29ef00dea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.202333 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af746115-a3b0-435b-b0f6-9fb29ef00dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:03.204135 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af746115-a3b0-435b-b0f6-9fb29ef00dea None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:03.223281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-af746115-a3b0-435b-b0f6-9fb29ef00dea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:03.223281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:03.223281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:03.223281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:03.223281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:03.223281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:03.223281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:03.223281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:03.223281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:03.223281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:03.223281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:03.223281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:03.223281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:03.223281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:03.223281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:03.224530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:03.225370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:03.225370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:03.225370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:03.225370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:03.225370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 251/491] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:03.226982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea66b6b-0f7d-4c99-95c6-b37945d2c7ac None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.226982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea66b6b-0f7d-4c99-95c6-b37945d2c7ac None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.226982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea66b6b-0f7d-4c99-95c6-b37945d2c7ac None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.228361 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 252/492] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:03.229390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35927952-32b3-47e7-bbd3-d521bcf5218b None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.229514 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefb013-51c5-4395-bb12-3b1488c1d613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:03.229727 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35927952-32b3-47e7-bbd3-d521bcf5218b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.229948 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35927952-32b3-47e7-bbd3-d521bcf5218b None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.230263 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefb013-51c5-4395-bb12-3b1488c1d613 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.230550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefb013-51c5-4395-bb12-3b1488c1d613 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.230825 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefb013-51c5-4395-bb12-3b1488c1d613 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.231632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 253/493] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:03.234774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35927952-32b3-47e7-bbd3-d521bcf5218b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:03.242982 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefb013-51c5-4395-bb12-3b1488c1d613 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:03.244465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefb013-51c5-4395-bb12-3b1488c1d613 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-6eefb013-51c5-4395-bb12-3b1488c1d613 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:03.263128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:03.264128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:03.265037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:03.265037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:03.265037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:03.265037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:03.265037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:03.265037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:03.265037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:03.265037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:03.265037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:17:03.265037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:03.265037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 241/494] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:17:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:03.265658 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ac8f4-ab14-4e1d-9180-dbb518e1636b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.266416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ac8f4-ab14-4e1d-9180-dbb518e1636b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.266760 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ac8f4-ab14-4e1d-9180-dbb518e1636b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.284049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-319ac8f4-ab14-4e1d-9180-dbb518e1636b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:03.285291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-319ac8f4-ab14-4e1d-9180-dbb518e1636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:03.347773 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35927952-32b3-47e7-bbd3-d521bcf5218b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:03.351612 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:03.357375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 242/495] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:03.358648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2794758-9967-4cec-853c-f730415c29c3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.358936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2794758-9967-4cec-853c-f730415c29c3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.359212 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2794758-9967-4cec-853c-f730415c29c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.377316 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f2794758-9967-4cec-853c-f730415c29c3 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:03.378759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f2794758-9967-4cec-853c-f730415c29c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:03.403273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9853f6-1ef3-42a9-a30c-278f97ff8f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:03.404743 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9853f6-1ef3-42a9-a30c-278f97ff8f0c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.405649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9853f6-1ef3-42a9-a30c-278f97ff8f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.406129 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9853f6-1ef3-42a9-a30c-278f97ff8f0c None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.407505 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9853f6-1ef3-42a9-a30c-278f97ff8f0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:03.408210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9853f6-1ef3-42a9-a30c-278f97ff8f0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:03.410263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9853f6-1ef3-42a9-a30c-278f97ff8f0c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:03.427390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 254/496] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:03.428615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9853f6-1ef3-42a9-a30c-278f97ff8f0c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:03.467693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 243/497] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:03.467693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2794758-9967-4cec-853c-f730415c29c3 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:03.487304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:03.555274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9853f6-1ef3-42a9-a30c-278f97ff8f0c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:03.568151 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2794758-9967-4cec-853c-f730415c29c3 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:03.591072 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3e9a6-5d90-43e8-a52f-90b4e8fb64df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:03.591803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3e9a6-5d90-43e8-a52f-90b4e8fb64df None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.592082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3e9a6-5d90-43e8-a52f-90b4e8fb64df None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.592362 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3e9a6-5d90-43e8-a52f-90b4e8fb64df None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.593219 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3e9a6-5d90-43e8-a52f-90b4e8fb64df None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:03.593511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3e9a6-5d90-43e8-a52f-90b4e8fb64df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:03.594951 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3e9a6-5d90-43e8-a52f-90b4e8fb64df None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:03.598489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:03.604832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f54c09-baf9-4dda-8301-b2bcf14cf3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:03.605609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f54c09-baf9-4dda-8301-b2bcf14cf3ac None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.605889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f54c09-baf9-4dda-8301-b2bcf14cf3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.607118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f54c09-baf9-4dda-8301-b2bcf14cf3ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.618206 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f54c09-baf9-4dda-8301-b2bcf14cf3ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-13f54c09-baf9-4dda-8301-b2bcf14cf3ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:03.625847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:03.626733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:03.627543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:03.627543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:03.627543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:03.627543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:03.627543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:03.627543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:03.627543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:03.627543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:03.627543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:03.627543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:03.627543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:03.627543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:03.627543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 244/498] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:03.629645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f54c09-baf9-4dda-8301-b2bcf14cf3ac None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:03.636661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 255/499] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 21 08:17:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:03.638392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3e9a6-5d90-43e8-a52f-90b4e8fb64df None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:03.731219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f54c09-baf9-4dda-8301-b2bcf14cf3ac None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:03.734151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:03.741675 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3e9a6-5d90-43e8-a52f-90b4e8fb64df None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:03.764367 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5ddf5-4c7a-41cb-a7e1-c3dc9f8a9b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:03.765167 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5ddf5-4c7a-41cb-a7e1-c3dc9f8a9b78 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.765470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5ddf5-4c7a-41cb-a7e1-c3dc9f8a9b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.765739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5ddf5-4c7a-41cb-a7e1-c3dc9f8a9b78 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.773359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5ddf5-4c7a-41cb-a7e1-c3dc9f8a9b78 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:03.774685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068a392-ad55-44cb-85e0-2de07b627d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:03.774805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5ddf5-4c7a-41cb-a7e1-c3dc9f8a9b78 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:03.775477 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a392-ad55-44cb-85e0-2de07b627d89 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.775791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a392-ad55-44cb-85e0-2de07b627d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.776065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a392-ad55-44cb-85e0-2de07b627d89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.786276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068a392-ad55-44cb-85e0-2de07b627d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-90d5ddf5-4c7a-41cb-a7e1-c3dc9f8a9b78 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:03.788880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:03.789787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:03.790672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:03.790672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:03.790672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:03.790672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:03.790672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:03.790672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:03.790672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:03.790672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:03.790672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:17:03.790672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:03.790672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 245/500] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 08:17:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:03.791447 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5ddf5-4c7a-41cb-a7e1-c3dc9f8a9b78 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-3068a392-ad55-44cb-85e0-2de07b627d89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:03.793916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:03.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:03.795903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:03.795903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:03.795903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:03.795903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:03.795903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:03.795903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:03.795903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:03.795903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:03.795903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:03.795903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:03.795903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:03.795903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:03.795903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 256/501] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:03.795903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068a392-ad55-44cb-85e0-2de07b627d89 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:03.844313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:03.892842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5ddf5-4c7a-41cb-a7e1-c3dc9f8a9b78 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:03.896936 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068a392-ad55-44cb-85e0-2de07b627d89 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:03.926966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f506e-25e1-44c2-91a0-9232b21887e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:03.927665 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f506e-25e1-44c2-91a0-9232b21887e1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.927943 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f506e-25e1-44c2-91a0-9232b21887e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.928214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f506e-25e1-44c2-91a0-9232b21887e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.928964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f506e-25e1-44c2-91a0-9232b21887e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:03.929268 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f506e-25e1-44c2-91a0-9232b21887e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:03.930645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f506e-25e1-44c2-91a0-9232b21887e1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:03.931017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5b7de-639d-49bf-8f42-488b1efd2fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:03.931722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b7de-639d-49bf-8f42-488b1efd2fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.932015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b7de-639d-49bf-8f42-488b1efd2fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.932288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b7de-639d-49bf-8f42-488b1efd2fd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.939042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 246/502] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:03.940119 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f736cd-6ef1-44ec-bb31-313f58bde45d None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.940405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f736cd-6ef1-44ec-bb31-313f58bde45d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.940685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f736cd-6ef1-44ec-bb31-313f58bde45d None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.942060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 247/503] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:03.944270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f736cd-6ef1-44ec-bb31-313f58bde45d None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:03.956943 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:04.000498 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5b7de-639d-49bf-8f42-488b1efd2fd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:04.001998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5b7de-639d-49bf-8f42-488b1efd2fd5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:04.045905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f736cd-6ef1-44ec-bb31-313f58bde45d None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:04.058602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:04.079954 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f26d67-685f-4fbb-a94b-0d2f0403c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:04.080651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f26d67-685f-4fbb-a94b-0d2f0403c96e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:04.080935 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f26d67-685f-4fbb-a94b-0d2f0403c96e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:04.081213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f26d67-685f-4fbb-a94b-0d2f0403c96e None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:04.082249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f26d67-685f-4fbb-a94b-0d2f0403c96e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:04.082558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f26d67-685f-4fbb-a94b-0d2f0403c96e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:04.084041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f26d67-685f-4fbb-a94b-0d2f0403c96e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:04.099386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 257/504] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:17:04.100184 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5b7de-639d-49bf-8f42-488b1efd2fd5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:04.121433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 248/505] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 08:17:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:04.122340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f26d67-685f-4fbb-a94b-0d2f0403c96e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:04.153670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:04.197881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5b7de-639d-49bf-8f42-488b1efd2fd5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:04.219159 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f26d67-685f-4fbb-a94b-0d2f0403c96e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:04.231119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a561292-a4a2-4275-af9f-0b122cd8eb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:04.231812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a561292-a4a2-4275-af9f-0b122cd8eb31 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:04.232098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a561292-a4a2-4275-af9f-0b122cd8eb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:04.232368 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a561292-a4a2-4275-af9f-0b122cd8eb31 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:04.233117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a561292-a4a2-4275-af9f-0b122cd8eb31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:04.233421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a561292-a4a2-4275-af9f-0b122cd8eb31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:04.234818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a561292-a4a2-4275-af9f-0b122cd8eb31 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:04.242825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 258/506] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:04.244040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f6a84-9a72-4e53-b165-7c8e119ca7a2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:04.244326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f6a84-9a72-4e53-b165-7c8e119ca7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:04.244604 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f6a84-9a72-4e53-b165-7c8e119ca7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:04.254884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732cc02-4752-4df4-a5dc-14e4d47c61df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:04.255710 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732cc02-4752-4df4-a5dc-14e4d47c61df None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:04.255989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732cc02-4752-4df4-a5dc-14e4d47c61df None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:04.256262 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732cc02-4752-4df4-a5dc-14e4d47c61df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:04.260998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0b7f6a84-9a72-4e53-b165-7c8e119ca7a2 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:04.262182 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0b7f6a84-9a72-4e53-b165-7c8e119ca7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:04.266323 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732cc02-4752-4df4-a5dc-14e4d47c61df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:04.267797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732cc02-4752-4df4-a5dc-14e4d47c61df None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:04.286652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-f732cc02-4752-4df4-a5dc-14e4d47c61df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:04.286652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:04.286652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:04.286652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:04.286652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:04.286652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:04.286652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:04.286652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:04.286652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:04.286652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:04.286652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:04.286652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:04.286652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:04.286652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:04.286652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:04.287623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:04.288553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:04.288553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:04.288553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:04.288553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:04.288553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 249/507] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:04.288823 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732cc02-4752-4df4-a5dc-14e4d47c61df None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:04.313542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:04.331538 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 259/508] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:04.332541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f6a84-9a72-4e53-b165-7c8e119ca7a2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:04.377470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:04.404474 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732cc02-4752-4df4-a5dc-14e4d47c61df None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:04.433015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f6a84-9a72-4e53-b165-7c8e119ca7a2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:04.441568 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec205c98-f746-49b2-bfbb-46b0f8dd1961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:04.442370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec205c98-f746-49b2-bfbb-46b0f8dd1961 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:04.442668 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec205c98-f746-49b2-bfbb-46b0f8dd1961 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:04.442939 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec205c98-f746-49b2-bfbb-46b0f8dd1961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:04.453640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec205c98-f746-49b2-bfbb-46b0f8dd1961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:04.455232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec205c98-f746-49b2-bfbb-46b0f8dd1961 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:04.472055 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eced3a-5621-4ce3-86d9-1fbb7829bed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:04.472914 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eced3a-5621-4ce3-86d9-1fbb7829bed1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:04.473218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eced3a-5621-4ce3-86d9-1fbb7829bed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:04.473494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eced3a-5621-4ce3-86d9-1fbb7829bed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:04.473693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ec205c98-f746-49b2-bfbb-46b0f8dd1961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:04.473693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:04.473693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:04.473693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:04.473693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:04.473693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:04.473693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:04.473693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:04.473693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:04.473693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:04.473693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:04.473693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:04.473693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:04.473693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:04.473693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:04.474471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:04.475291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:04.475291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:04.475291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:04.475291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:04.475734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 250/509] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:04.476841 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec205c98-f746-49b2-bfbb-46b0f8dd1961 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:04.541452 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eced3a-5621-4ce3-86d9-1fbb7829bed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:04.542990 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eced3a-5621-4ce3-86d9-1fbb7829bed1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:04.552781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:04.577185 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec205c98-f746-49b2-bfbb-46b0f8dd1961 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:04.589065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:04.611393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25712f1-4e1d-43c8-a8e8-6b308cf0ae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:04.612309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25712f1-4e1d-43c8-a8e8-6b308cf0ae56 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:04.612600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25712f1-4e1d-43c8-a8e8-6b308cf0ae56 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:04.612867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25712f1-4e1d-43c8-a8e8-6b308cf0ae56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:04.632948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25712f1-4e1d-43c8-a8e8-6b308cf0ae56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:04.634472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25712f1-4e1d-43c8-a8e8-6b308cf0ae56 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:04.644101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 260/510] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:17:04.645197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eced3a-5621-4ce3-86d9-1fbb7829bed1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:04.656507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-e25712f1-4e1d-43c8-a8e8-6b308cf0ae56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:04.656507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:04.656507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:04.656507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:04.656507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:04.656507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:04.656507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:04.656507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:04.656507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:04.656507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:04.656507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:04.656507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:04.656507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:04.656507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:04.656507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:04.657393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:04.658257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:04.658257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:04.658257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:04.658257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:04.658257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 251/511] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:04.658534 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25712f1-4e1d-43c8-a8e8-6b308cf0ae56 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:04.756903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eced3a-5621-4ce3-86d9-1fbb7829bed1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:04.758540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25712f1-4e1d-43c8-a8e8-6b308cf0ae56 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:04.784433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:04.791988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b1e1d-78cd-488d-a45b-73858212050a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:04.792676 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b1e1d-78cd-488d-a45b-73858212050a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:04.792961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b1e1d-78cd-488d-a45b-73858212050a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:04.793238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b1e1d-78cd-488d-a45b-73858212050a None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:04.793616 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d165e-bf6c-40b1-9337-1e267f91a125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:04.793965 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b1e1d-78cd-488d-a45b-73858212050a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:04.794272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b1e1d-78cd-488d-a45b-73858212050a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:04.794418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d165e-bf6c-40b1-9337-1e267f91a125 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:04.794696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d165e-bf6c-40b1-9337-1e267f91a125 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:04.794970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d165e-bf6c-40b1-9337-1e267f91a125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:04.795683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b1e1d-78cd-488d-a45b-73858212050a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:04.805181 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d165e-bf6c-40b1-9337-1e267f91a125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:04.806649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d165e-bf6c-40b1-9337-1e267f91a125 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:04.806916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 261/512] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:04.807779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b1e1d-78cd-488d-a45b-73858212050a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:04.821632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:04.830216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-768d165e-bf6c-40b1-9337-1e267f91a125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:04.830216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:04.830216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:04.830216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:04.830216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:04.830216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:04.830216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:04.830216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:04.830216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:04.830216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:04.830216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:04.830216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:04.830216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:04.830216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:04.830216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:04.831102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:04.832141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:04.832141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:04.832141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:04.832141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:04.832141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 252/513] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:04.832830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d165e-bf6c-40b1-9337-1e267f91a125 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:04.918344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b1e1d-78cd-488d-a45b-73858212050a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:04.932468 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d165e-bf6c-40b1-9337-1e267f91a125 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:04.952039 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b89fda-717f-41f9-80b1-8f80126b6313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:04.953102 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b89fda-717f-41f9-80b1-8f80126b6313 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:04.953380 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b89fda-717f-41f9-80b1-8f80126b6313 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:04.953648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b89fda-717f-41f9-80b1-8f80126b6313 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:04.954369 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b89fda-717f-41f9-80b1-8f80126b6313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:04.954665 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b89fda-717f-41f9-80b1-8f80126b6313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:04.956065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b89fda-717f-41f9-80b1-8f80126b6313 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:04.966530 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09856ab3-c4f6-41b7-9ec8-d828f743cf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:04.967305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09856ab3-c4f6-41b7-9ec8-d828f743cf1e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:04.967610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09856ab3-c4f6-41b7-9ec8-d828f743cf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:04.967779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 262/514] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:04.967856 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09856ab3-c4f6-41b7-9ec8-d828f743cf1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:04.968431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b89fda-717f-41f9-80b1-8f80126b6313 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:04.979690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09856ab3-c4f6-41b7-9ec8-d828f743cf1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:04.981311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09856ab3-c4f6-41b7-9ec8-d828f743cf1e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:05.000960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-09856ab3-c4f6-41b7-9ec8-d828f743cf1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:05.000960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:05.000960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:05.000960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:05.000960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:05.000960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:05.000960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:05.000960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:05.000960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:05.000960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:05.000960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:05.000960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:05.000960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:05.000960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:05.000960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:05.002059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:05.002994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:05.002994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:05.002994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:05.002994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:05.002994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 253/515] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:05.003299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09856ab3-c4f6-41b7-9ec8-d828f743cf1e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:05.034053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:05.039117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:05.074260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b89fda-717f-41f9-80b1-8f80126b6313 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:05.104745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09856ab3-c4f6-41b7-9ec8-d828f743cf1e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:05.109593 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c141deb-8a47-4077-a088-1f6d180892d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:05.110253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c141deb-8a47-4077-a088-1f6d180892d7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:05.110536 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c141deb-8a47-4077-a088-1f6d180892d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:05.110806 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c141deb-8a47-4077-a088-1f6d180892d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:05.111521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c141deb-8a47-4077-a088-1f6d180892d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:05.111838 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c141deb-8a47-4077-a088-1f6d180892d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:05.113283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c141deb-8a47-4077-a088-1f6d180892d7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:05.124772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 263/516] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:05.126055 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c141deb-8a47-4077-a088-1f6d180892d7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:05.138734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00abf3-da99-4c87-8063-94711b9bf2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:05.139641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00abf3-da99-4c87-8063-94711b9bf2dd None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:05.139926 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00abf3-da99-4c87-8063-94711b9bf2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:05.140211 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00abf3-da99-4c87-8063-94711b9bf2dd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:05.148110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00abf3-da99-4c87-8063-94711b9bf2dd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:05.149563 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00abf3-da99-4c87-8063-94711b9bf2dd None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-fa00abf3-da99-4c87-8063-94711b9bf2dd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:05.164364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:05.165283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:05.166154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:05.166154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:05.166154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:05.166154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:05.166154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:05.166154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:05.166154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:05.166154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:05.166154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:17:05.166154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:05.166154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 254/517] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:17:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:05.166713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00abf3-da99-4c87-8063-94711b9bf2dd None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:05.229452 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c141deb-8a47-4077-a088-1f6d180892d7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:05.253623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:05.254263 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:05.262841 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435f11b-35f7-4672-895d-f5503b2c8686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:05.263648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435f11b-35f7-4672-895d-f5503b2c8686 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:05.263906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435f11b-35f7-4672-895d-f5503b2c8686 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:05.263995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00abf3-da99-4c87-8063-94711b9bf2dd None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:05.264185 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435f11b-35f7-4672-895d-f5503b2c8686 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:05.264913 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435f11b-35f7-4672-895d-f5503b2c8686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:05.265227 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435f11b-35f7-4672-895d-f5503b2c8686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:05.266622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435f11b-35f7-4672-895d-f5503b2c8686 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:05.278855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 264/518] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:05.279697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435f11b-35f7-4672-895d-f5503b2c8686 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:05.297434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895b060-1072-49f5-aef4-f3505ff99433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:05.298234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895b060-1072-49f5-aef4-f3505ff99433 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:05.298515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895b060-1072-49f5-aef4-f3505ff99433 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:05.298789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895b060-1072-49f5-aef4-f3505ff99433 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:05.305422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895b060-1072-49f5-aef4-f3505ff99433 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:05.306876 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895b060-1072-49f5-aef4-f3505ff99433 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:05.320949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-9895b060-1072-49f5-aef4-f3505ff99433 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:05.320949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:05.320949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:05.320949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:05.320949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:05.320949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:05.320949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:05.320949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:05.320949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:05.320949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:05.320949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:05.320949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:05.320949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:05.320949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:05.320949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:05.321793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:05.323562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:05.323562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:05.323562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:05.323562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:05.323562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:05.323562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:05.323562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:05.323562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:05.323562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 255/519] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:05.323562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895b060-1072-49f5-aef4-f3505ff99433 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:05.379967 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435f11b-35f7-4672-895d-f5503b2c8686 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:05.419500 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2630379-a07f-4cdb-8862-65a3f5fa15a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:05.420270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2630379-a07f-4cdb-8862-65a3f5fa15a4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:05.420543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2630379-a07f-4cdb-8862-65a3f5fa15a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:05.420817 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2630379-a07f-4cdb-8862-65a3f5fa15a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:05.421607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2630379-a07f-4cdb-8862-65a3f5fa15a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:05.421919 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2630379-a07f-4cdb-8862-65a3f5fa15a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:05.423400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2630379-a07f-4cdb-8862-65a3f5fa15a4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:05.432971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895b060-1072-49f5-aef4-f3505ff99433 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:05.434815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 265/520] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:05.435414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2630379-a07f-4cdb-8862-65a3f5fa15a4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:05.476475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dca527-9791-4091-8d84-9b86e969e6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:05.477366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dca527-9791-4091-8d84-9b86e969e6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:05.477651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dca527-9791-4091-8d84-9b86e969e6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:05.477922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dca527-9791-4091-8d84-9b86e969e6a2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:05.482418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:05.486113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dca527-9791-4091-8d84-9b86e969e6a2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:05.487740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dca527-9791-4091-8d84-9b86e969e6a2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-99dca527-9791-4091-8d84-9b86e969e6a2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:05.502013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:05.503011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:05.503958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:05.503958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:05.503958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:05.503958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:05.503958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:05.503958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:05.503958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:05.503958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:05.503958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:17:05.503958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:05.503958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 256/521] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:05.504511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dca527-9791-4091-8d84-9b86e969e6a2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:05.523539 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:05.539660 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2630379-a07f-4cdb-8862-65a3f5fa15a4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:05.572825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fbc72-272b-47e3-9a6e-ce324519ebc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:05.573495 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fbc72-272b-47e3-9a6e-ce324519ebc8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:05.573777 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fbc72-272b-47e3-9a6e-ce324519ebc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:05.574049 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fbc72-272b-47e3-9a6e-ce324519ebc8 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:05.574894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fbc72-272b-47e3-9a6e-ce324519ebc8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:05.575200 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fbc72-272b-47e3-9a6e-ce324519ebc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:05.576693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fbc72-272b-47e3-9a6e-ce324519ebc8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:05.595908 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 266/522] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 21 08:17:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:05.596905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fbc72-272b-47e3-9a6e-ce324519ebc8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:05.613099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dca527-9791-4091-8d84-9b86e969e6a2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:05.646328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496286b-4c2f-4225-8879-3a84bf94efbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:05.646991 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496286b-4c2f-4225-8879-3a84bf94efbf None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:05.647269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496286b-4c2f-4225-8879-3a84bf94efbf None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:05.647541 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496286b-4c2f-4225-8879-3a84bf94efbf None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:05.648275 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496286b-4c2f-4225-8879-3a84bf94efbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:05.649767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496286b-4c2f-4225-8879-3a84bf94efbf None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:05.670638 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 257/523] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:17:05 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:05.671524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496286b-4c2f-4225-8879-3a84bf94efbf None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:05.709849 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fbc72-272b-47e3-9a6e-ce324519ebc8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:05.713387 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:05.750257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dff07-126b-467f-8d34-17a2ade93812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:05.750643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:05.751422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dff07-126b-467f-8d34-17a2ade93812 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:05.751759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dff07-126b-467f-8d34-17a2ade93812 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:05.752031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dff07-126b-467f-8d34-17a2ade93812 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:05.752930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587dff07-126b-467f-8d34-17a2ade93812 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:05.753269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587dff07-126b-467f-8d34-17a2ade93812 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:05.755105 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587dff07-126b-467f-8d34-17a2ade93812 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:05.778242 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 267/524] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:05.779222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dff07-126b-467f-8d34-17a2ade93812 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:05.800854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496286b-4c2f-4225-8879-3a84bf94efbf None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:05.840308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbbfea-2235-498e-a985-763da778049f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:05.841108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbbfea-2235-498e-a985-763da778049f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:05.841388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbbfea-2235-498e-a985-763da778049f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:05.841662 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbbfea-2235-498e-a985-763da778049f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:05.850122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbbfea-2235-498e-a985-763da778049f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:05.851682 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbbfea-2235-498e-a985-763da778049f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:05.868599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-65dbbfea-2235-498e-a985-763da778049f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:05.868599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:05.868599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:05.868599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:05.868599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:05.868599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:05.868599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:05.868599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:05.868599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:05.868599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:05.868599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:05.868599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:05.868599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:05.868599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:05.868599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:05.869670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:05.870651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:05.870651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:05.870651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:05.870651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:05.870651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:05.870651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:05.870651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:05.870651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:05.870651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 258/525] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:05.870651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbbfea-2235-498e-a985-763da778049f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:05.898553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dff07-126b-467f-8d34-17a2ade93812 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:05.940260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10540867-d288-4b8c-ada2-ec066a66aaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:05.940939 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10540867-d288-4b8c-ada2-ec066a66aaae None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:05.941592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10540867-d288-4b8c-ada2-ec066a66aaae None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:05.941867 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10540867-d288-4b8c-ada2-ec066a66aaae None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:05.942721 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10540867-d288-4b8c-ada2-ec066a66aaae None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:05.943030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10540867-d288-4b8c-ada2-ec066a66aaae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:05.944497 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10540867-d288-4b8c-ada2-ec066a66aaae None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:05.962482 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 268/526] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Jul 21 08:17:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:05.963307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10540867-d288-4b8c-ada2-ec066a66aaae None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:05.980120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbbfea-2235-498e-a985-763da778049f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:05.989793 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:06.010231 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:06.020161 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d195702-ce59-468c-bf5a-5acefb35a942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:06.020824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d195702-ce59-468c-bf5a-5acefb35a942 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:06.021109 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d195702-ce59-468c-bf5a-5acefb35a942 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:06.021385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d195702-ce59-468c-bf5a-5acefb35a942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:06.070998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10540867-d288-4b8c-ada2-ec066a66aaae None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:06.088602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d195702-ce59-468c-bf5a-5acefb35a942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:06.090084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d195702-ce59-468c-bf5a-5acefb35a942 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:06.107966 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed42f7d-3bac-4a1b-9ea9-19c3418e0eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:06.108924 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed42f7d-3bac-4a1b-9ea9-19c3418e0eff None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:06.109388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed42f7d-3bac-4a1b-9ea9-19c3418e0eff None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:06.109832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed42f7d-3bac-4a1b-9ea9-19c3418e0eff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:06.110929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed42f7d-3bac-4a1b-9ea9-19c3418e0eff None admin] RBAC: Adding query filter params (role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=4a57dc68aeb5482a86d5983b466d933d) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:06.111426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed42f7d-3bac-4a1b-9ea9-19c3418e0eff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:06.113298 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed42f7d-3bac-4a1b-9ea9-19c3418e0eff None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:06.128011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 269/527] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:05 2022] GET /identity/v3/role_assignments?user.id=4a57dc68aeb5482a86d5983b466d933d&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:06.129066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed42f7d-3bac-4a1b-9ea9-19c3418e0eff None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:06.203540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 259/528] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:17:06.205115 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d195702-ce59-468c-bf5a-5acefb35a942 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:06.235303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:06.238866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:06.257449 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed42f7d-3bac-4a1b-9ea9-19c3418e0eff None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:06.296299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359441d-8576-4fb0-acc2-ccf3ab04f3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:06.296299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359441d-8576-4fb0-acc2-ccf3ab04f3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:06.296299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359441d-8576-4fb0-acc2-ccf3ab04f3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:06.296698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359441d-8576-4fb0-acc2-ccf3ab04f3f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:06.298115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359441d-8576-4fb0-acc2-ccf3ab04f3f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:06.298706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359441d-8576-4fb0-acc2-ccf3ab04f3f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:06.299938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359441d-8576-4fb0-acc2-ccf3ab04f3f6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:06.315686 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 270/529] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:06.316672 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359441d-8576-4fb0-acc2-ccf3ab04f3f6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:06.325867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d195702-ce59-468c-bf5a-5acefb35a942 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:06.361319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bbd68-60bd-4246-882d-1a376d2cfb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:06.361991 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bbd68-60bd-4246-882d-1a376d2cfb05 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:06.362292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bbd68-60bd-4246-882d-1a376d2cfb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:06.362577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bbd68-60bd-4246-882d-1a376d2cfb05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:06.432579 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359441d-8576-4fb0-acc2-ccf3ab04f3f6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:06.435645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bbd68-60bd-4246-882d-1a376d2cfb05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:06.437179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bbd68-60bd-4246-882d-1a376d2cfb05 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:06.467858 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:06.479296 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da49536-1e15-45c4-852f-ae669032d790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:06.480160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da49536-1e15-45c4-852f-ae669032d790 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:06.480447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da49536-1e15-45c4-852f-ae669032d790 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:06.480725 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da49536-1e15-45c4-852f-ae669032d790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:06.492350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da49536-1e15-45c4-852f-ae669032d790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:06.493961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da49536-1e15-45c4-852f-ae669032d790 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:06.501780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:06.514814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4da49536-1e15-45c4-852f-ae669032d790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:06.514814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:06.514814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:06.514814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:06.514814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:06.514814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:06.514814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:06.514814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:06.514814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:06.514814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:06.514814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:06.514814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:06.514814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:06.514814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:06.514814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:06.515984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:06.517047 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:06.517047 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:06.517047 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:06.517047 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:06.521038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 271/530] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:06.521927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da49536-1e15-45c4-852f-ae669032d790 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:06.552913 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 260/531] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:17:06.554132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bbd68-60bd-4246-882d-1a376d2cfb05 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:06.645369 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da49536-1e15-45c4-852f-ae669032d790 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:06.673535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bbd68-60bd-4246-882d-1a376d2cfb05 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:06.693199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8caa5d-a5ab-4cd3-9d64-cd2bf761bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:06.694762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8caa5d-a5ab-4cd3-9d64-cd2bf761bfda None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:06.695509 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8caa5d-a5ab-4cd3-9d64-cd2bf761bfda None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:06.696274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8caa5d-a5ab-4cd3-9d64-cd2bf761bfda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:06.698146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8caa5d-a5ab-4cd3-9d64-cd2bf761bfda None admin] RBAC: Adding query filter params (role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=131bb5462c8b478783a350d37caa76ae) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:06.699045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8caa5d-a5ab-4cd3-9d64-cd2bf761bfda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:06.701984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8caa5d-a5ab-4cd3-9d64-cd2bf761bfda None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:06.713165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 272/532] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:06 2022] GET /identity/v3/role_assignments?user.id=131bb5462c8b478783a350d37caa76ae&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:06.715119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8caa5d-a5ab-4cd3-9d64-cd2bf761bfda None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:06.718715 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:06.742027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6da75-5348-4ec7-ada7-d82d78e4bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:06.743104 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6da75-5348-4ec7-ada7-d82d78e4bf01 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:06.743633 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6da75-5348-4ec7-ada7-d82d78e4bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:06.744390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6da75-5348-4ec7-ada7-d82d78e4bf01 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:06.745506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6da75-5348-4ec7-ada7-d82d78e4bf01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:06.746058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6da75-5348-4ec7-ada7-d82d78e4bf01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:06.748522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6da75-5348-4ec7-ada7-d82d78e4bf01 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:06.788177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 261/533] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:06.793851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6da75-5348-4ec7-ada7-d82d78e4bf01 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:06.832847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:06.902140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8caa5d-a5ab-4cd3-9d64-cd2bf761bfda None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:06.966260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f54e2c-e8f7-4ef0-8dbd-37568fd2c696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:06.968082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f54e2c-e8f7-4ef0-8dbd-37568fd2c696 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:06.969562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f54e2c-e8f7-4ef0-8dbd-37568fd2c696 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:06.970799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f54e2c-e8f7-4ef0-8dbd-37568fd2c696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:06.994866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f54e2c-e8f7-4ef0-8dbd-37568fd2c696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:06.997880 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f54e2c-e8f7-4ef0-8dbd-37568fd2c696 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:07.035519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f8f54e2c-e8f7-4ef0-8dbd-37568fd2c696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:07.035519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:07.035519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:07.035519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:07.035519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:07.035519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:07.035519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:07.035519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:07.035519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:07.035519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:07.035519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:07.035519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:07.035519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:07.035519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:07.035519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:07.036566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:07.037417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:07.037417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:07.037417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:07.037417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:07.045305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 273/534] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:07.051767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f54e2c-e8f7-4ef0-8dbd-37568fd2c696 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:07.072745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6da75-5348-4ec7-ada7-d82d78e4bf01 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:07.140663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814f7ed-07b4-414f-bb01-7de59d3cd2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:07.141337 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814f7ed-07b4-414f-bb01-7de59d3cd2ae None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:07.141616 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814f7ed-07b4-414f-bb01-7de59d3cd2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:07.142033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814f7ed-07b4-414f-bb01-7de59d3cd2ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:07.157889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814f7ed-07b4-414f-bb01-7de59d3cd2ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:07.159417 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814f7ed-07b4-414f-bb01-7de59d3cd2ae None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:07.170542 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f54e2c-e8f7-4ef0-8dbd-37568fd2c696 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:07.187320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-1814f7ed-07b4-414f-bb01-7de59d3cd2ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:07.187320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:07.187320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:07.187320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:07.187320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:07.187320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:07.187320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:07.187320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:07.187320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:07.187320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:07.187320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:07.187320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:07.187320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:07.187320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:07.187320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:07.188245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:07.189265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:07.189265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:07.189265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:07.189265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:07.189265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:07.189265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:07.189265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:07.189265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:07.189265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 262/535] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:07.200571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814f7ed-07b4-414f-bb01-7de59d3cd2ae None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:07.215974 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:07.261000 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c4512-7aa3-49fa-887c-710e8a7efea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:07.261873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c4512-7aa3-49fa-887c-710e8a7efea6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:07.262163 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c4512-7aa3-49fa-887c-710e8a7efea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:07.262438 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c4512-7aa3-49fa-887c-710e8a7efea6 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:07.263981 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c4512-7aa3-49fa-887c-710e8a7efea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:07.264293 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c4512-7aa3-49fa-887c-710e8a7efea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:07.265724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c4512-7aa3-49fa-887c-710e8a7efea6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:07.270088 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:07.293748 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 274/536] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:07.299220 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c4512-7aa3-49fa-887c-710e8a7efea6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:07.353125 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814f7ed-07b4-414f-bb01-7de59d3cd2ae None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:07.402902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3da133-8fb7-46df-b5a5-26b4556e8f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:07.403686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3da133-8fb7-46df-b5a5-26b4556e8f3b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:07.403906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3da133-8fb7-46df-b5a5-26b4556e8f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:07.404188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3da133-8fb7-46df-b5a5-26b4556e8f3b None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:07.405092 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3da133-8fb7-46df-b5a5-26b4556e8f3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:07.405413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3da133-8fb7-46df-b5a5-26b4556e8f3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:07.407131 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3da133-8fb7-46df-b5a5-26b4556e8f3b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:07.452843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c4512-7aa3-49fa-887c-710e8a7efea6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:07.455682 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 263/537] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:07.467661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3da133-8fb7-46df-b5a5-26b4556e8f3b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:07.505032 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012614f0-ff90-457a-b6ca-dba53154bd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:07.505902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012614f0-ff90-457a-b6ca-dba53154bd55 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:07.506183 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012614f0-ff90-457a-b6ca-dba53154bd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:07.506453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012614f0-ff90-457a-b6ca-dba53154bd55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:07.519223 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012614f0-ff90-457a-b6ca-dba53154bd55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:07.520787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012614f0-ff90-457a-b6ca-dba53154bd55 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:07.549802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-012614f0-ff90-457a-b6ca-dba53154bd55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:07.549802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:07.549802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:07.549802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:07.549802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:07.549802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:07.549802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:07.549802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:07.549802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:07.549802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:07.549802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:07.549802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:07.549802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:07.549802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:07.549802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:07.550907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:07.551795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:07.551795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:07.551795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:07.551795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:07.551795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:07.551795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:07.551795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:07.551795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:07.556499 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 275/538] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:07.557400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012614f0-ff90-457a-b6ca-dba53154bd55 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:07.597775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:07.622464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3da133-8fb7-46df-b5a5-26b4556e8f3b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:07.639623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:07.672380 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012614f0-ff90-457a-b6ca-dba53154bd55 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:07.705179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cebf3-5d91-47bb-8d56-f43f3df2e775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:07.705849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cebf3-5d91-47bb-8d56-f43f3df2e775 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:07.706127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cebf3-5d91-47bb-8d56-f43f3df2e775 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:07.706395 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cebf3-5d91-47bb-8d56-f43f3df2e775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:07.707298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cebf3-5d91-47bb-8d56-f43f3df2e775 None admin] RBAC: Adding query filter params (role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=bd620e5fcb9c4b82865d1d0c508ce8c0) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:07.707651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cebf3-5d91-47bb-8d56-f43f3df2e775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:07.709212 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cebf3-5d91-47bb-8d56-f43f3df2e775 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:07.716875 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 264/539] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:07 2022] GET /identity/v3/role_assignments?user.id=bd620e5fcb9c4b82865d1d0c508ce8c0&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:07.724622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacd051-e575-49ea-bba2-a0152f4d468e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:07.725340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacd051-e575-49ea-bba2-a0152f4d468e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:07.725623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacd051-e575-49ea-bba2-a0152f4d468e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:07.725897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacd051-e575-49ea-bba2-a0152f4d468e None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:07.726720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacd051-e575-49ea-bba2-a0152f4d468e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:07.727028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacd051-e575-49ea-bba2-a0152f4d468e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:07.728568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacd051-e575-49ea-bba2-a0152f4d468e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:07.748087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 276/540] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:07.754342 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cebf3-5d91-47bb-8d56-f43f3df2e775 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:07.896039 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cebf3-5d91-47bb-8d56-f43f3df2e775 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:07.907877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f6d89-ad48-4605-82bf-ec24f460a66c None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:07.908157 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f6d89-ad48-4605-82bf-ec24f460a66c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:07.908429 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f6d89-ad48-4605-82bf-ec24f460a66c None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:07.910151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 277/541] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:17:07.915906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617cf09-e461-4504-aa84-79c421f32a9e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:07.916610 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617cf09-e461-4504-aa84-79c421f32a9e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:07.917090 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617cf09-e461-4504-aa84-79c421f32a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:07.936648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413025f6-0318-44a5-abc4-5b010e2d0717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:07.937228 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413025f6-0318-44a5-abc4-5b010e2d0717 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:07.937519 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413025f6-0318-44a5-abc4-5b010e2d0717 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:07.937632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6617cf09-e461-4504-aa84-79c421f32a9e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:07.937805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413025f6-0318-44a5-abc4-5b010e2d0717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:07.938629 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413025f6-0318-44a5-abc4-5b010e2d0717 None admin] RBAC: Adding query filter params (role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=1d737a8a33da490db5d59ffed92bee60) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:07.938935 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413025f6-0318-44a5-abc4-5b010e2d0717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:07.939614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6617cf09-e461-4504-aa84-79c421f32a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:07.940428 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413025f6-0318-44a5-abc4-5b010e2d0717 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:07.946513 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 265/542] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:07 2022] GET /identity/v3/role_assignments?user.id=1d737a8a33da490db5d59ffed92bee60&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:08.066611 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 278/543] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:17:08.094760 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413025f6-0318-44a5-abc4-5b010e2d0717 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:08.161770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:08.243547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413025f6-0318-44a5-abc4-5b010e2d0717 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:08.290578 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dd2fd-9863-4d3c-aa14-7244c0555485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:08.291479 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dd2fd-9863-4d3c-aa14-7244c0555485 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:08.291803 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dd2fd-9863-4d3c-aa14-7244c0555485 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:08.292079 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dd2fd-9863-4d3c-aa14-7244c0555485 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:08.312542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dd2fd-9863-4d3c-aa14-7244c0555485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-cb7dd2fd-9863-4d3c-aa14-7244c0555485 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:08.320484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:08.321374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:08.322165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:08.322165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:08.322165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:08.322165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:08.322165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:08.322165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:08.322165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:08.322165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:08.322165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:08.322165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:08.322165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:08.322165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:08.322165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 266/544] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:08.329225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617cf09-e461-4504-aa84-79c421f32a9e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:08.366733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:08.460201 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617cf09-e461-4504-aa84-79c421f32a9e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:08.509299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23547c-2d87-4327-af8e-eb4701331f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:08.509960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23547c-2d87-4327-af8e-eb4701331f5f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:08.510238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23547c-2d87-4327-af8e-eb4701331f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:08.510515 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23547c-2d87-4327-af8e-eb4701331f5f None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:08.511302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23547c-2d87-4327-af8e-eb4701331f5f None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:08.511628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23547c-2d87-4327-af8e-eb4701331f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:08.513132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23547c-2d87-4327-af8e-eb4701331f5f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:08.526124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 279/545] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:08.527764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dd2fd-9863-4d3c-aa14-7244c0555485 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:08.541164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84282ec-c43f-4753-bce2-0c536abbacfe None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:08.541488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84282ec-c43f-4753-bce2-0c536abbacfe None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:08.541842 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84282ec-c43f-4753-bce2-0c536abbacfe None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:08.543219 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 280/546] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:17:08.556039 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de8c5-a4f4-489e-8444-429c588b4df6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:08.556324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de8c5-a4f4-489e-8444-429c588b4df6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:08.556598 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de8c5-a4f4-489e-8444-429c588b4df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:08.587620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8d8de8c5-a4f4-489e-8444-429c588b4df6 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:08.589014 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8d8de8c5-a4f4-489e-8444-429c588b4df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:08.678206 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:08.685521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dd2fd-9863-4d3c-aa14-7244c0555485 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:08.714682 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 281/547] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 21 08:17:08.743293 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de8c5-a4f4-489e-8444-429c588b4df6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:08.748919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb274c-f9ea-4d8f-a6f0-4a68ecf3caf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:08.750090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb274c-f9ea-4d8f-a6f0-4a68ecf3caf1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:08.750570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb274c-f9ea-4d8f-a6f0-4a68ecf3caf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:08.751037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb274c-f9ea-4d8f-a6f0-4a68ecf3caf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:08.763151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:08.768720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb274c-f9ea-4d8f-a6f0-4a68ecf3caf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:08.770709 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb274c-f9ea-4d8f-a6f0-4a68ecf3caf1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:08.789993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-7cbb274c-f9ea-4d8f-a6f0-4a68ecf3caf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:08.789993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:08.789993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:08.789993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:08.789993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:08.789993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:08.789993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:08.789993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:08.789993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:08.789993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:08.789993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:08.789993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:08.789993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:08.789993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:08.789993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:08.790884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:08.791734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:08.791734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:08.791734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:08.791734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:08.793957 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 267/548] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:08.799557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb274c-f9ea-4d8f-a6f0-4a68ecf3caf1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:08.905338 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de8c5-a4f4-489e-8444-429c588b4df6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:08.970281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcbcfd-b748-4bc9-8863-5a5709e26049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:08.972439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcbcfd-b748-4bc9-8863-5a5709e26049 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:08.973121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcbcfd-b748-4bc9-8863-5a5709e26049 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:08.974394 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcbcfd-b748-4bc9-8863-5a5709e26049 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:08.982289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb274c-f9ea-4d8f-a6f0-4a68ecf3caf1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:08.998986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcbcfd-b748-4bc9-8863-5a5709e26049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-94bcbcfd-b748-4bc9-8863-5a5709e26049 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:09.007769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:09.008680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:09.010108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:09.010108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:09.010108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:09.010108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:09.010108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:09.010108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:09.010108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:09.010108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:09.010108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:09.010108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:09.010108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:09.010108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:09.018101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 282/549] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:09.019326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcbcfd-b748-4bc9-8863-5a5709e26049 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:09.044414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f2e62-946d-40c4-ac93-0bf5f6972135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:09.045490 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f2e62-946d-40c4-ac93-0bf5f6972135 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:09.045969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f2e62-946d-40c4-ac93-0bf5f6972135 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:09.046456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f2e62-946d-40c4-ac93-0bf5f6972135 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:09.047385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f2e62-946d-40c4-ac93-0bf5f6972135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:09.047948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f2e62-946d-40c4-ac93-0bf5f6972135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:09.049563 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f2e62-946d-40c4-ac93-0bf5f6972135 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:09.070749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 268/550] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:09.078141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f2e62-946d-40c4-ac93-0bf5f6972135 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:09.091655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:09.170889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:09.220823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcbcfd-b748-4bc9-8863-5a5709e26049 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:09.231209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f2e62-946d-40c4-ac93-0bf5f6972135 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:09.266573 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c1290-ee80-4db2-986f-dd6014bd1376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:09.267475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c1290-ee80-4db2-986f-dd6014bd1376 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:09.267790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c1290-ee80-4db2-986f-dd6014bd1376 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:09.268424 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c1290-ee80-4db2-986f-dd6014bd1376 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:09.277116 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c1290-ee80-4db2-986f-dd6014bd1376 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:09.278697 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c1290-ee80-4db2-986f-dd6014bd1376 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:09.285266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb6ab5-361f-49e8-8e61-63e54ebcb885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:09.285958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb6ab5-361f-49e8-8e61-63e54ebcb885 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:09.286241 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb6ab5-361f-49e8-8e61-63e54ebcb885 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:09.286514 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb6ab5-361f-49e8-8e61-63e54ebcb885 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:09.287280 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb6ab5-361f-49e8-8e61-63e54ebcb885 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:09.287586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb6ab5-361f-49e8-8e61-63e54ebcb885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:09.289008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb6ab5-361f-49e8-8e61-63e54ebcb885 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-bd3c1290-ee80-4db2-986f-dd6014bd1376 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:09.293864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:09.295308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:09.296921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:09.296921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:09.296921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:09.296921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:09.296921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:09.296921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:09.296921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:09.296921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:09.296921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:17:09.296921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:09.296921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 269/551] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:17:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:09.296921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437bb7e-b0d0-47be-983c-55d044319eae None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:09.297713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437bb7e-b0d0-47be-983c-55d044319eae None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:09.297713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437bb7e-b0d0-47be-983c-55d044319eae None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:09.300180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 270/552] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:09.300344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 283/553] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:09.301350 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437bb7e-b0d0-47be-983c-55d044319eae None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:09.304592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cea50-2141-4ecb-9ab4-321928a3d3fd None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:09.304883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cea50-2141-4ecb-9ab4-321928a3d3fd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:09.305161 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cea50-2141-4ecb-9ab4-321928a3d3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:09.323783 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3b0cea50-2141-4ecb-9ab4-321928a3d3fd None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:09.325338 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3b0cea50-2141-4ecb-9ab4-321928a3d3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:09.389126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:09.412030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 284/554] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:17:09.413391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cea50-2141-4ecb-9ab4-321928a3d3fd None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:09.430213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437bb7e-b0d0-47be-983c-55d044319eae None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:09.485397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eed39c-08f0-4518-90ea-a0b979f1dca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:09.486410 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eed39c-08f0-4518-90ea-a0b979f1dca4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:09.486835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eed39c-08f0-4518-90ea-a0b979f1dca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:09.487253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eed39c-08f0-4518-90ea-a0b979f1dca4 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:09.488847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eed39c-08f0-4518-90ea-a0b979f1dca4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:09.489608 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eed39c-08f0-4518-90ea-a0b979f1dca4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:09.491989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eed39c-08f0-4518-90ea-a0b979f1dca4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:09.505192 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:09.524308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 271/555] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 21 08:17:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:09.525358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eed39c-08f0-4518-90ea-a0b979f1dca4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:09.551361 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cea50-2141-4ecb-9ab4-321928a3d3fd None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:09.590640 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4eb8a-0fe4-49ab-9154-6a75d6ab133c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:09.592016 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4eb8a-0fe4-49ab-9154-6a75d6ab133c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:09.592469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4eb8a-0fe4-49ab-9154-6a75d6ab133c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:09.592894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4eb8a-0fe4-49ab-9154-6a75d6ab133c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:09.604523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4eb8a-0fe4-49ab-9154-6a75d6ab133c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:09.606508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4eb8a-0fe4-49ab-9154-6a75d6ab133c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:09.628380 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eed39c-08f0-4518-90ea-a0b979f1dca4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:09.632164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-6cd4eb8a-0fe4-49ab-9154-6a75d6ab133c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:09.632164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:09.632164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:09.632164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:09.632164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:09.632164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:09.632164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:09.632164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:09.632164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:09.632164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:09.632164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:09.632164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:09.632164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:09.632164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:09.632164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:09.633199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:09.634199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:09.634199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:09.634199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:09.634199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:09.636870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 285/556] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:09.637900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4eb8a-0fe4-49ab-9154-6a75d6ab133c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:09.665186 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:09.680444 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218afc2-18d9-4535-8949-8b37a52e7af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:09.681548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218afc2-18d9-4535-8949-8b37a52e7af1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:09.681978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218afc2-18d9-4535-8949-8b37a52e7af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:09.682408 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218afc2-18d9-4535-8949-8b37a52e7af1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:09.697090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218afc2-18d9-4535-8949-8b37a52e7af1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-b218afc2-18d9-4535-8949-8b37a52e7af1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:09.713666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:09.714895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:09.716325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:09.716325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:09.716325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:09.716325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:09.716325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:09.716325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:09.716325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:09.716325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:09.716325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:09.716325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:09.716325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:09.716325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:09.719674 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 272/557] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:09.720813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218afc2-18d9-4535-8949-8b37a52e7af1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:09.761552 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4eb8a-0fe4-49ab-9154-6a75d6ab133c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:09.788309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:09.807885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14ac44-4887-4062-a004-0db965315755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:09.809367 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14ac44-4887-4062-a004-0db965315755 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:09.809869 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14ac44-4887-4062-a004-0db965315755 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:09.810583 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14ac44-4887-4062-a004-0db965315755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:09.836969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218afc2-18d9-4535-8949-8b37a52e7af1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:09.881328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962aa52-4335-4fe3-86bc-3e9c1a5f5718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:09.882116 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962aa52-4335-4fe3-86bc-3e9c1a5f5718 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:09.882678 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962aa52-4335-4fe3-86bc-3e9c1a5f5718 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:09.883037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962aa52-4335-4fe3-86bc-3e9c1a5f5718 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:09.884259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962aa52-4335-4fe3-86bc-3e9c1a5f5718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:09.884653 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962aa52-4335-4fe3-86bc-3e9c1a5f5718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:09.886295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962aa52-4335-4fe3-86bc-3e9c1a5f5718 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:09.894929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14ac44-4887-4062-a004-0db965315755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:09.896892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14ac44-4887-4062-a004-0db965315755 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:09.907676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 273/558] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:09.908807 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962aa52-4335-4fe3-86bc-3e9c1a5f5718 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:09.966117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:10.017363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 286/559] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:17:10.018400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14ac44-4887-4062-a004-0db965315755 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:10.026309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962aa52-4335-4fe3-86bc-3e9c1a5f5718 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:10.043369 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:10.071139 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9565409-0ebd-40a7-9585-6cc3655b2ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:10.072425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9565409-0ebd-40a7-9585-6cc3655b2ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:10.072808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9565409-0ebd-40a7-9585-6cc3655b2ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:10.073182 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9565409-0ebd-40a7-9585-6cc3655b2ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:10.074463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9565409-0ebd-40a7-9585-6cc3655b2ac2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:10.075131 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9565409-0ebd-40a7-9585-6cc3655b2ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:10.076894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9565409-0ebd-40a7-9585-6cc3655b2ac2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:10.091709 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 274/560] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:10.092787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9565409-0ebd-40a7-9585-6cc3655b2ac2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:10.143662 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14ac44-4887-4062-a004-0db965315755 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:10.183643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c597e33-14ac-4987-b7ff-f9ac31f7cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:10.184469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c597e33-14ac-4987-b7ff-f9ac31f7cddb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:10.184900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c597e33-14ac-4987-b7ff-f9ac31f7cddb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:10.185174 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c597e33-14ac-4987-b7ff-f9ac31f7cddb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:10.194898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c597e33-14ac-4987-b7ff-f9ac31f7cddb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:10.196816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c597e33-14ac-4987-b7ff-f9ac31f7cddb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:10.199747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9565409-0ebd-40a7-9585-6cc3655b2ac2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:10.206691 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-0c597e33-14ac-4987-b7ff-f9ac31f7cddb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:10.217029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:10.218005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:10.218947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:10.218947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:10.218947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:10.218947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:10.218947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:10.218947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:10.218947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:10.218947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:10.218947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:17:10.218947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:10.223576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 287/561] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:17:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:10.224605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c597e33-14ac-4987-b7ff-f9ac31f7cddb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:10.237407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936bbde-155b-40a3-9d71-4fff9751ce98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:10.238518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936bbde-155b-40a3-9d71-4fff9751ce98 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:10.238897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936bbde-155b-40a3-9d71-4fff9751ce98 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:10.239068 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936bbde-155b-40a3-9d71-4fff9751ce98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:10.250330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936bbde-155b-40a3-9d71-4fff9751ce98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:10.251897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936bbde-155b-40a3-9d71-4fff9751ce98 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:10.269077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-1936bbde-155b-40a3-9d71-4fff9751ce98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:10.269077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:10.269077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:10.269077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:10.269077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:10.269077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:10.269077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:10.269077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:10.269077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:10.269077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:10.269077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:10.269077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:10.269077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:10.269077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:10.269077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:10.270060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:10.270987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:10.270987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:10.270987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:10.270987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:10.270987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 275/562] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:10.272154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccee597-fe9d-48cf-9832-cb75fdc46297 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:10.272269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccee597-fe9d-48cf-9832-cb75fdc46297 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:10.272452 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccee597-fe9d-48cf-9832-cb75fdc46297 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:10.273905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 276/563] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:10.276702 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccee597-fe9d-48cf-9832-cb75fdc46297 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:10.321072 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:10.344846 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c597e33-14ac-4987-b7ff-f9ac31f7cddb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:10.381538 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d6d01-9097-409c-9311-33e4af3e3912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:10.382347 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d6d01-9097-409c-9311-33e4af3e3912 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:10.382629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d6d01-9097-409c-9311-33e4af3e3912 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:10.382903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d6d01-9097-409c-9311-33e4af3e3912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:10.384713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccee597-fe9d-48cf-9832-cb75fdc46297 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:10.394150 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d6d01-9097-409c-9311-33e4af3e3912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:10.396072 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d6d01-9097-409c-9311-33e4af3e3912 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:10.416270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4a1d6d01-9097-409c-9311-33e4af3e3912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:10.416270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:10.416270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:10.416270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:10.416270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:10.416270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:10.416270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:10.416270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:10.416270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:10.416270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:10.416270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:10.416270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:10.416270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:10.416270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:10.416270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:10.417327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:10.418379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:10.418379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:10.418379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:10.418379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:10.418379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 288/564] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:10.418719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d6d01-9097-409c-9311-33e4af3e3912 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:10.426990 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88160196-3028-41be-bd48-c3f5a6553adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:10.427870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88160196-3028-41be-bd48-c3f5a6553adb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:10.428182 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88160196-3028-41be-bd48-c3f5a6553adb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:10.428422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88160196-3028-41be-bd48-c3f5a6553adb None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:10.429314 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88160196-3028-41be-bd48-c3f5a6553adb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:10.429626 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88160196-3028-41be-bd48-c3f5a6553adb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:10.431958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88160196-3028-41be-bd48-c3f5a6553adb None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:10.465277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 277/565] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 21 08:17:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:10.465277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4875f29-3d08-4201-89e7-60dc0b5ef792 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:10.465277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4875f29-3d08-4201-89e7-60dc0b5ef792 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:10.465277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4875f29-3d08-4201-89e7-60dc0b5ef792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:10.478499 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b4875f29-3d08-4201-89e7-60dc0b5ef792 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:10.479776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b4875f29-3d08-4201-89e7-60dc0b5ef792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:10.490386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:10.535013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d6d01-9097-409c-9311-33e4af3e3912 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:10.547604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 278/566] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:10.548520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4875f29-3d08-4201-89e7-60dc0b5ef792 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:10.577858 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:10.583716 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271de8a9-48f1-4205-9e43-2a98f3af354b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:10.584387 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271de8a9-48f1-4205-9e43-2a98f3af354b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:10.584670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271de8a9-48f1-4205-9e43-2a98f3af354b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:10.584943 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271de8a9-48f1-4205-9e43-2a98f3af354b None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:10.585674 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271de8a9-48f1-4205-9e43-2a98f3af354b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:10.585979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271de8a9-48f1-4205-9e43-2a98f3af354b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:10.587380 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271de8a9-48f1-4205-9e43-2a98f3af354b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:10.598971 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 289/567] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:10.600299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acbaab-5b37-486e-a404-23971a196620 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:10.600524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acbaab-5b37-486e-a404-23971a196620 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:10.600797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acbaab-5b37-486e-a404-23971a196620 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:10.602153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 290/568] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:10.602694 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acbaab-5b37-486e-a404-23971a196620 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:10.652680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4875f29-3d08-4201-89e7-60dc0b5ef792 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:10.686232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a15212-e709-41de-8e59-ec891761ede6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:10.686889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a15212-e709-41de-8e59-ec891761ede6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:10.687165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a15212-e709-41de-8e59-ec891761ede6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:10.687454 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a15212-e709-41de-8e59-ec891761ede6 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:10.688204 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a15212-e709-41de-8e59-ec891761ede6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:10.688501 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a15212-e709-41de-8e59-ec891761ede6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:10.689869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a15212-e709-41de-8e59-ec891761ede6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:10.705340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 279/569] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:10.706523 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a15212-e709-41de-8e59-ec891761ede6 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:10.713863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acbaab-5b37-486e-a404-23971a196620 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:10.724372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:10.753125 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b1b31-1084-44f5-aab9-71057892f62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:10.754056 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b1b31-1084-44f5-aab9-71057892f62e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:10.754340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b1b31-1084-44f5-aab9-71057892f62e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:10.754617 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b1b31-1084-44f5-aab9-71057892f62e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:10.765460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b1b31-1084-44f5-aab9-71057892f62e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:10.766973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b1b31-1084-44f5-aab9-71057892f62e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:10.786433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-948b1b31-1084-44f5-aab9-71057892f62e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:10.786433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:10.786433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:10.786433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:10.786433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:10.786433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:10.786433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:10.786433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:10.786433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:10.786433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:10.786433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:10.786433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:10.786433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:10.786433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:10.786433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:10.787534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:10.788648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:10.788648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:10.788648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:10.788648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:10.788648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 291/570] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:10.788648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b1b31-1084-44f5-aab9-71057892f62e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:10.824508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a15212-e709-41de-8e59-ec891761ede6 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:10.834572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:10.858895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf802b-4419-4c10-a6b3-cda8a862f382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:10.859703 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf802b-4419-4c10-a6b3-cda8a862f382 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:10.859984 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf802b-4419-4c10-a6b3-cda8a862f382 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:10.860256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf802b-4419-4c10-a6b3-cda8a862f382 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:10.870645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf802b-4419-4c10-a6b3-cda8a862f382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-96cf802b-4419-4c10-a6b3-cda8a862f382 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:10.878610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:10.879761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:10.880789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:10.880789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:10.880789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:10.880789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:10.880789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:10.880789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:10.880789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:10.880789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:10.880789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:10.880789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:10.880789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:10.880789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:10.880789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 280/571] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:10.881641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894cef2-6dea-4a13-8c26-2f2ca26bbac0 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:10.881641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894cef2-6dea-4a13-8c26-2f2ca26bbac0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:10.881641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894cef2-6dea-4a13-8c26-2f2ca26bbac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:10.893768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b1b31-1084-44f5-aab9-71057892f62e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:10.898127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6894cef2-6dea-4a13-8c26-2f2ca26bbac0 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:10.899313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6894cef2-6dea-4a13-8c26-2f2ca26bbac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:10.928851 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90641a-fe19-4fe2-8a0f-118e09ecb37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:10.929651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90641a-fe19-4fe2-8a0f-118e09ecb37c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:10.929934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90641a-fe19-4fe2-8a0f-118e09ecb37c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:10.930212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90641a-fe19-4fe2-8a0f-118e09ecb37c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:10.936737 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90641a-fe19-4fe2-8a0f-118e09ecb37c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:10.938194 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90641a-fe19-4fe2-8a0f-118e09ecb37c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:10.952935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-fe90641a-fe19-4fe2-8a0f-118e09ecb37c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:10.952935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:10.952935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:10.952935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:10.952935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:10.952935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:10.952935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:10.952935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:10.952935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:10.952935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:10.952935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:10.952935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:10.952935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:10.952935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:10.952935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:10.953818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:10.954707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:10.954707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:10.954707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:10.954707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:10.954707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:10.954707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:10.954707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:10.954707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:10.954707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 292/572] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:10.955384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90641a-fe19-4fe2-8a0f-118e09ecb37c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:10.961339 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:10.970138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 281/573] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:10.971211 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894cef2-6dea-4a13-8c26-2f2ca26bbac0 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:11.074541 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894cef2-6dea-4a13-8c26-2f2ca26bbac0 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:11.074799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90641a-fe19-4fe2-8a0f-118e09ecb37c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:11.077020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:11.108914 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c697b7-3ed3-4ebe-b898-a29d03821873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:11.109502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c697b7-3ed3-4ebe-b898-a29d03821873 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.109795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c697b7-3ed3-4ebe-b898-a29d03821873 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.110065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c697b7-3ed3-4ebe-b898-a29d03821873 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:11.110795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c697b7-3ed3-4ebe-b898-a29d03821873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:11.111097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c697b7-3ed3-4ebe-b898-a29d03821873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:11.112528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c697b7-3ed3-4ebe-b898-a29d03821873 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:11.115412 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a8a0f-b572-4715-b17f-855ab11f7414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:11.116301 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a8a0f-b572-4715-b17f-855ab11f7414 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.116652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a8a0f-b572-4715-b17f-855ab11f7414 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.116935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a8a0f-b572-4715-b17f-855ab11f7414 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:11.124009 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a8a0f-b572-4715-b17f-855ab11f7414 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:11.124135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 282/574] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:11.124841 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c697b7-3ed3-4ebe-b898-a29d03821873 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:11.125451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a8a0f-b572-4715-b17f-855ab11f7414 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-455a8a0f-b572-4715-b17f-855ab11f7414 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:11.140744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:11.141717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:11.142811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:11.142811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:11.142811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:11.142811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:11.142811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:11.142811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:11.142811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:11.142811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:11.142811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:17:11.142811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:11.142811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 293/575] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 08:17:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:11.143526 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a8a0f-b572-4715-b17f-855ab11f7414 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:11.182381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:11.226808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c697b7-3ed3-4ebe-b898-a29d03821873 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:11.244109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a8a0f-b572-4715-b17f-855ab11f7414 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:11.259935 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26529bb1-9bee-43ce-b9e0-5864113e9d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:11.260596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26529bb1-9bee-43ce-b9e0-5864113e9d9a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.260875 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26529bb1-9bee-43ce-b9e0-5864113e9d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.261134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26529bb1-9bee-43ce-b9e0-5864113e9d9a None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:11.261879 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26529bb1-9bee-43ce-b9e0-5864113e9d9a None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:11.262181 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26529bb1-9bee-43ce-b9e0-5864113e9d9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:11.263560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26529bb1-9bee-43ce-b9e0-5864113e9d9a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:11.271446 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 283/576] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:11.272277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26529bb1-9bee-43ce-b9e0-5864113e9d9a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:11.282163 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1cfa8-bc34-4ba3-b4ba-ba4fb9b8172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:11.282833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1cfa8-bc34-4ba3-b4ba-ba4fb9b8172b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.283117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1cfa8-bc34-4ba3-b4ba-ba4fb9b8172b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.283394 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1cfa8-bc34-4ba3-b4ba-ba4fb9b8172b None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:11.284236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1cfa8-bc34-4ba3-b4ba-ba4fb9b8172b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:11.284580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1cfa8-bc34-4ba3-b4ba-ba4fb9b8172b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:11.286221 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1cfa8-bc34-4ba3-b4ba-ba4fb9b8172b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:11.298204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 294/577] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:11.299053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1cfa8-bc34-4ba3-b4ba-ba4fb9b8172b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:11.327074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:11.372217 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26529bb1-9bee-43ce-b9e0-5864113e9d9a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:11.388210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:11.399282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1cfa8-bc34-4ba3-b4ba-ba4fb9b8172b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:11.406514 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3add0c-26b5-4c15-b9d5-7b1655a6d671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:11.407405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3add0c-26b5-4c15-b9d5-7b1655a6d671 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.407723 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3add0c-26b5-4c15-b9d5-7b1655a6d671 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.407996 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3add0c-26b5-4c15-b9d5-7b1655a6d671 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:11.418884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3add0c-26b5-4c15-b9d5-7b1655a6d671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ac3add0c-26b5-4c15-b9d5-7b1655a6d671 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:11.426728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:11.427680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:11.428524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:11.428524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:11.428524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:11.428524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:11.428524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:11.428524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:11.428524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:11.428524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:11.428524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:11.428524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:11.428524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:11.428524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:11.428524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 284/578] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:11.429219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3add0c-26b5-4c15-b9d5-7b1655a6d671 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:11.439209 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f55ad3-5f15-466b-ba53-bde74be5fe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:11.440054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f55ad3-5f15-466b-ba53-bde74be5fe2b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.440342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f55ad3-5f15-466b-ba53-bde74be5fe2b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.440646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f55ad3-5f15-466b-ba53-bde74be5fe2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:11.448959 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f55ad3-5f15-466b-ba53-bde74be5fe2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:11.449344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f55ad3-5f15-466b-ba53-bde74be5fe2b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:11.463790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-96f55ad3-5f15-466b-ba53-bde74be5fe2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:11.463790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:11.463790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:11.463790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:11.463790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:11.463790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:11.463790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:11.463790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:11.463790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:11.463790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:11.463790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:11.463790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:11.463790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:11.463790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:11.463790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:11.464658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:11.465558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:11.465558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:11.465558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:11.465558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:11.465558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:11.465558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:11.465558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:11.465558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:11.465558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 295/579] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:11.466048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f55ad3-5f15-466b-ba53-bde74be5fe2b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:11.529853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3add0c-26b5-4c15-b9d5-7b1655a6d671 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:11.551635 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:11.564135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3d000-2931-40b6-b6c2-6df9a71227a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:11.564806 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3d000-2931-40b6-b6c2-6df9a71227a1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.565085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3d000-2931-40b6-b6c2-6df9a71227a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.565361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3d000-2931-40b6-b6c2-6df9a71227a1 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:11.566286 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3d000-2931-40b6-b6c2-6df9a71227a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:11.566592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3d000-2931-40b6-b6c2-6df9a71227a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:11.567275 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f55ad3-5f15-466b-ba53-bde74be5fe2b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:11.568064 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3d000-2931-40b6-b6c2-6df9a71227a1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:11.585084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 285/580] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 08:17:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:11.585860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3d000-2931-40b6-b6c2-6df9a71227a1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:11.601754 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebb6b9-45c2-47eb-9786-c89a05407155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:11.602559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebb6b9-45c2-47eb-9786-c89a05407155 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.602888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebb6b9-45c2-47eb-9786-c89a05407155 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.603110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebb6b9-45c2-47eb-9786-c89a05407155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:11.613259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebb6b9-45c2-47eb-9786-c89a05407155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:11.614813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebb6b9-45c2-47eb-9786-c89a05407155 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:11.620341 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:11.633622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e6ebb6b9-45c2-47eb-9786-c89a05407155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:11.633622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:11.633622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:11.633622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:11.633622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:11.633622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:11.633622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:11.633622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:11.633622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:11.633622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:11.633622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:11.633622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:11.633622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:11.633622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:11.633622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:11.634506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:11.635392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:11.635392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:11.635392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:11.635392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:11.635392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 296/581] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:11.635705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebb6b9-45c2-47eb-9786-c89a05407155 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:11.688908 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3d000-2931-40b6-b6c2-6df9a71227a1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:11.721916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deff01e-07b1-41d2-868d-82a9ecccef2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:11.722660 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deff01e-07b1-41d2-868d-82a9ecccef2f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.722936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deff01e-07b1-41d2-868d-82a9ecccef2f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.723210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deff01e-07b1-41d2-868d-82a9ecccef2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:11.724145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deff01e-07b1-41d2-868d-82a9ecccef2f None admin] RBAC: Adding query filter params (role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=a8d7cfd6610a4df095daea14ecc37b21) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:11.724450 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deff01e-07b1-41d2-868d-82a9ecccef2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:11.725901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deff01e-07b1-41d2-868d-82a9ecccef2f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:11.731239 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 286/582] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:11 2022] GET /identity/v3/role_assignments?user.id=a8d7cfd6610a4df095daea14ecc37b21&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:11.732030 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deff01e-07b1-41d2-868d-82a9ecccef2f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:11.750037 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebb6b9-45c2-47eb-9786-c89a05407155 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:11.788092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4b688-085b-4368-b1f3-56c09fd027a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:11.788770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b688-085b-4368-b1f3-56c09fd027a5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.789059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b688-085b-4368-b1f3-56c09fd027a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.789336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b688-085b-4368-b1f3-56c09fd027a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:11.790091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4b688-085b-4368-b1f3-56c09fd027a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:11.790395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4b688-085b-4368-b1f3-56c09fd027a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:11.791875 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4b688-085b-4368-b1f3-56c09fd027a5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:11.794488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:11.807064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 297/583] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:11.807064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4b688-085b-4368-b1f3-56c09fd027a5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:11.852307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:11.858319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deff01e-07b1-41d2-868d-82a9ecccef2f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:11.911753 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16f667-8ca0-480b-8e23-092dae87732f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:11.912533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16f667-8ca0-480b-8e23-092dae87732f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.913000 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16f667-8ca0-480b-8e23-092dae87732f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.913424 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16f667-8ca0-480b-8e23-092dae87732f None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:11.914722 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16f667-8ca0-480b-8e23-092dae87732f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:11.915234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16f667-8ca0-480b-8e23-092dae87732f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:11.917797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16f667-8ca0-480b-8e23-092dae87732f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:11.936657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 287/584] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:11.937714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16f667-8ca0-480b-8e23-092dae87732f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:11.950572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4b688-085b-4368-b1f3-56c09fd027a5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:11.986566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5b646-c0a8-4489-8867-6b95a391365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:11.987431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5b646-c0a8-4489-8867-6b95a391365c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.987908 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5b646-c0a8-4489-8867-6b95a391365c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.988225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5b646-c0a8-4489-8867-6b95a391365c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:12.000820 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5b646-c0a8-4489-8867-6b95a391365c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:12.002399 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5b646-c0a8-4489-8867-6b95a391365c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:12.020979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ccb5b646-c0a8-4489-8867-6b95a391365c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:12.020979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:12.020979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:12.020979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:12.020979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:12.020979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:12.020979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:12.020979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:12.020979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:12.020979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:12.020979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:12.020979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:12.020979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:12.020979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:12.020979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:12.021895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:12.022768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:12.022768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:12.022768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:12.022768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:12.027148 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 298/585] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:12.027902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5b646-c0a8-4489-8867-6b95a391365c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:12.052885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16f667-8ca0-480b-8e23-092dae87732f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:12.080335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:12.089920 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42388e5-de12-498a-aeb7-d4e965408cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:12.090587 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42388e5-de12-498a-aeb7-d4e965408cfb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:12.090867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42388e5-de12-498a-aeb7-d4e965408cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:12.091129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42388e5-de12-498a-aeb7-d4e965408cfb None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:12.091899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42388e5-de12-498a-aeb7-d4e965408cfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:12.092191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42388e5-de12-498a-aeb7-d4e965408cfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:12.093590 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42388e5-de12-498a-aeb7-d4e965408cfb None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:12.110280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 288/586] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:12.110280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42388e5-de12-498a-aeb7-d4e965408cfb None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:12.131047 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:12.142897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5b646-c0a8-4489-8867-6b95a391365c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:12.185629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99013069-b0b8-419b-a499-c31fcdb6f352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:12.186357 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99013069-b0b8-419b-a499-c31fcdb6f352 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:12.187646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99013069-b0b8-419b-a499-c31fcdb6f352 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:12.187646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99013069-b0b8-419b-a499-c31fcdb6f352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:12.198240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99013069-b0b8-419b-a499-c31fcdb6f352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:12.199738 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99013069-b0b8-419b-a499-c31fcdb6f352 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:12.217576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-99013069-b0b8-419b-a499-c31fcdb6f352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:12.217576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:12.217576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:12.217576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:12.217576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:12.217576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:12.217576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:12.217576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:12.217576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:12.217576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:12.217576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:12.217576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:12.217576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:12.217576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:12.217576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:12.218494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:12.219347 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:12.219347 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:12.219347 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:12.219347 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:12.219347 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 299/587] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:12.219700 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99013069-b0b8-419b-a499-c31fcdb6f352 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:12.225826 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42388e5-de12-498a-aeb7-d4e965408cfb None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:12.261968 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c1c8a-5b09-490d-9e2b-fca5b0282bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:12.262984 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c1c8a-5b09-490d-9e2b-fca5b0282bd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:12.263265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c1c8a-5b09-490d-9e2b-fca5b0282bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:12.263539 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c1c8a-5b09-490d-9e2b-fca5b0282bd0 None admin] PATH_INFO: `/v3/projects/784795960efb40e5811f778fff6fceb1/users/4a57dc68aeb5482a86d5983b466d933d/roles/d6d1bb4d1d4d43f6985c2b90e85ca6a6` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:12.279908 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c1c8a-5b09-490d-9e2b-fca5b0282bd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=784795960efb40e5811f778fff6fceb1, user_id=4a57dc68aeb5482a86d5983b466d933d, role_id=d6d1bb4d1d4d43f6985c2b90e85ca6a6)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:12.281357 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c1c8a-5b09-490d-9e2b-fca5b0282bd0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:12.299648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 289/588] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:17:12 2022] PUT /identity/v3/projects/784795960efb40e5811f778fff6fceb1/users/4a57dc68aeb5482a86d5983b466d933d/roles/d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:17:12.299648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c1c8a-5b09-490d-9e2b-fca5b0282bd0 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:12.333769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99013069-b0b8-419b-a499-c31fcdb6f352 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:12.336311 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:12.374214 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a96073-de41-4426-a603-fcc66d175736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:12.375199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a96073-de41-4426-a603-fcc66d175736 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:12.375677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a96073-de41-4426-a603-fcc66d175736 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:12.375958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a96073-de41-4426-a603-fcc66d175736 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:12.376719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a96073-de41-4426-a603-fcc66d175736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:12.377040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a96073-de41-4426-a603-fcc66d175736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:12.378821 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a96073-de41-4426-a603-fcc66d175736 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:12.392387 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 300/589] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:12.393375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a96073-de41-4426-a603-fcc66d175736 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:12.414912 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:12.471277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c1c8a-5b09-490d-9e2b-fca5b0282bd0 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:12.519118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b7ad9-97c3-4170-a852-ba9e70df986d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:12.520166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b7ad9-97c3-4170-a852-ba9e70df986d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:12.520973 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b7ad9-97c3-4170-a852-ba9e70df986d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:12.520973 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b7ad9-97c3-4170-a852-ba9e70df986d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:12.529061 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a96073-de41-4426-a603-fcc66d175736 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:12.530108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b7ad9-97c3-4170-a852-ba9e70df986d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:12.531640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b7ad9-97c3-4170-a852-ba9e70df986d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-af1b7ad9-97c3-4170-a852-ba9e70df986d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:12.546849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:12.547869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:12.548804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:12.548804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:12.548804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:12.548804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:12.548804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:12.548804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:12.548804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:12.548804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:12.548804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:17:12.548804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:12.548804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 290/590] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:17:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:12.549863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b7ad9-97c3-4170-a852-ba9e70df986d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:12.582516 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020cf72-08cc-449d-861c-a390cd9ec342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:12.583624 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020cf72-08cc-449d-861c-a390cd9ec342 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:12.584112 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020cf72-08cc-449d-861c-a390cd9ec342 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:12.584609 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020cf72-08cc-449d-861c-a390cd9ec342 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:12.585540 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020cf72-08cc-449d-861c-a390cd9ec342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:12.586044 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020cf72-08cc-449d-861c-a390cd9ec342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:12.587683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020cf72-08cc-449d-861c-a390cd9ec342 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:12.600450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 301/591] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:12.601578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020cf72-08cc-449d-861c-a390cd9ec342 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:12.627757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:12.682038 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b7ad9-97c3-4170-a852-ba9e70df986d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:12.712295 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020cf72-08cc-449d-861c-a390cd9ec342 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:12.726593 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:12.733794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34f056-301b-4a19-b8c8-67a67744881d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:12.735228 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34f056-301b-4a19-b8c8-67a67744881d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:12.735912 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34f056-301b-4a19-b8c8-67a67744881d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:12.736180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34f056-301b-4a19-b8c8-67a67744881d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:12.745340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34f056-301b-4a19-b8c8-67a67744881d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:12.747508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34f056-301b-4a19-b8c8-67a67744881d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:12.758889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2c634-6acf-480a-a660-06424d016e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:12.759881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2c634-6acf-480a-a660-06424d016e05 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:12.760383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2c634-6acf-480a-a660-06424d016e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:12.760857 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2c634-6acf-480a-a660-06424d016e05 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:12.761909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2c634-6acf-480a-a660-06424d016e05 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:12.762439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2c634-6acf-480a-a660-06424d016e05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:12.763471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-9f34f056-301b-4a19-b8c8-67a67744881d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:12.763471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:12.763471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:12.763471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:12.763471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:12.763471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:12.763471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:12.763471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:12.763471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:12.763471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:12.763471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:12.763471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:12.763471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:12.763471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:12.763471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:12.764333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:12.765212 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:12.765212 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:12.765212 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:12.765212 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:12.765212 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:12.765212 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:12.765212 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:12.765212 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:12.765212 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 291/592] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:12.766156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34f056-301b-4a19-b8c8-67a67744881d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:12.767088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2c634-6acf-480a-a660-06424d016e05 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:12.790184 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 302/593] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 21 08:17:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:12.791383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2c634-6acf-480a-a660-06424d016e05 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:12.887730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:12.902493 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34f056-301b-4a19-b8c8-67a67744881d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:12.909404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2c634-6acf-480a-a660-06424d016e05 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:12.939049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e73c5-ceaa-4cc8-bc27-9fb50e8d108d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:12.940150 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e73c5-ceaa-4cc8-bc27-9fb50e8d108d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:12.940535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e73c5-ceaa-4cc8-bc27-9fb50e8d108d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:12.941091 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e73c5-ceaa-4cc8-bc27-9fb50e8d108d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:12.946815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b32b7-f528-47b4-aa8d-a67a17677f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:12.947810 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b32b7-f528-47b4-aa8d-a67a17677f1c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:12.948255 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b32b7-f528-47b4-aa8d-a67a17677f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:12.948666 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b32b7-f528-47b4-aa8d-a67a17677f1c None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:12.949671 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b32b7-f528-47b4-aa8d-a67a17677f1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:12.949958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e73c5-ceaa-4cc8-bc27-9fb50e8d108d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:12.950362 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b32b7-f528-47b4-aa8d-a67a17677f1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:12.951705 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e73c5-ceaa-4cc8-bc27-9fb50e8d108d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:12.952338 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b32b7-f528-47b4-aa8d-a67a17677f1c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:12.965656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 303/594] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:12.966673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b32b7-f528-47b4-aa8d-a67a17677f1c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-fb4e73c5-ceaa-4cc8-bc27-9fb50e8d108d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:12.967809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:12.968938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:12.970041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:12.970041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:12.970041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:12.970041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:12.970041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:12.970041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:12.970041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:12.970041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:12.970041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:17:12.970041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:12.971888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 292/595] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:12.972774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e73c5-ceaa-4cc8-bc27-9fb50e8d108d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:13.044120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:13.078209 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b32b7-f528-47b4-aa8d-a67a17677f1c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:13.089510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e73c5-ceaa-4cc8-bc27-9fb50e8d108d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:13.122281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fa032-9afb-4ef2-9d96-9d17aa86e27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:13.123389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fa032-9afb-4ef2-9d96-9d17aa86e27a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:13.123892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fa032-9afb-4ef2-9d96-9d17aa86e27a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:13.124429 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fa032-9afb-4ef2-9d96-9d17aa86e27a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:13.128328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8396b1d-1485-41ee-8e3f-2e917fecf1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:13.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8396b1d-1485-41ee-8e3f-2e917fecf1a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:13.129645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8396b1d-1485-41ee-8e3f-2e917fecf1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:13.129983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8396b1d-1485-41ee-8e3f-2e917fecf1a5 None admin] PATH_INFO: `/v3/projects/784795960efb40e5811f778fff6fceb1/users/131bb5462c8b478783a350d37caa76ae/roles/d6d1bb4d1d4d43f6985c2b90e85ca6a6` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:13.135504 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:13.138119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fa032-9afb-4ef2-9d96-9d17aa86e27a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:13.140066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fa032-9afb-4ef2-9d96-9d17aa86e27a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:13.149313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8396b1d-1485-41ee-8e3f-2e917fecf1a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=784795960efb40e5811f778fff6fceb1, user_id=131bb5462c8b478783a350d37caa76ae, role_id=d6d1bb4d1d4d43f6985c2b90e85ca6a6)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:13.151833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8396b1d-1485-41ee-8e3f-2e917fecf1a5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:13.160955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-5a7fa032-9afb-4ef2-9d96-9d17aa86e27a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:13.160955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:13.160955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:13.160955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:13.160955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:13.160955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:13.160955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:13.160955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:13.160955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:13.160955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:13.160955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:13.160955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:13.160955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:13.160955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:13.160955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:13.161847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:13.162761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:13.162761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:13.162761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:13.162761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:13.169468 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 304/596] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:13.170380 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 293/597] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:17:12 2022] PUT /identity/v3/projects/784795960efb40e5811f778fff6fceb1/users/131bb5462c8b478783a350d37caa76ae/roles/d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:17:13.170800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fa032-9afb-4ef2-9d96-9d17aa86e27a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:13.171738 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8396b1d-1485-41ee-8e3f-2e917fecf1a5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:13.357304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fa032-9afb-4ef2-9d96-9d17aa86e27a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:13.361021 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:13.368761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8396b1d-1485-41ee-8e3f-2e917fecf1a5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:13.409264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab526ab9-3fcb-4594-b470-fd2c74e7e88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:13.410209 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526ab9-3fcb-4594-b470-fd2c74e7e88f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:13.410567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526ab9-3fcb-4594-b470-fd2c74e7e88f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:13.410851 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526ab9-3fcb-4594-b470-fd2c74e7e88f None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:13.411730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab526ab9-3fcb-4594-b470-fd2c74e7e88f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:13.412040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab526ab9-3fcb-4594-b470-fd2c74e7e88f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:13.412296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c0480-8191-4f44-b2de-e5343cb4f171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:13.413177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c0480-8191-4f44-b2de-e5343cb4f171 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:13.413543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab526ab9-3fcb-4594-b470-fd2c74e7e88f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:13.413858 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c0480-8191-4f44-b2de-e5343cb4f171 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:13.414319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c0480-8191-4f44-b2de-e5343cb4f171 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:13.415355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c0480-8191-4f44-b2de-e5343cb4f171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:13.416453 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c0480-8191-4f44-b2de-e5343cb4f171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:13.418088 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c0480-8191-4f44-b2de-e5343cb4f171 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:13.431443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 294/598] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:13.438655 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 305/599] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Jul 21 08:17:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:13.440125 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c0480-8191-4f44-b2de-e5343cb4f171 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:13.444520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab526ab9-3fcb-4594-b470-fd2c74e7e88f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:13.527981 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:13.561990 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c0480-8191-4f44-b2de-e5343cb4f171 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:13.604901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd566ce2-b330-4294-9461-50911c92d81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:13.605796 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd566ce2-b330-4294-9461-50911c92d81e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:13.606332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd566ce2-b330-4294-9461-50911c92d81e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:13.606675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd566ce2-b330-4294-9461-50911c92d81e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:13.610506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab526ab9-3fcb-4594-b470-fd2c74e7e88f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:13.615991 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd566ce2-b330-4294-9461-50911c92d81e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:13.618338 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd566ce2-b330-4294-9461-50911c92d81e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:13.634409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-dd566ce2-b330-4294-9461-50911c92d81e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:13.634409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:13.634409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:13.634409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:13.634409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:13.634409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:13.634409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:13.634409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:13.634409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:13.634409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:13.634409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:13.634409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:13.634409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:13.634409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:13.634409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:13.635686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:13.636813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:13.636813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:13.636813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:13.636813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:13.636813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:13.636813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:13.636813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:13.636813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:13.640247 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 295/600] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:13.643113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd566ce2-b330-4294-9461-50911c92d81e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:13.682434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:13.685234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b2aab-0d27-4859-839d-27bba37d6440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:13.686088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b2aab-0d27-4859-839d-27bba37d6440 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:13.686366 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b2aab-0d27-4859-839d-27bba37d6440 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:13.686635 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b2aab-0d27-4859-839d-27bba37d6440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:13.704752 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b2aab-0d27-4859-839d-27bba37d6440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:13.709298 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b2aab-0d27-4859-839d-27bba37d6440 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:13.746246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9f5b2aab-0d27-4859-839d-27bba37d6440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:13.746246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:13.746246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:13.746246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:13.746246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:13.746246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:13.746246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:13.746246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:13.746246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:13.746246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:13.746246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:13.746246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:13.746246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:13.746246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:13.746246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:13.747188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:13.748118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:13.748118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:13.748118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:13.748118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:13.748787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 306/601] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:13.756577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b2aab-0d27-4859-839d-27bba37d6440 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:13.790350 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd566ce2-b330-4294-9461-50911c92d81e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:13.826973 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac698c8-5394-4ac0-99ac-425773b8497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:13.827917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac698c8-5394-4ac0-99ac-425773b8497d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:13.828338 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac698c8-5394-4ac0-99ac-425773b8497d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:13.828752 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac698c8-5394-4ac0-99ac-425773b8497d None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:13.829709 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac698c8-5394-4ac0-99ac-425773b8497d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:13.830171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac698c8-5394-4ac0-99ac-425773b8497d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:13.832188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac698c8-5394-4ac0-99ac-425773b8497d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:13.846652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 296/602] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:13.854263 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac698c8-5394-4ac0-99ac-425773b8497d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:13.966218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b2aab-0d27-4859-839d-27bba37d6440 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:13.969647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:13.991959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:14.012272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac698c8-5394-4ac0-99ac-425773b8497d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:14.027151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525de389-0a4d-4264-8acf-3fde9d8168a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:14.028034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525de389-0a4d-4264-8acf-3fde9d8168a6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.028406 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525de389-0a4d-4264-8acf-3fde9d8168a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.028778 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525de389-0a4d-4264-8acf-3fde9d8168a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.029589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525de389-0a4d-4264-8acf-3fde9d8168a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:14.029956 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525de389-0a4d-4264-8acf-3fde9d8168a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:14.031400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525de389-0a4d-4264-8acf-3fde9d8168a6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:14.044544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 307/603] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:14.046037 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a238095-912d-4e4b-8d90-5b6e0f9e2a5d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.046384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a238095-912d-4e4b-8d90-5b6e0f9e2a5d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.046726 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a238095-912d-4e4b-8d90-5b6e0f9e2a5d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.048301 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 308/604] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:14.050849 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a238095-912d-4e4b-8d90-5b6e0f9e2a5d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:14.060243 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5157b6-fcd5-4785-9afd-b9be91d527d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:14.061648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5157b6-fcd5-4785-9afd-b9be91d527d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.061931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5157b6-fcd5-4785-9afd-b9be91d527d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.062210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5157b6-fcd5-4785-9afd-b9be91d527d2 None admin] PATH_INFO: `/v3/projects/784795960efb40e5811f778fff6fceb1/users/bd620e5fcb9c4b82865d1d0c508ce8c0/roles/d6d1bb4d1d4d43f6985c2b90e85ca6a6` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.083033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5157b6-fcd5-4785-9afd-b9be91d527d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=784795960efb40e5811f778fff6fceb1, user_id=bd620e5fcb9c4b82865d1d0c508ce8c0, role_id=d6d1bb4d1d4d43f6985c2b90e85ca6a6)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:14.084729 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5157b6-fcd5-4785-9afd-b9be91d527d2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:14.103736 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 297/605] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:17:13 2022] PUT /identity/v3/projects/784795960efb40e5811f778fff6fceb1/users/bd620e5fcb9c4b82865d1d0c508ce8c0/roles/d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:17:14.105124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ed7cc-daa9-41a6-88db-95c75462c012 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.105418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ed7cc-daa9-41a6-88db-95c75462c012 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.105699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ed7cc-daa9-41a6-88db-95c75462c012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.126411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8d8ed7cc-daa9-41a6-88db-95c75462c012 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:14.127823 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8d8ed7cc-daa9-41a6-88db-95c75462c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:14.217935 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 298/606] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:14.224623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a238095-912d-4e4b-8d90-5b6e0f9e2a5d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:14.245124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ed7cc-daa9-41a6-88db-95c75462c012 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:14.324599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbf64d-f50a-48da-97cf-f51d67ea999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:14.325548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbf64d-f50a-48da-97cf-f51d67ea999a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.325873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbf64d-f50a-48da-97cf-f51d67ea999a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.326155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbf64d-f50a-48da-97cf-f51d67ea999a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.327990 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:14.342214 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbf64d-f50a-48da-97cf-f51d67ea999a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:14.344727 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbf64d-f50a-48da-97cf-f51d67ea999a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:14.362288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-5acbf64d-f50a-48da-97cf-f51d67ea999a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:14.362288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:14.362288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:14.362288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:14.362288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:14.362288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:14.362288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:14.362288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:14.362288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:14.362288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:14.362288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:14.362288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:14.362288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:14.362288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:14.362288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:14.365069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:14.366205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:14.366205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:14.366205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:14.366205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:14.366205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:14.366205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:14.366205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:14.366205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:14.366205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 309/607] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:14.370377 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ed7cc-daa9-41a6-88db-95c75462c012 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:14.372846 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbf64d-f50a-48da-97cf-f51d67ea999a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:14.400363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:14.411956 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d127a25-feac-46de-816b-d4ede1ab7dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:14.412800 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d127a25-feac-46de-816b-d4ede1ab7dbd None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.413093 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d127a25-feac-46de-816b-d4ede1ab7dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.413481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d127a25-feac-46de-816b-d4ede1ab7dbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.425265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d127a25-feac-46de-816b-d4ede1ab7dbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-1d127a25-feac-46de-816b-d4ede1ab7dbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:14.434264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:14.435219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:14.436187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:14.436187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:14.436187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:14.436187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:14.436187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:14.436187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:14.436187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:14.436187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:14.436187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:14.436187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:14.436187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:14.436187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:14.438835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 299/608] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:14.444878 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d127a25-feac-46de-816b-d4ede1ab7dbd None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:14.501872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbf64d-f50a-48da-97cf-f51d67ea999a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:14.559308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba199bc2-0956-4d38-9eff-c69df6f421ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:14.559308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba199bc2-0956-4d38-9eff-c69df6f421ca None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.559308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba199bc2-0956-4d38-9eff-c69df6f421ca None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.559308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba199bc2-0956-4d38-9eff-c69df6f421ca None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.559777 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba199bc2-0956-4d38-9eff-c69df6f421ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:14.559777 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba199bc2-0956-4d38-9eff-c69df6f421ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:14.559777 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba199bc2-0956-4d38-9eff-c69df6f421ca None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:14.573346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 310/609] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:14.580081 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba199bc2-0956-4d38-9eff-c69df6f421ca None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:14.585245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d127a25-feac-46de-816b-d4ede1ab7dbd None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:14.635485 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:14.669198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad7c64-3aa4-4909-a4e1-6202b3c0227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:14.669970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad7c64-3aa4-4909-a4e1-6202b3c0227b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.670255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad7c64-3aa4-4909-a4e1-6202b3c0227b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.670583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad7c64-3aa4-4909-a4e1-6202b3c0227b None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.671358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad7c64-3aa4-4909-a4e1-6202b3c0227b None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:14.671686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad7c64-3aa4-4909-a4e1-6202b3c0227b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:14.673093 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad7c64-3aa4-4909-a4e1-6202b3c0227b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:14.694102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 300/610] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:14.701134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad7c64-3aa4-4909-a4e1-6202b3c0227b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:14.732514 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:14.756177 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba199bc2-0956-4d38-9eff-c69df6f421ca None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:14.799615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105266f-b480-442d-91e8-1527e0ac0ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:14.801713 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105266f-b480-442d-91e8-1527e0ac0ec0 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.802074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105266f-b480-442d-91e8-1527e0ac0ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.802422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105266f-b480-442d-91e8-1527e0ac0ec0 None admin] PATH_INFO: `/v3/projects/784795960efb40e5811f778fff6fceb1/users/1d737a8a33da490db5d59ffed92bee60/roles/d6d1bb4d1d4d43f6985c2b90e85ca6a6` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.821600 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105266f-b480-442d-91e8-1527e0ac0ec0 None admin] RBAC: Authorizing `identity:create_grant(project_id=784795960efb40e5811f778fff6fceb1, user_id=1d737a8a33da490db5d59ffed92bee60, role_id=d6d1bb4d1d4d43f6985c2b90e85ca6a6)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:14.823683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105266f-b480-442d-91e8-1527e0ac0ec0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:14.832475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad7c64-3aa4-4909-a4e1-6202b3c0227b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:14.845800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 311/611] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:17:14 2022] PUT /identity/v3/projects/784795960efb40e5811f778fff6fceb1/users/1d737a8a33da490db5d59ffed92bee60/roles/d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:17:14.847306 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7452af-1495-43ef-a847-fc8c4eb2b0bd None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.847614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7452af-1495-43ef-a847-fc8c4eb2b0bd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.847898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7452af-1495-43ef-a847-fc8c4eb2b0bd None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.850855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 312/612] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:14.859745 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e279c-5157-41f1-8665-32f7d8016c0d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.859745 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e279c-5157-41f1-8665-32f7d8016c0d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.859745 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e279c-5157-41f1-8665-32f7d8016c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.894326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-746e279c-5157-41f1-8665-32f7d8016c0d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:14.895554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-746e279c-5157-41f1-8665-32f7d8016c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:14.904466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88801c30-2138-467e-b07a-224d082c9e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:14.905457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88801c30-2138-467e-b07a-224d082c9e4a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.905737 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88801c30-2138-467e-b07a-224d082c9e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.906012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88801c30-2138-467e-b07a-224d082c9e4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.928277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88801c30-2138-467e-b07a-224d082c9e4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:14.930748 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88801c30-2138-467e-b07a-224d082c9e4a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:14.960655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-88801c30-2138-467e-b07a-224d082c9e4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:14.960655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:14.960655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:14.960655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:14.960655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:14.960655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:14.960655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:14.960655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:14.960655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:14.960655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:14.960655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:14.960655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:14.960655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:14.960655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:14.960655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:14.961600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:14.962473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:14.962473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:14.962473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:14.962473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:14.963180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 301/613] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:14.972762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88801c30-2138-467e-b07a-224d082c9e4a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:15.016944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:15.051726 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 313/614] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:15.074371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e279c-5157-41f1-8665-32f7d8016c0d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:15.097534 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88801c30-2138-467e-b07a-224d082c9e4a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:15.141306 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfdef4-f084-44d3-85ff-79a3da558f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:15.142790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfdef4-f084-44d3-85ff-79a3da558f00 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:15.143074 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfdef4-f084-44d3-85ff-79a3da558f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:15.143351 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfdef4-f084-44d3-85ff-79a3da558f00 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:15.144411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfdef4-f084-44d3-85ff-79a3da558f00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:15.144852 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfdef4-f084-44d3-85ff-79a3da558f00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:15.147457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfdef4-f084-44d3-85ff-79a3da558f00 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:15.178559 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 302/615] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:15.182858 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfdef4-f084-44d3-85ff-79a3da558f00 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:15.209398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:15.288247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e279c-5157-41f1-8665-32f7d8016c0d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:15.300397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:15.315453 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfdef4-f084-44d3-85ff-79a3da558f00 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:15.349559 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90bc7e-886c-43db-91a1-d4e2dc5de024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:15.350381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90bc7e-886c-43db-91a1-d4e2dc5de024 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:15.350666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90bc7e-886c-43db-91a1-d4e2dc5de024 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:15.351047 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90bc7e-886c-43db-91a1-d4e2dc5de024 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:15.365732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90bc7e-886c-43db-91a1-d4e2dc5de024 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:15.367191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90bc7e-886c-43db-91a1-d4e2dc5de024 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:15.370762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba50b47-e980-40f7-83e4-c81c5a4a6d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:15.371583 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50b47-e980-40f7-83e4-c81c5a4a6d3f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:15.371883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50b47-e980-40f7-83e4-c81c5a4a6d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:15.372156 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50b47-e980-40f7-83e4-c81c5a4a6d3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-cc90bc7e-886c-43db-91a1-d4e2dc5de024 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:15.391352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:15.392354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:15.393267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:15.393267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:15.393267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:15.393267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:15.393267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:15.393267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:15.393267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:15.393267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:15.393267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:17:15.393267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:15.397960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba50b47-e980-40f7-83e4-c81c5a4a6d3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4ba50b47-e980-40f7-83e4-c81c5a4a6d3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:15.406179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:15.408259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:15.410634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:15.410634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:15.410634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:15.410634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:15.410634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:15.410634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:15.410634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:15.410634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:15.410634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:15.410634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:15.410634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:15.410634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:15.412138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 303/616] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:17:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:15.412138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90bc7e-886c-43db-91a1-d4e2dc5de024 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:15.412407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 314/617] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:15.418780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba50b47-e980-40f7-83e4-c81c5a4a6d3f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:15.589593 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90bc7e-886c-43db-91a1-d4e2dc5de024 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:15.601655 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba50b47-e980-40f7-83e4-c81c5a4a6d3f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:15.628202 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:15.634091 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2b167-716f-44ee-9147-3131e425701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:15.634780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2b167-716f-44ee-9147-3131e425701c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:15.635062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2b167-716f-44ee-9147-3131e425701c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:15.635336 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2b167-716f-44ee-9147-3131e425701c None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:15.636215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2b167-716f-44ee-9147-3131e425701c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:15.636524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2b167-716f-44ee-9147-3131e425701c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:15.637983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2b167-716f-44ee-9147-3131e425701c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:15.642970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48b011-bbf7-407f-b3c8-849e69964d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:15.644169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48b011-bbf7-407f-b3c8-849e69964d33 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:15.644634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48b011-bbf7-407f-b3c8-849e69964d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:15.645284 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48b011-bbf7-407f-b3c8-849e69964d33 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:15.646250 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48b011-bbf7-407f-b3c8-849e69964d33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:15.646735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48b011-bbf7-407f-b3c8-849e69964d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:15.648677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48b011-bbf7-407f-b3c8-849e69964d33 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:15.663765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 304/618] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 21 08:17:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:15.663765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04abea5-20e2-4ee7-adfb-2c603cd47d41 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:15.663765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04abea5-20e2-4ee7-adfb-2c603cd47d41 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:15.663765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04abea5-20e2-4ee7-adfb-2c603cd47d41 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:15.663765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 305/619] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:15.664263 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04abea5-20e2-4ee7-adfb-2c603cd47d41 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:15.664830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 315/620] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:15.670647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48b011-bbf7-407f-b3c8-849e69964d33 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:15.684533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:15.780461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04abea5-20e2-4ee7-adfb-2c603cd47d41 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:15.789685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48b011-bbf7-407f-b3c8-849e69964d33 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:15.823546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f1c5-4945-4882-bc48-6fe008ba745a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:15.824387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f1c5-4945-4882-bc48-6fe008ba745a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:15.824682 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f1c5-4945-4882-bc48-6fe008ba745a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:15.824977 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f1c5-4945-4882-bc48-6fe008ba745a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:15.830876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93567b-c51d-4db8-8879-7ab3d9e08fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:15.832162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93567b-c51d-4db8-8879-7ab3d9e08fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:15.832628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93567b-c51d-4db8-8879-7ab3d9e08fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:15.833088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93567b-c51d-4db8-8879-7ab3d9e08fd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:15.835400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62f1c5-4945-4882-bc48-6fe008ba745a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:15.836899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62f1c5-4945-4882-bc48-6fe008ba745a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:15.845308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93567b-c51d-4db8-8879-7ab3d9e08fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:15.847082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93567b-c51d-4db8-8879-7ab3d9e08fd0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:15.854785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-6d62f1c5-4945-4882-bc48-6fe008ba745a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:15.854785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:15.854785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:15.854785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:15.854785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:15.854785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:15.854785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:15.854785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:15.854785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:15.854785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:15.854785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:15.854785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:15.854785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:15.854785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:15.854785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:15.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:15.856644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:15.856644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:15.856644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:15.856644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:15.860796 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 306/621] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:15.862110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3193d33-8f0b-4bfa-bc4e-1667523d6541 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:15.862396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3193d33-8f0b-4bfa-bc4e-1667523d6541 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:15.862768 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3193d33-8f0b-4bfa-bc4e-1667523d6541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:15.869398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-be93567b-c51d-4db8-8879-7ab3d9e08fd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:15.869398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:15.869398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:15.869398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:15.869398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:15.869398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:15.869398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:15.869398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:15.869398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:15.869398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:15.869398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:15.869398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:15.869398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:15.869398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:15.869398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:15.870312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:15.871204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:15.871204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:15.871204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:15.871204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:15.873152 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 316/622] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:15.874073 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93567b-c51d-4db8-8879-7ab3d9e08fd0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:15.886582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a3193d33-8f0b-4bfa-bc4e-1667523d6541 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:15.889811 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a3193d33-8f0b-4bfa-bc4e-1667523d6541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:15.915259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:15.954001 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:15.967646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 307/623] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:15.967646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3193d33-8f0b-4bfa-bc4e-1667523d6541 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:16.021007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93567b-c51d-4db8-8879-7ab3d9e08fd0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:16.056960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79953302-8649-416c-9231-c6bab2011365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:16.057992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79953302-8649-416c-9231-c6bab2011365 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:16.058501 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79953302-8649-416c-9231-c6bab2011365 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:16.059011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79953302-8649-416c-9231-c6bab2011365 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:16.060129 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79953302-8649-416c-9231-c6bab2011365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:16.060647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79953302-8649-416c-9231-c6bab2011365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:16.062395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79953302-8649-416c-9231-c6bab2011365 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:16.071714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3193d33-8f0b-4bfa-bc4e-1667523d6541 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:16.077531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 317/624] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:16.078779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79953302-8649-416c-9231-c6bab2011365 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:16.114742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb783ef9-073d-4371-ae42-3d5cfd8eb9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:16.115311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb783ef9-073d-4371-ae42-3d5cfd8eb9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:16.115591 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb783ef9-073d-4371-ae42-3d5cfd8eb9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:16.115892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb783ef9-073d-4371-ae42-3d5cfd8eb9e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:16.117210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb783ef9-073d-4371-ae42-3d5cfd8eb9e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:16.117210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb783ef9-073d-4371-ae42-3d5cfd8eb9e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:16.118284 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb783ef9-073d-4371-ae42-3d5cfd8eb9e5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:16.135742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 308/625] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:16.136682 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb783ef9-073d-4371-ae42-3d5cfd8eb9e5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:16.186265 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79953302-8649-416c-9231-c6bab2011365 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:16.194695 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:16.211963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:16.226153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa7035-147a-4895-b84a-9b5cdc50b0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:16.227675 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa7035-147a-4895-b84a-9b5cdc50b0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:16.228201 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa7035-147a-4895-b84a-9b5cdc50b0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:16.228667 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa7035-147a-4895-b84a-9b5cdc50b0d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:16.241644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb783ef9-073d-4371-ae42-3d5cfd8eb9e5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:16.243360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa7035-147a-4895-b84a-9b5cdc50b0d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-7efa7035-147a-4895-b84a-9b5cdc50b0d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:16.258124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:16.259096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:16.259996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:16.259996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:16.259996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:16.259996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:16.259996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:16.259996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:16.259996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:16.259996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:16.259996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:16.259996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:16.259996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:16.259996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:16.266033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 318/626] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:16.266033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa7035-147a-4895-b84a-9b5cdc50b0d9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:16.292351 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24b428-ea16-4391-a537-33471149bb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:16.294218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24b428-ea16-4391-a537-33471149bb15 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:16.294804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24b428-ea16-4391-a537-33471149bb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:16.295322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24b428-ea16-4391-a537-33471149bb15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:16.305309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24b428-ea16-4391-a537-33471149bb15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:16.308051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24b428-ea16-4391-a537-33471149bb15 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:16.326636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-5f24b428-ea16-4391-a537-33471149bb15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:16.326636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:16.326636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:16.326636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:16.326636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:16.326636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:16.326636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:16.326636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:16.326636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:16.326636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:16.326636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:16.326636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:16.326636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:16.326636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:16.326636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:16.327661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:16.328580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:16.328580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:16.328580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:16.328580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:16.328580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:16.328580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:16.328580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:16.328580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:16.331671 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 309/627] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:16.332898 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24b428-ea16-4391-a537-33471149bb15 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:16.383414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa7035-147a-4895-b84a-9b5cdc50b0d9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:16.420607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09926679-4bd0-4afb-8b3f-520a5c324d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:16.421543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09926679-4bd0-4afb-8b3f-520a5c324d96 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:16.421828 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09926679-4bd0-4afb-8b3f-520a5c324d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:16.422134 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09926679-4bd0-4afb-8b3f-520a5c324d96 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:16.430855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09926679-4bd0-4afb-8b3f-520a5c324d96 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:16.432677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09926679-4bd0-4afb-8b3f-520a5c324d96 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:16.441336 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24b428-ea16-4391-a537-33471149bb15 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:16.456473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-09926679-4bd0-4afb-8b3f-520a5c324d96 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:16.457720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:16.458701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:16.459656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:16.459656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:16.459656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:16.459656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:16.459656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:16.459656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:16.459656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:16.459656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:16.459656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:17:16.459656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:16.465798 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 319/628] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:17:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:16.465798 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09926679-4bd0-4afb-8b3f-520a5c324d96 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:16.490765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e1727-de3d-4792-aca3-8b39a354d92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:16.492075 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:16.492525 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e1727-de3d-4792-aca3-8b39a354d92d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:16.493919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e1727-de3d-4792-aca3-8b39a354d92d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:16.494474 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e1727-de3d-4792-aca3-8b39a354d92d None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:16.495453 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e1727-de3d-4792-aca3-8b39a354d92d None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:16.495978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e1727-de3d-4792-aca3-8b39a354d92d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:16.499112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e1727-de3d-4792-aca3-8b39a354d92d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:16.511588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 310/629] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:16.512737 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e1727-de3d-4792-aca3-8b39a354d92d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:16.605261 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09926679-4bd0-4afb-8b3f-520a5c324d96 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:16.641759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e1727-de3d-4792-aca3-8b39a354d92d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:16.647305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c54bd-9d3f-460e-beca-0c74c2cc7a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:16.648005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c54bd-9d3f-460e-beca-0c74c2cc7a0b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:16.648287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c54bd-9d3f-460e-beca-0c74c2cc7a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:16.648559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c54bd-9d3f-460e-beca-0c74c2cc7a0b None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:16.649361 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c54bd-9d3f-460e-beca-0c74c2cc7a0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:16.649667 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c54bd-9d3f-460e-beca-0c74c2cc7a0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:16.651426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c54bd-9d3f-460e-beca-0c74c2cc7a0b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:16.667874 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 320/630] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:16.667874 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c54bd-9d3f-460e-beca-0c74c2cc7a0b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:16.684752 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55757fa3-de0c-4516-9bb7-df5dc6e48e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:16.685435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55757fa3-de0c-4516-9bb7-df5dc6e48e7c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:16.685717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55757fa3-de0c-4516-9bb7-df5dc6e48e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:16.685989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55757fa3-de0c-4516-9bb7-df5dc6e48e7c None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:16.686829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55757fa3-de0c-4516-9bb7-df5dc6e48e7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:16.687139 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55757fa3-de0c-4516-9bb7-df5dc6e48e7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:16.688603 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55757fa3-de0c-4516-9bb7-df5dc6e48e7c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:16.707815 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 311/631] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 21 08:17:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:16.713431 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50b53f-5492-41ea-a1fd-6439f88037d4 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:16.713782 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50b53f-5492-41ea-a1fd-6439f88037d4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:16.714126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50b53f-5492-41ea-a1fd-6439f88037d4 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:16.715537 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 312/632] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:16.716299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50b53f-5492-41ea-a1fd-6439f88037d4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:16.752460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:16.768335 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:16.780798 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c54bd-9d3f-460e-beca-0c74c2cc7a0b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:16.817653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3d99c-c463-405b-8944-744fe67a1cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:16.818472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3d99c-c463-405b-8944-744fe67a1cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:16.818741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3d99c-c463-405b-8944-744fe67a1cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:16.819014 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3d99c-c463-405b-8944-744fe67a1cf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:16.830562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3d99c-c463-405b-8944-744fe67a1cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:16.832288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3d99c-c463-405b-8944-744fe67a1cf2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:16.841743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50b53f-5492-41ea-a1fd-6439f88037d4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:16.851439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-faa3d99c-c463-405b-8944-744fe67a1cf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:16.851439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:16.851439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:16.851439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:16.851439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:16.851439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:16.851439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:16.851439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:16.851439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:16.851439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:16.851439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:16.851439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:16.851439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:16.851439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:16.851439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:16.852389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:16.853257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:16.853257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:16.853257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:16.853257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:16.853257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 321/633] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:16.853538 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3d99c-c463-405b-8944-744fe67a1cf2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:16.886070 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c509d-1dbe-4db8-a469-b94075a67841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:16.886981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c509d-1dbe-4db8-a469-b94075a67841 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:16.887272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c509d-1dbe-4db8-a469-b94075a67841 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:16.887568 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c509d-1dbe-4db8-a469-b94075a67841 None admin] PATH_INFO: `/v3/projects/784795960efb40e5811f778fff6fceb1/users/a8d7cfd6610a4df095daea14ecc37b21/roles/d6d1bb4d1d4d43f6985c2b90e85ca6a6` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:16.903801 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c509d-1dbe-4db8-a469-b94075a67841 None admin] RBAC: Authorizing `identity:create_grant(project_id=784795960efb40e5811f778fff6fceb1, user_id=a8d7cfd6610a4df095daea14ecc37b21, role_id=d6d1bb4d1d4d43f6985c2b90e85ca6a6)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:16.905419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c509d-1dbe-4db8-a469-b94075a67841 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:16.927640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 313/634] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:17:16 2022] PUT /identity/v3/projects/784795960efb40e5811f778fff6fceb1/users/a8d7cfd6610a4df095daea14ecc37b21/roles/d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:17:16.927640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe0312-0ea1-4f08-9121-cff889d7f825 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:16.927640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe0312-0ea1-4f08-9121-cff889d7f825 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:16.927640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe0312-0ea1-4f08-9121-cff889d7f825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:16.945252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8abe0312-0ea1-4f08-9121-cff889d7f825 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:16.946776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8abe0312-0ea1-4f08-9121-cff889d7f825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:16.977181 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3d99c-c463-405b-8944-744fe67a1cf2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:17.018982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:17.030879 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce5a14-a4f9-44a0-bd19-6088aefff111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:17.031552 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce5a14-a4f9-44a0-bd19-6088aefff111 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:17.031860 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce5a14-a4f9-44a0-bd19-6088aefff111 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:17.032136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce5a14-a4f9-44a0-bd19-6088aefff111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:17.039832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 314/635] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:17.039832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe0312-0ea1-4f08-9121-cff889d7f825 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:17.060627 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:17.112778 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce5a14-a4f9-44a0-bd19-6088aefff111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:17.114669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce5a14-a4f9-44a0-bd19-6088aefff111 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:17.160851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe0312-0ea1-4f08-9121-cff889d7f825 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:17.197460 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ed7d9-d410-4af2-8e80-94a26f0dfacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:17.198124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ed7d9-d410-4af2-8e80-94a26f0dfacd None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:17.198402 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ed7d9-d410-4af2-8e80-94a26f0dfacd None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:17.198682 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ed7d9-d410-4af2-8e80-94a26f0dfacd None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:17.199418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ed7d9-d410-4af2-8e80-94a26f0dfacd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:17.199758 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ed7d9-d410-4af2-8e80-94a26f0dfacd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:17.201158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ed7d9-d410-4af2-8e80-94a26f0dfacd None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:17.212910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 315/636] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:17.214194 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db6d56-d469-4c76-8a14-15b4e3a2b7fa None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:17.214481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db6d56-d469-4c76-8a14-15b4e3a2b7fa None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:17.214807 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db6d56-d469-4c76-8a14-15b4e3a2b7fa None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:17.220060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 316/637] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:17.220060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db6d56-d469-4c76-8a14-15b4e3a2b7fa None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:17.225432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 322/638] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:17:17.226281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce5a14-a4f9-44a0-bd19-6088aefff111 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:17.256454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:17.304800 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:17.335008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce5a14-a4f9-44a0-bd19-6088aefff111 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:17.335333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db6d56-d469-4c76-8a14-15b4e3a2b7fa None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:17.373375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff355e-3d23-4220-bf43-53db887c61ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:17.374559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff355e-3d23-4220-bf43-53db887c61ba None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:17.374890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198793d-4e8a-4e5c-b437-fc79f2f1acfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:17.375160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff355e-3d23-4220-bf43-53db887c61ba None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:17.375578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff355e-3d23-4220-bf43-53db887c61ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:17.375797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198793d-4e8a-4e5c-b437-fc79f2f1acfd None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:17.376091 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198793d-4e8a-4e5c-b437-fc79f2f1acfd None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:17.376391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198793d-4e8a-4e5c-b437-fc79f2f1acfd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:17.384335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff355e-3d23-4220-bf43-53db887c61ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:17.385799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff355e-3d23-4220-bf43-53db887c61ba None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:17.387883 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198793d-4e8a-4e5c-b437-fc79f2f1acfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-5198793d-4e8a-4e5c-b437-fc79f2f1acfd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:17.396504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:17.397577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:17.404244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:17.404244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:17.404244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:17.404244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:17.404244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:17.404244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:17.404244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:17.404244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:17.404244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:17.404244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:17.404244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:17.404244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:17.404244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 317/639] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:17.404244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913552d-4912-4c1a-999f-54ff34d2779d None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:17.405031 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913552d-4912-4c1a-999f-54ff34d2779d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:17.405031 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913552d-4912-4c1a-999f-54ff34d2779d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-cfff355e-3d23-4220-bf43-53db887c61ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:17.405160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:17.406015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:17.406938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:17.406938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:17.406938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:17.406938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:17.406938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:17.406938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:17.406938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:17.406938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:17.406938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:17:17.406938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:17.406938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 323/640] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 08:17:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:17.406938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff355e-3d23-4220-bf43-53db887c61ba None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:17.422613 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-5913552d-4912-4c1a-999f-54ff34d2779d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:17.423774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5913552d-4912-4c1a-999f-54ff34d2779d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:17.501033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 318/641] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:17.502434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913552d-4912-4c1a-999f-54ff34d2779d None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:17.508933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:17.523822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff355e-3d23-4220-bf43-53db887c61ba None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:17.559555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc409ee-bfa0-48be-8f89-7a2cb0abd651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:17.560701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc409ee-bfa0-48be-8f89-7a2cb0abd651 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:17.561131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc409ee-bfa0-48be-8f89-7a2cb0abd651 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:17.561554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc409ee-bfa0-48be-8f89-7a2cb0abd651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:17.572950 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc409ee-bfa0-48be-8f89-7a2cb0abd651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:17.574321 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:17.574449 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc409ee-bfa0-48be-8f89-7a2cb0abd651 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:17.593599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-cfc409ee-bfa0-48be-8f89-7a2cb0abd651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:17.593599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:17.593599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:17.593599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:17.593599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:17.593599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:17.593599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:17.593599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:17.593599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:17.593599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:17.593599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:17.593599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:17.593599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:17.593599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:17.593599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:17.594628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:17.595521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:17.595521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:17.595521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:17.595521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:17.595521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 324/642] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:17.596458 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc409ee-bfa0-48be-8f89-7a2cb0abd651 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:17.620800 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913552d-4912-4c1a-999f-54ff34d2779d None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:17.657574 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3435c66-5389-4fc1-a44d-6f455aa40f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:17.658962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3435c66-5389-4fc1-a44d-6f455aa40f40 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:17.659281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3435c66-5389-4fc1-a44d-6f455aa40f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:17.659615 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3435c66-5389-4fc1-a44d-6f455aa40f40 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:17.660878 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3435c66-5389-4fc1-a44d-6f455aa40f40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:17.661196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3435c66-5389-4fc1-a44d-6f455aa40f40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:17.662659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3435c66-5389-4fc1-a44d-6f455aa40f40 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:17.685132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 319/643] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 08:17:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:17.685966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3435c66-5389-4fc1-a44d-6f455aa40f40 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:17.705892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc409ee-bfa0-48be-8f89-7a2cb0abd651 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:17.742308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd120fd4-cce4-4913-9db3-2f97c1f2fa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:17.743412 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd120fd4-cce4-4913-9db3-2f97c1f2fa87 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:17.744014 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd120fd4-cce4-4913-9db3-2f97c1f2fa87 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:17.744524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd120fd4-cce4-4913-9db3-2f97c1f2fa87 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:17.745423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd120fd4-cce4-4913-9db3-2f97c1f2fa87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:17.745728 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd120fd4-cce4-4913-9db3-2f97c1f2fa87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:17.747406 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd120fd4-cce4-4913-9db3-2f97c1f2fa87 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:17.756205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 325/644] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:17.761427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd120fd4-cce4-4913-9db3-2f97c1f2fa87 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:17.764151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:17.795160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3435c66-5389-4fc1-a44d-6f455aa40f40 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:17.827261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:17.840810 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f0791-6a37-4992-ab94-374ae11436c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:17.841622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f0791-6a37-4992-ab94-374ae11436c2 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:17.841903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f0791-6a37-4992-ab94-374ae11436c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:17.842175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f0791-6a37-4992-ab94-374ae11436c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:17.852953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f0791-6a37-4992-ab94-374ae11436c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-494f0791-6a37-4992-ab94-374ae11436c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:17.860740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:17.861763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:17.862934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:17.862934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:17.862934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:17.862934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:17.862934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:17.862934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:17.862934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:17.862934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:17.862934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:17.862934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:17.862934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:17.862934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:17.862934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 320/645] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:17.864363 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f0791-6a37-4992-ab94-374ae11436c2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:17.874234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd120fd4-cce4-4913-9db3-2f97c1f2fa87 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:17.912142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b1505-3be1-406c-a95f-02312259400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:17.912890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b1505-3be1-406c-a95f-02312259400b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:17.913187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b1505-3be1-406c-a95f-02312259400b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:17.913491 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b1505-3be1-406c-a95f-02312259400b None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:17.914210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b1505-3be1-406c-a95f-02312259400b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:17.914519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b1505-3be1-406c-a95f-02312259400b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:17.916068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b1505-3be1-406c-a95f-02312259400b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:17.933330 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 326/646] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:17.933330 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b1505-3be1-406c-a95f-02312259400b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:17.980548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f0791-6a37-4992-ab94-374ae11436c2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:17.996222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:18.018173 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce670d-2878-4b5a-93d1-8875384134d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:18.018899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce670d-2878-4b5a-93d1-8875384134d9 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:18.019184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce670d-2878-4b5a-93d1-8875384134d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:18.019466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce670d-2878-4b5a-93d1-8875384134d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:18.037153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b1505-3be1-406c-a95f-02312259400b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:18.073820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:18.074186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e2619-73ba-487e-9e9d-f00eb73b498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:18.074917 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e2619-73ba-487e-9e9d-f00eb73b498b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:18.075244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e2619-73ba-487e-9e9d-f00eb73b498b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:18.075517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e2619-73ba-487e-9e9d-f00eb73b498b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:18.086760 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e2619-73ba-487e-9e9d-f00eb73b498b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:18.088266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e2619-73ba-487e-9e9d-f00eb73b498b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:18.094158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce670d-2878-4b5a-93d1-8875384134d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:18.095692 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce670d-2878-4b5a-93d1-8875384134d9 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:18.106153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-2a5e2619-73ba-487e-9e9d-f00eb73b498b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:18.106153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:18.106153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:18.106153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:18.106153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:18.106153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:18.106153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:18.106153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:18.106153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:18.106153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:18.106153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:18.106153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:18.106153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:18.106153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:18.106153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:18.107098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:18.108031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:18.108031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:18.108031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:18.108031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:18.112178 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 327/647] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:18.112939 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e2619-73ba-487e-9e9d-f00eb73b498b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:18.208889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 321/648] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:17:18.209750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce670d-2878-4b5a-93d1-8875384134d9 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:18.221963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e2619-73ba-487e-9e9d-f00eb73b498b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:18.238165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:18.259437 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fafdde-ec0e-44b2-a416-ca08a349dd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:18.259922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fafdde-ec0e-44b2-a416-ca08a349dd79 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:18.260208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fafdde-ec0e-44b2-a416-ca08a349dd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:18.260485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fafdde-ec0e-44b2-a416-ca08a349dd79 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:18.261249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fafdde-ec0e-44b2-a416-ca08a349dd79 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:18.261558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fafdde-ec0e-44b2-a416-ca08a349dd79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:18.262943 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fafdde-ec0e-44b2-a416-ca08a349dd79 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:18.271918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 328/649] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:18.272975 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fafdde-ec0e-44b2-a416-ca08a349dd79 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:18.305482 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:18.324559 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce670d-2878-4b5a-93d1-8875384134d9 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:18.358510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f9bfc-1e4a-4594-8a13-f14e00255218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:18.359313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f9bfc-1e4a-4594-8a13-f14e00255218 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:18.359641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f9bfc-1e4a-4594-8a13-f14e00255218 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:18.359888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f9bfc-1e4a-4594-8a13-f14e00255218 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:18.366578 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f9bfc-1e4a-4594-8a13-f14e00255218 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:18.368054 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f9bfc-1e4a-4594-8a13-f14e00255218 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:18.381179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fafdde-ec0e-44b2-a416-ca08a349dd79 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:18.381644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-e67f9bfc-1e4a-4594-8a13-f14e00255218 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:18.381644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:18.381644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:18.381644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:18.381644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:18.381644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:18.381644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:18.381644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:18.381644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:18.381644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:18.381644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:18.381644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:18.381644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:18.381644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:18.381644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:18.382498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:18.383372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:18.383372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:18.383372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:18.383372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:18.383372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:18.383372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:18.383372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:18.383372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:18.383372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 322/650] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:18.383909 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f9bfc-1e4a-4594-8a13-f14e00255218 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:18.424138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ad293-0c66-43e0-9b86-48312705e484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:18.425661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ad293-0c66-43e0-9b86-48312705e484 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:18.426118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ad293-0c66-43e0-9b86-48312705e484 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:18.426541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ad293-0c66-43e0-9b86-48312705e484 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:18.427618 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ad293-0c66-43e0-9b86-48312705e484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:18.428080 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ad293-0c66-43e0-9b86-48312705e484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:18.429834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ad293-0c66-43e0-9b86-48312705e484 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:18.444366 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 329/651] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:18.445535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ad293-0c66-43e0-9b86-48312705e484 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:18.485465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:18.503963 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f9bfc-1e4a-4594-8a13-f14e00255218 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:18.540092 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04190a4-3526-4314-9f85-911de380a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:18.540894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04190a4-3526-4314-9f85-911de380a429 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:18.541189 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04190a4-3526-4314-9f85-911de380a429 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:18.541455 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04190a4-3526-4314-9f85-911de380a429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:18.552915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04190a4-3526-4314-9f85-911de380a429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:18.554393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04190a4-3526-4314-9f85-911de380a429 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:18.556359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:18.569292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ad293-0c66-43e0-9b86-48312705e484 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:18.573012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-e04190a4-3526-4314-9f85-911de380a429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:18.573012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:18.573012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:18.573012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:18.573012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:18.573012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:18.573012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:18.573012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:18.573012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:18.573012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:18.573012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:18.573012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:18.573012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:18.573012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:18.573012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:18.573869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:18.574872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:18.574872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:18.574872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:18.574872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:18.574872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 323/652] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:18.575162 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04190a4-3526-4314-9f85-911de380a429 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:18.610298 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033c13f-2613-4d0a-890d-00cc80628949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:18.611867 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033c13f-2613-4d0a-890d-00cc80628949 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:18.612408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033c13f-2613-4d0a-890d-00cc80628949 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:18.612938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033c13f-2613-4d0a-890d-00cc80628949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:18.624479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033c13f-2613-4d0a-890d-00cc80628949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:18.626047 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033c13f-2613-4d0a-890d-00cc80628949 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:18.646267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-2033c13f-2613-4d0a-890d-00cc80628949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:18.646267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:18.646267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:18.646267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:18.646267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:18.646267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:18.646267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:18.646267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:18.646267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:18.646267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:18.646267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:18.646267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:18.646267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:18.646267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:18.646267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:18.647247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:18.648911 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:18.648911 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:18.648911 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:18.648911 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:18.648911 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 330/653] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:18.648911 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033c13f-2613-4d0a-890d-00cc80628949 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:18.692573 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04190a4-3526-4314-9f85-911de380a429 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:18.729903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bace832-1015-4e7e-99ab-632981be5403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:18.730587 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bace832-1015-4e7e-99ab-632981be5403 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:18.730866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bace832-1015-4e7e-99ab-632981be5403 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:18.731138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bace832-1015-4e7e-99ab-632981be5403 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:18.731988 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bace832-1015-4e7e-99ab-632981be5403 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:18.732296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bace832-1015-4e7e-99ab-632981be5403 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:18.733767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bace832-1015-4e7e-99ab-632981be5403 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:18.743383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:18.752087 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 324/654] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:18.752087 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bace832-1015-4e7e-99ab-632981be5403 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:18.765206 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033c13f-2613-4d0a-890d-00cc80628949 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:18.802921 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aeda8-fa6b-4c86-a990-f6249a0d07c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:18.803762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aeda8-fa6b-4c86-a990-f6249a0d07c3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:18.804048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aeda8-fa6b-4c86-a990-f6249a0d07c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:18.804322 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aeda8-fa6b-4c86-a990-f6249a0d07c3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:18.808872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:18.812188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9aeda8-fa6b-4c86-a990-f6249a0d07c3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:18.813652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9aeda8-fa6b-4c86-a990-f6249a0d07c3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-aa9aeda8-fa6b-4c86-a990-f6249a0d07c3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:18.828417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:18.829415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:18.831203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:18.831203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:18.831203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:18.831203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:18.831203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:18.831203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:18.831203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:18.831203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:18.831203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:17:18.831203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:18.831203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 331/655] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:17:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:18.831203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aeda8-fa6b-4c86-a990-f6249a0d07c3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:18.860495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bace832-1015-4e7e-99ab-632981be5403 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:18.894774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c29777-2954-403c-84e1-1286ebe4c640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:18.895440 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c29777-2954-403c-84e1-1286ebe4c640 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:18.895783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c29777-2954-403c-84e1-1286ebe4c640 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:18.896040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c29777-2954-403c-84e1-1286ebe4c640 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:18.896783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c29777-2954-403c-84e1-1286ebe4c640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:18.897073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c29777-2954-403c-84e1-1286ebe4c640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:18.898459 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c29777-2954-403c-84e1-1286ebe4c640 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:18.911046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 325/656] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:18.912567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c29777-2954-403c-84e1-1286ebe4c640 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:18.940157 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aeda8-fa6b-4c86-a990-f6249a0d07c3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:18.976603 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81346c3d-268e-410d-9849-6db96df39d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:18.977277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81346c3d-268e-410d-9849-6db96df39d70 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:18.977560 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81346c3d-268e-410d-9849-6db96df39d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:18.977841 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81346c3d-268e-410d-9849-6db96df39d70 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:18.978584 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81346c3d-268e-410d-9849-6db96df39d70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:18.978888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81346c3d-268e-410d-9849-6db96df39d70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:18.980398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81346c3d-268e-410d-9849-6db96df39d70 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:18.992825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 332/657] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:18.993664 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81346c3d-268e-410d-9849-6db96df39d70 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:19.004772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:19.018199 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c29777-2954-403c-84e1-1286ebe4c640 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:19.031843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:19.052645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578729f7-a304-42d5-909b-fd5c329b4644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:19.053304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578729f7-a304-42d5-909b-fd5c329b4644 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:19.053583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578729f7-a304-42d5-909b-fd5c329b4644 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:19.053865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578729f7-a304-42d5-909b-fd5c329b4644 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:19.054695 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578729f7-a304-42d5-909b-fd5c329b4644 None admin] RBAC: Adding query filter params (role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=4a57dc68aeb5482a86d5983b466d933d) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:19.055004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578729f7-a304-42d5-909b-fd5c329b4644 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:19.056476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578729f7-a304-42d5-909b-fd5c329b4644 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:19.062187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 326/658] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:18 2022] GET /identity/v3/role_assignments?user.id=4a57dc68aeb5482a86d5983b466d933d&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:19.062964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578729f7-a304-42d5-909b-fd5c329b4644 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:19.106147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81346c3d-268e-410d-9849-6db96df39d70 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:19.144692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3c9ae-3d2b-47c7-97a6-ad99f16d4660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:19.145395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3c9ae-3d2b-47c7-97a6-ad99f16d4660 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:19.145749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3c9ae-3d2b-47c7-97a6-ad99f16d4660 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:19.146029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3c9ae-3d2b-47c7-97a6-ad99f16d4660 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:19.146909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3c9ae-3d2b-47c7-97a6-ad99f16d4660 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:19.147217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3c9ae-3d2b-47c7-97a6-ad99f16d4660 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:19.148775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3c9ae-3d2b-47c7-97a6-ad99f16d4660 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:19.172772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 333/659] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 21 08:17:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:19.172772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2300da6-bd5d-45bd-934b-f36e4ad49c4a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:19.172772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2300da6-bd5d-45bd-934b-f36e4ad49c4a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:19.172772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2300da6-bd5d-45bd-934b-f36e4ad49c4a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:19.172772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 334/660] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:19.172772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2300da6-bd5d-45bd-934b-f36e4ad49c4a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:19.181112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578729f7-a304-42d5-909b-fd5c329b4644 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:19.218682 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176a236-fa6b-4d10-95d6-7c83de9ad092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:19.219501 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176a236-fa6b-4d10-95d6-7c83de9ad092 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:19.219813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176a236-fa6b-4d10-95d6-7c83de9ad092 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:19.220090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176a236-fa6b-4d10-95d6-7c83de9ad092 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:19.228717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176a236-fa6b-4d10-95d6-7c83de9ad092 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:19.231643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176a236-fa6b-4d10-95d6-7c83de9ad092 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:19.244375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-c176a236-fa6b-4d10-95d6-7c83de9ad092 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:19.244375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:19.244375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:19.244375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:19.244375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:19.244375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:19.244375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:19.244375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:19.244375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:19.244375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:19.244375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:19.244375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:19.244375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:19.244375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:19.244375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:19.245305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:19.246169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:19.246169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:19.246169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:19.246169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:19.246169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:19.246169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:19.246169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:19.246169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:19.250394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 327/661] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:19.251011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:19.251127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176a236-fa6b-4d10-95d6-7c83de9ad092 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:19.290835 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2300da6-bd5d-45bd-934b-f36e4ad49c4a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:19.299701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:19.329036 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83677270-ce7a-4b39-8faa-a02735286fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:19.329847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83677270-ce7a-4b39-8faa-a02735286fff None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:19.330127 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83677270-ce7a-4b39-8faa-a02735286fff None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:19.330401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83677270-ce7a-4b39-8faa-a02735286fff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:19.337862 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83677270-ce7a-4b39-8faa-a02735286fff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:19.339396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83677270-ce7a-4b39-8faa-a02735286fff None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-83677270-ce7a-4b39-8faa-a02735286fff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:19.355048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:19.356110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:19.357141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:19.357141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:19.357141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:19.357141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:19.357141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:19.357141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:19.357141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:19.357141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:19.357141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:17:19.357141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:19.357141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 335/662] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:19.357779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d84a9f-bde8-4a38-a229-a5733a3c8478 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:19.358506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d84a9f-bde8-4a38-a229-a5733a3c8478 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:19.358506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d84a9f-bde8-4a38-a229-a5733a3c8478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:19.371684 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176a236-fa6b-4d10-95d6-7c83de9ad092 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:19.374827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-15d84a9f-bde8-4a38-a229-a5733a3c8478 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:19.376036 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-15d84a9f-bde8-4a38-a229-a5733a3c8478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:19.412517 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c848f-bc43-42c1-b02f-563646f5a0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:19.413203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c848f-bc43-42c1-b02f-563646f5a0be None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:19.413477 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c848f-bc43-42c1-b02f-563646f5a0be None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:19.413747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c848f-bc43-42c1-b02f-563646f5a0be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:19.453822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 336/663] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:19.456200 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d84a9f-bde8-4a38-a229-a5733a3c8478 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:19.494344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c848f-bc43-42c1-b02f-563646f5a0be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:19.495938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c848f-bc43-42c1-b02f-563646f5a0be None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:19.527342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:19.539675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:19.578472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d84a9f-bde8-4a38-a229-a5733a3c8478 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:19.608522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 328/664] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:17:19.608522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c848f-bc43-42c1-b02f-563646f5a0be None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:19.620283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405dee2-a4ea-413e-b5f3-cfe2e24a8bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:19.621071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405dee2-a4ea-413e-b5f3-cfe2e24a8bdf None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:19.621358 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405dee2-a4ea-413e-b5f3-cfe2e24a8bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:19.621753 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405dee2-a4ea-413e-b5f3-cfe2e24a8bdf None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:19.622559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405dee2-a4ea-413e-b5f3-cfe2e24a8bdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:19.622869 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405dee2-a4ea-413e-b5f3-cfe2e24a8bdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:19.624456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405dee2-a4ea-413e-b5f3-cfe2e24a8bdf None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:19.642401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 337/665] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:19.643299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405dee2-a4ea-413e-b5f3-cfe2e24a8bdf None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:19.708132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c848f-bc43-42c1-b02f-563646f5a0be None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:19.743790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f17a0-964f-4936-b70f-7d9fda55dc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:19.744425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f17a0-964f-4936-b70f-7d9fda55dc42 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:19.744692 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f17a0-964f-4936-b70f-7d9fda55dc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:19.744956 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f17a0-964f-4936-b70f-7d9fda55dc42 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:19.745792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f17a0-964f-4936-b70f-7d9fda55dc42 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:19.746098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f17a0-964f-4936-b70f-7d9fda55dc42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:19.747528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f17a0-964f-4936-b70f-7d9fda55dc42 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:19.751173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405dee2-a4ea-413e-b5f3-cfe2e24a8bdf None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:19.755897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:19.766566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 329/666] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Jul 21 08:17:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:19.767445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f17a0-964f-4936-b70f-7d9fda55dc42 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:19.776454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:19.797271 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1e943-0281-497e-9551-355a2158a26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:19.798451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1e943-0281-497e-9551-355a2158a26a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:19.798937 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1e943-0281-497e-9551-355a2158a26a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:19.799391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1e943-0281-497e-9551-355a2158a26a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:19.811239 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1e943-0281-497e-9551-355a2158a26a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-81b1e943-0281-497e-9551-355a2158a26a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:19.820484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:19.821470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:19.822328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:19.822328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:19.822328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:19.822328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:19.822328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:19.822328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:19.822328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:19.822328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:19.822328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:19.822328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:19.822328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:19.822328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:19.829450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 338/667] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:19.830448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1e943-0281-497e-9551-355a2158a26a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:19.877857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f17a0-964f-4936-b70f-7d9fda55dc42 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:19.916820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207c72b-1aca-4e76-96b0-7c4efdde4af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:19.917631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207c72b-1aca-4e76-96b0-7c4efdde4af7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:19.917910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207c72b-1aca-4e76-96b0-7c4efdde4af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:19.918177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207c72b-1aca-4e76-96b0-7c4efdde4af7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:19.930354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207c72b-1aca-4e76-96b0-7c4efdde4af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:19.931861 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207c72b-1aca-4e76-96b0-7c4efdde4af7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:19.937339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1e943-0281-497e-9551-355a2158a26a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:19.949792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-e207c72b-1aca-4e76-96b0-7c4efdde4af7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:19.949792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:19.949792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:19.949792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:19.949792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:19.949792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:19.949792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:19.949792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:19.949792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:19.949792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:19.949792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:19.949792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:19.949792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:19.949792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:19.949792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:19.950853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:19.951955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:19.951955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:19.951955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:19.951955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:19.956098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 330/668] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:19.956855 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207c72b-1aca-4e76-96b0-7c4efdde4af7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:19.976523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0d090-a6e4-4ae3-9a7c-74c4f5f653c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:19.977491 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0d090-a6e4-4ae3-9a7c-74c4f5f653c2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:19.977774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0d090-a6e4-4ae3-9a7c-74c4f5f653c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:19.978049 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0d090-a6e4-4ae3-9a7c-74c4f5f653c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:19.978988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0d090-a6e4-4ae3-9a7c-74c4f5f653c2 None admin] RBAC: Adding query filter params (role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=131bb5462c8b478783a350d37caa76ae) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:19.979300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0d090-a6e4-4ae3-9a7c-74c4f5f653c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:19.980977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0d090-a6e4-4ae3-9a7c-74c4f5f653c2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:19.995632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 339/669] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:19 2022] GET /identity/v3/role_assignments?user.id=131bb5462c8b478783a350d37caa76ae&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:19.995632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0d090-a6e4-4ae3-9a7c-74c4f5f653c2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:20.013532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:20.045833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:20.070562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207c72b-1aca-4e76-96b0-7c4efdde4af7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:20.122567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38485820-4126-4074-bee8-1e08cd5ff737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:20.123148 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38485820-4126-4074-bee8-1e08cd5ff737 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:20.123431 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38485820-4126-4074-bee8-1e08cd5ff737 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:20.123751 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38485820-4126-4074-bee8-1e08cd5ff737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:20.137993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0d090-a6e4-4ae3-9a7c-74c4f5f653c2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:20.192349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecda201-b586-449a-870d-6499aa6b33c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:20.192564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecda201-b586-449a-870d-6499aa6b33c9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:20.192706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecda201-b586-449a-870d-6499aa6b33c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:20.192979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecda201-b586-449a-870d-6499aa6b33c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:20.193776 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecda201-b586-449a-870d-6499aa6b33c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:20.194088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecda201-b586-449a-870d-6499aa6b33c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:20.203625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecda201-b586-449a-870d-6499aa6b33c9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:20.208461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 340/670] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:20.209615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecda201-b586-449a-870d-6499aa6b33c9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:20.218535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38485820-4126-4074-bee8-1e08cd5ff737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:20.220521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38485820-4126-4074-bee8-1e08cd5ff737 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:20.295888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:20.349848 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecda201-b586-449a-870d-6499aa6b33c9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:20.357256 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:20.366689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 331/671] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:17:20.367946 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38485820-4126-4074-bee8-1e08cd5ff737 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:20.386858 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af9b7d-4bf4-4ad8-8c9b-7e97a821fe63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:20.387558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af9b7d-4bf4-4ad8-8c9b-7e97a821fe63 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:20.387889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af9b7d-4bf4-4ad8-8c9b-7e97a821fe63 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:20.388169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af9b7d-4bf4-4ad8-8c9b-7e97a821fe63 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:20.388999 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af9b7d-4bf4-4ad8-8c9b-7e97a821fe63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:20.389313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af9b7d-4bf4-4ad8-8c9b-7e97a821fe63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:20.391006 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af9b7d-4bf4-4ad8-8c9b-7e97a821fe63 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:20.404783 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 341/672] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:20.405898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af9b7d-4bf4-4ad8-8c9b-7e97a821fe63 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:20.492871 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38485820-4126-4074-bee8-1e08cd5ff737 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:20.523735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af9b7d-4bf4-4ad8-8c9b-7e97a821fe63 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:20.538865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94538d2b-a9ad-45bf-9a88-8309ca4ee0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:20.540197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94538d2b-a9ad-45bf-9a88-8309ca4ee0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:20.540855 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94538d2b-a9ad-45bf-9a88-8309ca4ee0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:20.541314 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94538d2b-a9ad-45bf-9a88-8309ca4ee0f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:20.556345 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94538d2b-a9ad-45bf-9a88-8309ca4ee0f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:20.558712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94538d2b-a9ad-45bf-9a88-8309ca4ee0f8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:20.570285 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949c92c-6455-455e-9b87-6a9ca689470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:20.571668 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949c92c-6455-455e-9b87-6a9ca689470b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:20.571965 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949c92c-6455-455e-9b87-6a9ca689470b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:20.572239 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949c92c-6455-455e-9b87-6a9ca689470b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:20.573249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:20.583776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-94538d2b-a9ad-45bf-9a88-8309ca4ee0f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:20.583776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:20.583776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:20.583776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:20.583776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:20.583776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:20.583776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:20.583776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:20.583776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:20.583776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:20.583776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:20.583776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:20.583776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:20.583776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:20.583776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:20.584865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:20.585962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:20.585962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:20.585962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:20.585962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:20.588295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 332/673] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:20.588567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949c92c-6455-455e-9b87-6a9ca689470b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:20.589299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94538d2b-a9ad-45bf-9a88-8309ca4ee0f8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:20.590573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949c92c-6455-455e-9b87-6a9ca689470b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:20.614417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a949c92c-6455-455e-9b87-6a9ca689470b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:20.614417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:20.614417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:20.614417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:20.614417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:20.614417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:20.614417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:20.614417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:20.614417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:20.614417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:20.614417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:20.614417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:20.614417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:20.614417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:20.614417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:20.615418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:20.616337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:20.616337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:20.616337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:20.616337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:20.622696 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 342/674] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:20.622696 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949c92c-6455-455e-9b87-6a9ca689470b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:20.639881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:20.720458 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94538d2b-a9ad-45bf-9a88-8309ca4ee0f8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:20.734878 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949c92c-6455-455e-9b87-6a9ca689470b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:20.759491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97f7d7-439b-4151-b41e-ee80afe892d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:20.760353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97f7d7-439b-4151-b41e-ee80afe892d6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:20.760643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97f7d7-439b-4151-b41e-ee80afe892d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:20.760926 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97f7d7-439b-4151-b41e-ee80afe892d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:20.768036 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97f7d7-439b-4151-b41e-ee80afe892d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:20.770352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97f7d7-439b-4151-b41e-ee80afe892d6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:20.774005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622637f-e5ff-49fa-9d4a-226f294bc2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:20.775136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622637f-e5ff-49fa-9d4a-226f294bc2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:20.776258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622637f-e5ff-49fa-9d4a-226f294bc2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:20.777009 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622637f-e5ff-49fa-9d4a-226f294bc2a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:20.777993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622637f-e5ff-49fa-9d4a-226f294bc2a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:20.778776 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622637f-e5ff-49fa-9d4a-226f294bc2a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:20.781573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622637f-e5ff-49fa-9d4a-226f294bc2a9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:20.790160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-2b97f7d7-439b-4151-b41e-ee80afe892d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:20.790160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:20.790160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:20.790160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:20.790160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:20.790160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:20.790160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:20.790160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:20.790160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:20.790160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:20.790160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:20.790160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:20.790160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:20.790160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:20.790160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:20.791292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:20.792438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:20.792438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:20.792438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:20.792438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:20.792438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:20.792438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:20.792438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:20.792438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:20.796625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 333/675] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:20.797522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97f7d7-439b-4151-b41e-ee80afe892d6 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:20.802772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 343/676] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:20.804050 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622637f-e5ff-49fa-9d4a-226f294bc2a9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:20.861996 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:20.883420 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:20.910709 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622637f-e5ff-49fa-9d4a-226f294bc2a9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:20.911226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97f7d7-439b-4151-b41e-ee80afe892d6 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:20.946505 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dbf74-768f-4828-a488-da676d252659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:20.947719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dbf74-768f-4828-a488-da676d252659 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:20.948200 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dbf74-768f-4828-a488-da676d252659 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:20.948668 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dbf74-768f-4828-a488-da676d252659 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:20.949845 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183dbf74-768f-4828-a488-da676d252659 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:20.950363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183dbf74-768f-4828-a488-da676d252659 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:20.950572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176afbb9-c452-47e2-9056-fb39a15b4eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:20.951252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176afbb9-c452-47e2-9056-fb39a15b4eda None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:20.951538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176afbb9-c452-47e2-9056-fb39a15b4eda None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:20.951847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176afbb9-c452-47e2-9056-fb39a15b4eda None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:20.952584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176afbb9-c452-47e2-9056-fb39a15b4eda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:20.952894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176afbb9-c452-47e2-9056-fb39a15b4eda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:20.953246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183dbf74-768f-4828-a488-da676d252659 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:20.954270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176afbb9-c452-47e2-9056-fb39a15b4eda None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:20.966686 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 344/677] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:20.967843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dbf74-768f-4828-a488-da676d252659 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:20.977496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 334/678] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:20.977496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176afbb9-c452-47e2-9056-fb39a15b4eda None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:21.083953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dbf74-768f-4828-a488-da676d252659 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:21.088144 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176afbb9-c452-47e2-9056-fb39a15b4eda None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:21.111783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:21.120064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4365c3-ce1a-43c9-bec8-710a92cc8c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:21.120947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4365c3-ce1a-43c9-bec8-710a92cc8c81 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:21.121446 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4365c3-ce1a-43c9-bec8-710a92cc8c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:21.121556 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4365c3-ce1a-43c9-bec8-710a92cc8c81 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:21.123774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:21.130652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4365c3-ce1a-43c9-bec8-710a92cc8c81 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:21.131310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75792702-a7c9-4b0d-bb34-00c351c02464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:21.132219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75792702-a7c9-4b0d-bb34-00c351c02464 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:21.132472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4365c3-ce1a-43c9-bec8-710a92cc8c81 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:21.132863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75792702-a7c9-4b0d-bb34-00c351c02464 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:21.133337 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75792702-a7c9-4b0d-bb34-00c351c02464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:21.134451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75792702-a7c9-4b0d-bb34-00c351c02464 None admin] RBAC: Adding query filter params (role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=bd620e5fcb9c4b82865d1d0c508ce8c0) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:21.134940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75792702-a7c9-4b0d-bb34-00c351c02464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:21.136654 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75792702-a7c9-4b0d-bb34-00c351c02464 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-1c4365c3-ce1a-43c9-bec8-710a92cc8c81 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:21.148349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:21.149375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:21.150302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:21.150302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:21.150302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:21.150302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:21.150302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:21.150302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:21.150302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:21.150302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:21.150302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:17:21.150302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:21.150302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 345/680] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:17:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:21.151229 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4365c3-ce1a-43c9-bec8-710a92cc8c81 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:21.151549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 335/680] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:20 2022] GET /identity/v3/role_assignments?user.id=bd620e5fcb9c4b82865d1d0c508ce8c0&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:21.155550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75792702-a7c9-4b0d-bb34-00c351c02464 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:21.266896 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4365c3-ce1a-43c9-bec8-710a92cc8c81 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:21.306760 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522cbc0-ec91-4a7d-b41f-577566f59156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:21.307489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75792702-a7c9-4b0d-bb34-00c351c02464 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:21.307803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522cbc0-ec91-4a7d-b41f-577566f59156 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:21.308184 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522cbc0-ec91-4a7d-b41f-577566f59156 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:21.308761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522cbc0-ec91-4a7d-b41f-577566f59156 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:21.320287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522cbc0-ec91-4a7d-b41f-577566f59156 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:21.322454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522cbc0-ec91-4a7d-b41f-577566f59156 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:21.342158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e522cbc0-ec91-4a7d-b41f-577566f59156 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:21.342158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:21.342158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:21.342158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:21.342158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:21.342158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:21.342158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:21.342158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:21.342158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:21.342158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:21.342158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:21.342158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:21.342158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:21.342158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:21.342158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:21.343186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:21.344110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:21.344110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:21.344110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:21.344110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:21.344110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:21.344110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:21.344110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:21.344110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:21.344110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 346/681] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:21.345001 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d975502-43be-4587-9a61-372263474176 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:21.345099 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d975502-43be-4587-9a61-372263474176 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:21.345366 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d975502-43be-4587-9a61-372263474176 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:21.351284 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 347/682] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:21.352302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d975502-43be-4587-9a61-372263474176 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:21.353484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c39b59-bf7f-4a2b-b13c-7f181680a066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:21.354198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c39b59-bf7f-4a2b-b13c-7f181680a066 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:21.354498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c39b59-bf7f-4a2b-b13c-7f181680a066 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:21.354775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c39b59-bf7f-4a2b-b13c-7f181680a066 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:21.355689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c39b59-bf7f-4a2b-b13c-7f181680a066 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:21.356253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c39b59-bf7f-4a2b-b13c-7f181680a066 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:21.358591 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c39b59-bf7f-4a2b-b13c-7f181680a066 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:21.379429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 336/683] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 21 08:17:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:21.381609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375fedf-0ac4-4b58-96c3-18042df74ddc None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:21.381892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375fedf-0ac4-4b58-96c3-18042df74ddc None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:21.382167 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375fedf-0ac4-4b58-96c3-18042df74ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:21.407186 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a375fedf-0ac4-4b58-96c3-18042df74ddc None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:21.408618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a375fedf-0ac4-4b58-96c3-18042df74ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:21.419620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:21.462730 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:21.485900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d975502-43be-4587-9a61-372263474176 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:21.503623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 337/684] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:21.503623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375fedf-0ac4-4b58-96c3-18042df74ddc None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:21.547312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cde553-3a56-4cc8-a99f-f83898aed31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:21.547956 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cde553-3a56-4cc8-a99f-f83898aed31a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:21.548243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cde553-3a56-4cc8-a99f-f83898aed31a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:21.548515 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cde553-3a56-4cc8-a99f-f83898aed31a None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:21.549490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cde553-3a56-4cc8-a99f-f83898aed31a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:21.549610 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cde553-3a56-4cc8-a99f-f83898aed31a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:21.551522 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cde553-3a56-4cc8-a99f-f83898aed31a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:21.565420 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 348/685] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:21.566596 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cde553-3a56-4cc8-a99f-f83898aed31a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:21.639701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375fedf-0ac4-4b58-96c3-18042df74ddc None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:21.678040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cde553-3a56-4cc8-a99f-f83898aed31a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:21.679056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15176ef5-e227-43b2-b2f0-af79ed4d5404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:21.679894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15176ef5-e227-43b2-b2f0-af79ed4d5404 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:21.680188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15176ef5-e227-43b2-b2f0-af79ed4d5404 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:21.680565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15176ef5-e227-43b2-b2f0-af79ed4d5404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:21.693751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:21.716313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29b199-7454-47b9-90c0-efd22343448c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:21.717136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29b199-7454-47b9-90c0-efd22343448c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:21.717574 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29b199-7454-47b9-90c0-efd22343448c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:21.717857 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29b199-7454-47b9-90c0-efd22343448c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:21.730887 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:21.731448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29b199-7454-47b9-90c0-efd22343448c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:21.734023 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29b199-7454-47b9-90c0-efd22343448c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:21.760480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8d29b199-7454-47b9-90c0-efd22343448c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:21.760480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:21.760480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:21.760480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:21.760480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:21.760480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:21.760480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:21.760480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:21.760480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:21.760480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:21.760480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:21.760480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:21.760480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:21.760480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:21.760480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:21.761619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:21.762544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:21.762544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:21.762544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:21.762544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:21.763234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 349/686] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:21.763926 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29b199-7454-47b9-90c0-efd22343448c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:21.766585 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15176ef5-e227-43b2-b2f0-af79ed4d5404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:21.768376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15176ef5-e227-43b2-b2f0-af79ed4d5404 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:21.894040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 338/687] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:17:21.894040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15176ef5-e227-43b2-b2f0-af79ed4d5404 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:21.898480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29b199-7454-47b9-90c0-efd22343448c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:21.948237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ae63e-919e-4f31-9cb2-922432ed4aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:21.949189 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ae63e-919e-4f31-9cb2-922432ed4aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:21.950149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ae63e-919e-4f31-9cb2-922432ed4aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:21.950667 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ae63e-919e-4f31-9cb2-922432ed4aa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:21.951983 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ae63e-919e-4f31-9cb2-922432ed4aa9 None admin] RBAC: Adding query filter params (role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=1d737a8a33da490db5d59ffed92bee60) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:21.952435 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ae63e-919e-4f31-9cb2-922432ed4aa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:21.954686 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ae63e-919e-4f31-9cb2-922432ed4aa9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:21.967699 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 350/688] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:21 2022] GET /identity/v3/role_assignments?user.id=1d737a8a33da490db5d59ffed92bee60&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:21.967699 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ae63e-919e-4f31-9cb2-922432ed4aa9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:21.989389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:22.035346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:22.049788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15176ef5-e227-43b2-b2f0-af79ed4d5404 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:22.142649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ae63e-919e-4f31-9cb2-922432ed4aa9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:22.143652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05560c2-288c-4a6a-8395-7a587a3bdcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:22.144604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05560c2-288c-4a6a-8395-7a587a3bdcbf None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:22.144915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05560c2-288c-4a6a-8395-7a587a3bdcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:22.145347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05560c2-288c-4a6a-8395-7a587a3bdcbf None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:22.146610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05560c2-288c-4a6a-8395-7a587a3bdcbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:22.147018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05560c2-288c-4a6a-8395-7a587a3bdcbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:22.148562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05560c2-288c-4a6a-8395-7a587a3bdcbf None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:22.164356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 339/689] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:22.169907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05560c2-288c-4a6a-8395-7a587a3bdcbf None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:22.210731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dd3aa-c7e6-4582-ba60-e56bc678108e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:22.211685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dd3aa-c7e6-4582-ba60-e56bc678108e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:22.212065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dd3aa-c7e6-4582-ba60-e56bc678108e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:22.213341 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dd3aa-c7e6-4582-ba60-e56bc678108e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:22.226207 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dd3aa-c7e6-4582-ba60-e56bc678108e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:22.227873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dd3aa-c7e6-4582-ba60-e56bc678108e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:22.248344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-210dd3aa-c7e6-4582-ba60-e56bc678108e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:22.248344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:22.248344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:22.248344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:22.248344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:22.248344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:22.248344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:22.248344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:22.248344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:22.248344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:22.248344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:22.248344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:22.248344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:22.248344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:22.248344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:22.249524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:22.250396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:22.250396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:22.250396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:22.250396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:22.250621 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 351/690] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:22.256350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dd3aa-c7e6-4582-ba60-e56bc678108e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:22.297373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05560c2-288c-4a6a-8395-7a587a3bdcbf None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:22.334770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:22.344279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d0571-f3ce-4ba0-b44b-a184a1945308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:22.345193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d0571-f3ce-4ba0-b44b-a184a1945308 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:22.345490 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d0571-f3ce-4ba0-b44b-a184a1945308 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:22.345775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d0571-f3ce-4ba0-b44b-a184a1945308 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:22.346841 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d0571-f3ce-4ba0-b44b-a184a1945308 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:22.349631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d0571-f3ce-4ba0-b44b-a184a1945308 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:22.360244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:22.377696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 340/691] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:17:22 2022] POST /identity/v3/users => generated 254 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:22.379501 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f926fe-3d14-438f-834d-c522c3d86415 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:22.379818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f926fe-3d14-438f-834d-c522c3d86415 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:22.380095 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f926fe-3d14-438f-834d-c522c3d86415 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:22.383258 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 341/692] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:22.388474 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d2106-1402-4c1f-a739-43809574541e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:22.388760 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d2106-1402-4c1f-a739-43809574541e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:22.388947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dd3aa-c7e6-4582-ba60-e56bc678108e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:22.390873 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d2106-1402-4c1f-a739-43809574541e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:22.423344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9f4d2106-1402-4c1f-a739-43809574541e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:22.425694 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9f4d2106-1402-4c1f-a739-43809574541e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:22.464363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b06fba-f114-46e1-8d09-9f8b71226fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:22.465054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b06fba-f114-46e1-8d09-9f8b71226fdd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:22.465335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b06fba-f114-46e1-8d09-9f8b71226fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:22.465610 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b06fba-f114-46e1-8d09-9f8b71226fdd None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:22.466348 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b06fba-f114-46e1-8d09-9f8b71226fdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:22.466655 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b06fba-f114-46e1-8d09-9f8b71226fdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:22.468095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b06fba-f114-46e1-8d09-9f8b71226fdd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:22.497541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 352/693] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:22.503777 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b06fba-f114-46e1-8d09-9f8b71226fdd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:22.564775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 342/694] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:22.598554 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d2106-1402-4c1f-a739-43809574541e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:22.674596 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b06fba-f114-46e1-8d09-9f8b71226fdd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:22.715012 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac84315-7a8b-46ca-a182-4f9495bd0405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:22.716097 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac84315-7a8b-46ca-a182-4f9495bd0405 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:22.716585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac84315-7a8b-46ca-a182-4f9495bd0405 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:22.717050 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac84315-7a8b-46ca-a182-4f9495bd0405 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:22.728389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac84315-7a8b-46ca-a182-4f9495bd0405 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:22.730099 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac84315-7a8b-46ca-a182-4f9495bd0405 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:22.735816 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d2106-1402-4c1f-a739-43809574541e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:22.747109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-3ac84315-7a8b-46ca-a182-4f9495bd0405 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:22.747109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:22.747109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:22.747109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:22.747109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:22.747109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:22.747109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:22.747109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:22.747109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:22.747109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:22.747109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:22.747109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:22.747109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:22.747109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:22.747109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:22.748095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:22.748973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:22.748973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:22.748973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:22.748973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:22.748973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:22.748973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:22.748973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:22.748973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:22.749476 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 353/695] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:22.755525 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac84315-7a8b-46ca-a182-4f9495bd0405 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:22.757528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:22.760045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:22.786872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a837b-e365-4808-8a61-3a21120c8973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:22.790229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a837b-e365-4808-8a61-3a21120c8973 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:22.790229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a837b-e365-4808-8a61-3a21120c8973 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:22.790811 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a837b-e365-4808-8a61-3a21120c8973 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:22.812008 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a837b-e365-4808-8a61-3a21120c8973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-fe9a837b-e365-4808-8a61-3a21120c8973 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:22.824037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:22.825129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:22.825981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:22.825981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:22.825981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:22.825981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:22.825981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:22.825981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:22.825981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:22.825981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:22.825981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:22.825981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:22.825981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:17:22.825981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:22.828567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 343/696] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:17:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:22.836605 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a837b-e365-4808-8a61-3a21120c8973 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:22.889530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac84315-7a8b-46ca-a182-4f9495bd0405 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:22.936306 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a53ef-0192-4951-b72a-5c315a23d717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:22.937117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a53ef-0192-4951-b72a-5c315a23d717 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:22.937517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a53ef-0192-4951-b72a-5c315a23d717 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:22.937803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a53ef-0192-4951-b72a-5c315a23d717 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:22.938682 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a53ef-0192-4951-b72a-5c315a23d717 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:22.939029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a53ef-0192-4951-b72a-5c315a23d717 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:22.941669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a53ef-0192-4951-b72a-5c315a23d717 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:22.956263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 354/697] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:22.956612 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a837b-e365-4808-8a61-3a21120c8973 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:22.964637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a53ef-0192-4951-b72a-5c315a23d717 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:23.003124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849abeb-f8b7-4b32-8ef5-3df052abfb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:23.004249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849abeb-f8b7-4b32-8ef5-3df052abfb75 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:23.004540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849abeb-f8b7-4b32-8ef5-3df052abfb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:23.004916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849abeb-f8b7-4b32-8ef5-3df052abfb75 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:23.005707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849abeb-f8b7-4b32-8ef5-3df052abfb75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:23.006019 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849abeb-f8b7-4b32-8ef5-3df052abfb75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:23.007467 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849abeb-f8b7-4b32-8ef5-3df052abfb75 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:23.017064 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 344/698] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:17:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:23.023220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849abeb-f8b7-4b32-8ef5-3df052abfb75 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:23.072317 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:23.088059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:23.138818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849abeb-f8b7-4b32-8ef5-3df052abfb75 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:23.179458 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d58139-71e0-4676-9487-70761d837293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:23.180327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d58139-71e0-4676-9487-70761d837293 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:23.180613 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d58139-71e0-4676-9487-70761d837293 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:23.180894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d58139-71e0-4676-9487-70761d837293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:23.189734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a53ef-0192-4951-b72a-5c315a23d717 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:23.193574 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d58139-71e0-4676-9487-70761d837293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:23.195089 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d58139-71e0-4676-9487-70761d837293 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:23.222937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-47d58139-71e0-4676-9487-70761d837293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:23.222937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:23.222937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:23.222937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:23.222937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:23.222937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:23.222937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:23.222937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:23.222937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:23.222937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:23.222937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:23.222937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:23.222937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:23.222937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:23.222937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:23.232273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:23.233155 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:23.233155 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:23.233155 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:23.233155 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:23.233155 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 345/699] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:23.233155 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d58139-71e0-4676-9487-70761d837293 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:23.262664 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025f0d1-d358-47e4-a236-440f84cf6f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:23.263898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025f0d1-d358-47e4-a236-440f84cf6f6e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:23.264372 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025f0d1-d358-47e4-a236-440f84cf6f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:23.264837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025f0d1-d358-47e4-a236-440f84cf6f6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:23.265880 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025f0d1-d358-47e4-a236-440f84cf6f6e None admin] RBAC: Adding query filter params (role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=a8d7cfd6610a4df095daea14ecc37b21) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:23.266398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025f0d1-d358-47e4-a236-440f84cf6f6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:23.268260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025f0d1-d358-47e4-a236-440f84cf6f6e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:23.284986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 355/700] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:22 2022] GET /identity/v3/role_assignments?user.id=a8d7cfd6610a4df095daea14ecc37b21&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:23.331531 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:23.340977 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d58139-71e0-4676-9487-70761d837293 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:23.376869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f94f17-4c17-40ca-a5eb-4cc24fed8618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:23.377600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f94f17-4c17-40ca-a5eb-4cc24fed8618 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:23.377911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f94f17-4c17-40ca-a5eb-4cc24fed8618 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:23.378214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f94f17-4c17-40ca-a5eb-4cc24fed8618 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:23.379004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f94f17-4c17-40ca-a5eb-4cc24fed8618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:23.379309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f94f17-4c17-40ca-a5eb-4cc24fed8618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:23.380768 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f94f17-4c17-40ca-a5eb-4cc24fed8618 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:23.394640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 346/701] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:23.400322 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025f0d1-d358-47e4-a236-440f84cf6f6e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:23.573017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025f0d1-d358-47e4-a236-440f84cf6f6e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:23.604136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:23.614591 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf21cb1-9205-40b6-be5e-a1098c32a75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:23.615471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf21cb1-9205-40b6-be5e-a1098c32a75d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:23.615783 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf21cb1-9205-40b6-be5e-a1098c32a75d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:23.616119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf21cb1-9205-40b6-be5e-a1098c32a75d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:23.624450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf21cb1-9205-40b6-be5e-a1098c32a75d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:23.625906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf21cb1-9205-40b6-be5e-a1098c32a75d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-ddf21cb1-9205-40b6-be5e-a1098c32a75d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:23.641266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:23.642294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:23.643297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:23.643297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:23.643297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:23.643297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:23.643297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:23.643297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:23.643297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:23.643297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:23.643297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:17:23.643297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:23.643297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 356/702] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 08:17:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:23.649255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f94f17-4c17-40ca-a5eb-4cc24fed8618 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:23.680822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a7a8c-eefc-427a-bbda-4ed3411230d2 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:23.681459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a7a8c-eefc-427a-bbda-4ed3411230d2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:23.681459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a7a8c-eefc-427a-bbda-4ed3411230d2 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:23.684233 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 357/703] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:17:23.688439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bab978-c29c-4846-9445-4a0e23314538 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:23.688738 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bab978-c29c-4846-9445-4a0e23314538 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:23.689020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bab978-c29c-4846-9445-4a0e23314538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:23.708472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-29bab978-c29c-4846-9445-4a0e23314538 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:23.709593 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-29bab978-c29c-4846-9445-4a0e23314538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:23.761727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f94f17-4c17-40ca-a5eb-4cc24fed8618 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:23.795723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 358/704] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:17:23.814498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af7a9d-8d0b-4654-8ff4-b704bcbf5bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:23.815335 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af7a9d-8d0b-4654-8ff4-b704bcbf5bff None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:23.815657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af7a9d-8d0b-4654-8ff4-b704bcbf5bff None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:23.816018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af7a9d-8d0b-4654-8ff4-b704bcbf5bff None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:23.817841 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bab978-c29c-4846-9445-4a0e23314538 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:23.820805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af7a9d-8d0b-4654-8ff4-b704bcbf5bff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:23.821177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af7a9d-8d0b-4654-8ff4-b704bcbf5bff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:23.826980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af7a9d-8d0b-4654-8ff4-b704bcbf5bff None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:23.851210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 347/705] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 08:17:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:23.860677 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af7a9d-8d0b-4654-8ff4-b704bcbf5bff None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:23.881606 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:23.993425 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bab978-c29c-4846-9445-4a0e23314538 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:24.023368 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:24.041891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af7a9d-8d0b-4654-8ff4-b704bcbf5bff None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:24.061682 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b25ae-5eb1-4ecd-b8c3-e0efdd956d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:24.062516 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b25ae-5eb1-4ecd-b8c3-e0efdd956d48 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:24.062797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b25ae-5eb1-4ecd-b8c3-e0efdd956d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:24.063073 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b25ae-5eb1-4ecd-b8c3-e0efdd956d48 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:24.063767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b25ae-5eb1-4ecd-b8c3-e0efdd956d48 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:24.065147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b25ae-5eb1-4ecd-b8c3-e0efdd956d48 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:24.084258 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d96dd-e200-4313-8ac6-b12f96a7d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:24.084845 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d96dd-e200-4313-8ac6-b12f96a7d2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:24.085124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d96dd-e200-4313-8ac6-b12f96a7d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:24.085401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d96dd-e200-4313-8ac6-b12f96a7d2b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-d72b25ae-5eb1-4ecd-b8c3-e0efdd956d48 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:24.088272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:24.089332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:24.090354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 359/706] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Jul 21 08:17:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:24.100767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b25ae-5eb1-4ecd-b8c3-e0efdd956d48 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:24.216805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d96dd-e200-4313-8ac6-b12f96a7d2b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:24.218294 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d96dd-e200-4313-8ac6-b12f96a7d2b9 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:24.239925 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:24.275487 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b25ae-5eb1-4ecd-b8c3-e0efdd956d48 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:24.352762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc4505-a2e3-41e7-a6d2-4c4a74c95d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:24.353444 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc4505-a2e3-41e7-a6d2-4c4a74c95d9c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:24.353723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc4505-a2e3-41e7-a6d2-4c4a74c95d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:24.354000 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc4505-a2e3-41e7-a6d2-4c4a74c95d9c None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:24.354705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc4505-a2e3-41e7-a6d2-4c4a74c95d9c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:24.355008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc4505-a2e3-41e7-a6d2-4c4a74c95d9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:24.366119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc4505-a2e3-41e7-a6d2-4c4a74c95d9c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:24.378888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 360/707] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 21 08:17:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:24.396472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc4505-a2e3-41e7-a6d2-4c4a74c95d9c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:24.419444 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 348/708] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:17:24.424928 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d96dd-e200-4313-8ac6-b12f96a7d2b9 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:24.448911 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:24.543250 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc4505-a2e3-41e7-a6d2-4c4a74c95d9c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:24.581742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d96dd-e200-4313-8ac6-b12f96a7d2b9 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:24.589863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf98d1-5255-4d00-b476-3e8b8548ab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:24.590768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf98d1-5255-4d00-b476-3e8b8548ab3e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:24.591722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf98d1-5255-4d00-b476-3e8b8548ab3e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:24.592210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf98d1-5255-4d00-b476-3e8b8548ab3e None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:24.593056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:24.594966 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf98d1-5255-4d00-b476-3e8b8548ab3e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:24.595463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf98d1-5255-4d00-b476-3e8b8548ab3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:24.598311 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf98d1-5255-4d00-b476-3e8b8548ab3e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:24.606277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 361/709] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 21 08:17:24 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:24.608081 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5621791-b984-4d3a-b9d5-3517a84554b0 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:24.608851 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5621791-b984-4d3a-b9d5-3517a84554b0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:24.609315 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5621791-b984-4d3a-b9d5-3517a84554b0 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:24.612247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 362/710] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:24.617830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ea0b3-7316-43f7-b2cb-88138108e316 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:24.618101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ea0b3-7316-43f7-b2cb-88138108e316 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:24.618378 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ea0b3-7316-43f7-b2cb-88138108e316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:24.629304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b27258-667e-4908-ad93-57b4e032a5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:24.630426 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b27258-667e-4908-ad93-57b4e032a5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:24.630942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b27258-667e-4908-ad93-57b4e032a5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:24.631419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b27258-667e-4908-ad93-57b4e032a5e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:24.643549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b27258-667e-4908-ad93-57b4e032a5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:24.645332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b27258-667e-4908-ad93-57b4e032a5e5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:24.656715 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9f9ea0b3-7316-43f7-b2cb-88138108e316 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:24.657850 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9f9ea0b3-7316-43f7-b2cb-88138108e316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:24.665619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-c4b27258-667e-4908-ad93-57b4e032a5e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:24.665619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:24.665619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:24.665619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:24.665619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:24.665619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:24.665619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:24.665619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:24.665619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:24.665619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:24.665619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:24.665619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:24.665619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:24.665619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:24.665619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:24.666643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:24.667632 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:24.667632 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:24.667632 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:24.667632 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:24.670033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 349/711] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:24.680780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b27258-667e-4908-ad93-57b4e032a5e5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:24.746472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 363/712] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:24.829403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ea0b3-7316-43f7-b2cb-88138108e316 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:24.848364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b27258-667e-4908-ad93-57b4e032a5e5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:24.884214 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:24.894412 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2257d-57ae-4e04-b9fd-646e94a77b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:24.895378 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2257d-57ae-4e04-b9fd-646e94a77b3b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:24.895917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2257d-57ae-4e04-b9fd-646e94a77b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:24.896383 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2257d-57ae-4e04-b9fd-646e94a77b3b None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:24.897310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2257d-57ae-4e04-b9fd-646e94a77b3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:24.897807 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2257d-57ae-4e04-b9fd-646e94a77b3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:24.899397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2257d-57ae-4e04-b9fd-646e94a77b3b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:24.912646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 350/713] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:24.917672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2257d-57ae-4e04-b9fd-646e94a77b3b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:24.945102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:24.962412 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ea0b3-7316-43f7-b2cb-88138108e316 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:25.011022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e7ab2-4ccf-40ff-a884-0cd778b91069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:25.011873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e7ab2-4ccf-40ff-a884-0cd778b91069 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:25.012154 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e7ab2-4ccf-40ff-a884-0cd778b91069 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:25.012422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e7ab2-4ccf-40ff-a884-0cd778b91069 None admin] PATH_INFO: `/v3/services/network` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:25.013206 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e7ab2-4ccf-40ff-a884-0cd778b91069 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:25.014615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e7ab2-4ccf-40ff-a884-0cd778b91069 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-c18e7ab2-4ccf-40ff-a884-0cd778b91069 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:25.036567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:25.037634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:25.038474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:25.038474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:25.038474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:25.038474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:25.038474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:25.038474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:25.038474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:25.038474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:25.038474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:25.038474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:25.038474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:25.038474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:25.038474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:17:25.038474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:25.038474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 364/714] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:24 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:25.046740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e7ab2-4ccf-40ff-a884-0cd778b91069 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:25.063562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2257d-57ae-4e04-b9fd-646e94a77b3b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:25.128602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193c951-8ee7-4bc9-8b6d-75453824bf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:25.129787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193c951-8ee7-4bc9-8b6d-75453824bf82 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:25.130272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193c951-8ee7-4bc9-8b6d-75453824bf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:25.130761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193c951-8ee7-4bc9-8b6d-75453824bf82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:25.151624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193c951-8ee7-4bc9-8b6d-75453824bf82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:25.153611 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193c951-8ee7-4bc9-8b6d-75453824bf82 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:25.161287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e7ab2-4ccf-40ff-a884-0cd778b91069 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:25.163841 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:25.180425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-b193c951-8ee7-4bc9-8b6d-75453824bf82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:25.180425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:25.180425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:25.180425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:25.180425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:25.180425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:25.180425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:25.180425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:25.180425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:25.180425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:25.180425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:25.180425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:25.180425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:25.180425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:25.180425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:25.181381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:25.182273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:25.182273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:25.182273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:25.182273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:25.182273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:25.182273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:25.182273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:25.182273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:25.184828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 351/715] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:25.190022 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193c951-8ee7-4bc9-8b6d-75453824bf82 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:25.200700 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88336ce-da4f-4192-8e7b-401ca8df01c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:25.201379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88336ce-da4f-4192-8e7b-401ca8df01c1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:25.201654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88336ce-da4f-4192-8e7b-401ca8df01c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:25.201922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88336ce-da4f-4192-8e7b-401ca8df01c1 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:25.202635 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88336ce-da4f-4192-8e7b-401ca8df01c1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:25.202935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88336ce-da4f-4192-8e7b-401ca8df01c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:25.208170 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88336ce-da4f-4192-8e7b-401ca8df01c1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:25.216754 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 365/716] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 08:17:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:25.223557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88336ce-da4f-4192-8e7b-401ca8df01c1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:25.324062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:25.348447 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193c951-8ee7-4bc9-8b6d-75453824bf82 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:25.368459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88336ce-da4f-4192-8e7b-401ca8df01c1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:25.397870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637a834-434c-4261-ba2c-adc31faf572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:25.398711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637a834-434c-4261-ba2c-adc31faf572f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:25.398997 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637a834-434c-4261-ba2c-adc31faf572f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:25.399734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637a834-434c-4261-ba2c-adc31faf572f None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:25.401183 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637a834-434c-4261-ba2c-adc31faf572f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:25.401499 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637a834-434c-4261-ba2c-adc31faf572f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:25.403890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637a834-434c-4261-ba2c-adc31faf572f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:25.407736 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdb389-531c-47e9-bd50-5fa222e4ee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:25.408485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdb389-531c-47e9-bd50-5fa222e4ee5c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:25.408835 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdb389-531c-47e9-bd50-5fa222e4ee5c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:25.410048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdb389-531c-47e9-bd50-5fa222e4ee5c None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:25.410843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdb389-531c-47e9-bd50-5fa222e4ee5c None admin] RBAC: Adding query filter params (type=network) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:25.411214 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdb389-531c-47e9-bd50-5fa222e4ee5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:25.412690 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdb389-531c-47e9-bd50-5fa222e4ee5c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:25.418034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 366/718] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 08:17:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:25.418179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 352/718] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:25.424538 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca6ddf-1eff-4910-af56-e91b5d198520 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:25.424931 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca6ddf-1eff-4910-af56-e91b5d198520 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:25.425236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca6ddf-1eff-4910-af56-e91b5d198520 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:25.426955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 367/719] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:25.427868 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637a834-434c-4261-ba2c-adc31faf572f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:25.445210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ccea6-0cc1-4498-8fd9-619f9a64f920 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:25.445557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ccea6-0cc1-4498-8fd9-619f9a64f920 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:25.445768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ccea6-0cc1-4498-8fd9-619f9a64f920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:25.491755 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f81ccea6-0cc1-4498-8fd9-619f9a64f920 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:25.492986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f81ccea6-0cc1-4498-8fd9-619f9a64f920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:25.561366 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:25.575536 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637a834-434c-4261-ba2c-adc31faf572f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:25.620046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718f5b2-352c-4ca1-b0a9-fd80a1f375d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:25.620715 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718f5b2-352c-4ca1-b0a9-fd80a1f375d5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:25.621165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718f5b2-352c-4ca1-b0a9-fd80a1f375d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:25.621442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718f5b2-352c-4ca1-b0a9-fd80a1f375d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:25.622879 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718f5b2-352c-4ca1-b0a9-fd80a1f375d5 None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=131bb5462c8b478783a350d37caa76ae) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:25.623203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718f5b2-352c-4ca1-b0a9-fd80a1f375d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:25.625256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718f5b2-352c-4ca1-b0a9-fd80a1f375d5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:25.632117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 353/721] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:25 2022] GET /identity/v3/role_assignments?user.id=131bb5462c8b478783a350d37caa76ae&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:25.632298 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 368/721] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:25.656973 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718f5b2-352c-4ca1-b0a9-fd80a1f375d5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:25.672793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:25.784155 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718f5b2-352c-4ca1-b0a9-fd80a1f375d5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:25.826948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f2cb5-4a50-49d5-8afd-a6f9ee7fc103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:25.827797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f2cb5-4a50-49d5-8afd-a6f9ee7fc103 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:25.828073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f2cb5-4a50-49d5-8afd-a6f9ee7fc103 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:25.828339 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f2cb5-4a50-49d5-8afd-a6f9ee7fc103 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:25.840232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f2cb5-4a50-49d5-8afd-a6f9ee7fc103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-2a6f2cb5-4a50-49d5-8afd-a6f9ee7fc103 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:25.848725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:25.851256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:25.853261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:25.853261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:25.853261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:25.853261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:25.853261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:25.853261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:25.853261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:25.853261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:25.853261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:25.853261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:25.853261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:25.853261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:25.854749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 354/722] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:25.859631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ccea6-0cc1-4498-8fd9-619f9a64f920 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:25.982995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ccea6-0cc1-4498-8fd9-619f9a64f920 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:26.038078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c4f88-2c8b-4732-bdce-ed2b3c871598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:26.038813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c4f88-2c8b-4732-bdce-ed2b3c871598 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:26.039091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c4f88-2c8b-4732-bdce-ed2b3c871598 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:26.039360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c4f88-2c8b-4732-bdce-ed2b3c871598 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:26.040141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c4f88-2c8b-4732-bdce-ed2b3c871598 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:26.040442 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c4f88-2c8b-4732-bdce-ed2b3c871598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:26.041836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c4f88-2c8b-4732-bdce-ed2b3c871598 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:26.055536 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 369/723] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:26.061305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f2cb5-4a50-49d5-8afd-a6f9ee7fc103 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:26.102105 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7a1b0-53ee-4629-9f32-5112da5070c7 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:26.102430 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7a1b0-53ee-4629-9f32-5112da5070c7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:26.102642 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7a1b0-53ee-4629-9f32-5112da5070c7 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:26.104444 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 370/724] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:17:26.113301 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3acbeb-a161-4749-bbd8-74c067efc0d6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:26.113713 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3acbeb-a161-4749-bbd8-74c067efc0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:26.114096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3acbeb-a161-4749-bbd8-74c067efc0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:26.149038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9f3acbeb-a161-4749-bbd8-74c067efc0d6 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:26.155574 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9f3acbeb-a161-4749-bbd8-74c067efc0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:26.160013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:26.194492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:26.220103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f2cb5-4a50-49d5-8afd-a6f9ee7fc103 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:26.271770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6cd99-c7ab-4c57-94ee-bd29fc350e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:26.272973 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6cd99-c7ab-4c57-94ee-bd29fc350e90 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:26.273543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6cd99-c7ab-4c57-94ee-bd29fc350e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:26.274017 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6cd99-c7ab-4c57-94ee-bd29fc350e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:26.294608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 371/725] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:17:26.295958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6cd99-c7ab-4c57-94ee-bd29fc350e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:26.297638 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6cd99-c7ab-4c57-94ee-bd29fc350e90 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:26.318824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3acbeb-a161-4749-bbd8-74c067efc0d6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:26.329429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-86e6cd99-c7ab-4c57-94ee-bd29fc350e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:26.329429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:26.329429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:26.329429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:26.329429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:26.329429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:26.329429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:26.329429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:26.329429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:26.329429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:26.329429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:26.329429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:26.329429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:26.329429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:26.329429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:26.330331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:26.331969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:26.331969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:26.331969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:26.331969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:26.331969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 355/726] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:26.338813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6cd99-c7ab-4c57-94ee-bd29fc350e90 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:26.515243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3acbeb-a161-4749-bbd8-74c067efc0d6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:26.564617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6cd99-c7ab-4c57-94ee-bd29fc350e90 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:26.589003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:26.600299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773aa825-9b85-423c-b969-3f82e49a5bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:26.601441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773aa825-9b85-423c-b969-3f82e49a5bff None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:26.601916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773aa825-9b85-423c-b969-3f82e49a5bff None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:26.602382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773aa825-9b85-423c-b969-3f82e49a5bff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:26.615328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4e180-e2e7-4596-9af8-b207a9ac0e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:26.616395 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4e180-e2e7-4596-9af8-b207a9ac0e7b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:26.616879 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4e180-e2e7-4596-9af8-b207a9ac0e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:26.617360 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4e180-e2e7-4596-9af8-b207a9ac0e7b None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:26.618282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4e180-e2e7-4596-9af8-b207a9ac0e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:26.618826 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4e180-e2e7-4596-9af8-b207a9ac0e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:26.620724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4e180-e2e7-4596-9af8-b207a9ac0e7b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:26.622965 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773aa825-9b85-423c-b969-3f82e49a5bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-773aa825-9b85-423c-b969-3f82e49a5bff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:26.638085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:26.639019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:26.639888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:26.639888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:26.639888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:26.639888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:26.639888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:26.639888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:26.639888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:26.639888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:26.639888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:26.639888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:26.639888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:17:26.639888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:26.649372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 356/728] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:26.649700 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 372/728] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:17:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:26.652515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4e180-e2e7-4596-9af8-b207a9ac0e7b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:26.654573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773aa825-9b85-423c-b969-3f82e49a5bff None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:26.695996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:26.786079 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773aa825-9b85-423c-b969-3f82e49a5bff None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:26.848478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4e180-e2e7-4596-9af8-b207a9ac0e7b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:26.851836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef89948-a26b-4110-a967-e442085878b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:26.852679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef89948-a26b-4110-a967-e442085878b7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:26.852957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef89948-a26b-4110-a967-e442085878b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:26.853234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef89948-a26b-4110-a967-e442085878b7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:26.867382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef89948-a26b-4110-a967-e442085878b7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:26.868888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef89948-a26b-4110-a967-e442085878b7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-2ef89948-a26b-4110-a967-e442085878b7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:26.885918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:26.886970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:26.888389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:26.888389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:26.888389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:26.888389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:26.888389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:26.888389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:26.888389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:26.888389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:26.888389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:17:26.888389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:26.888389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 373/729] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 08:17:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:26.893511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef89948-a26b-4110-a967-e442085878b7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:26.908347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5362a3-76b4-4687-8c5a-617bae8bc426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:26.909425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5362a3-76b4-4687-8c5a-617bae8bc426 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:26.909709 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5362a3-76b4-4687-8c5a-617bae8bc426 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:26.909983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5362a3-76b4-4687-8c5a-617bae8bc426 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:26.910755 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5362a3-76b4-4687-8c5a-617bae8bc426 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:26.911062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5362a3-76b4-4687-8c5a-617bae8bc426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:26.915053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5362a3-76b4-4687-8c5a-617bae8bc426 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:26.932749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 357/730] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:17:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:26.938464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5362a3-76b4-4687-8c5a-617bae8bc426 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:27.009707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:27.021288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:27.067994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef89948-a26b-4110-a967-e442085878b7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:27.103075 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae51914-1cfb-47a4-a2f3-7a7fc0faaef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:27.103418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5362a3-76b4-4687-8c5a-617bae8bc426 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:27.103690 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae51914-1cfb-47a4-a2f3-7a7fc0faaef1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:27.103975 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae51914-1cfb-47a4-a2f3-7a7fc0faaef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:27.104248 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae51914-1cfb-47a4-a2f3-7a7fc0faaef1 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:27.105096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae51914-1cfb-47a4-a2f3-7a7fc0faaef1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:27.105513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae51914-1cfb-47a4-a2f3-7a7fc0faaef1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:27.107930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae51914-1cfb-47a4-a2f3-7a7fc0faaef1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:27.126094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 374/731] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 21 08:17:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:27.127426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0383be-a1b6-4989-bdfb-dbcf7b13fa09 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:27.132206 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0383be-a1b6-4989-bdfb-dbcf7b13fa09 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:27.132746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0383be-a1b6-4989-bdfb-dbcf7b13fa09 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:27.135246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 375/732] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:27.136196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0383be-a1b6-4989-bdfb-dbcf7b13fa09 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:27.147769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33feee-b5ec-4a3b-9089-15698c6ffdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:27.149082 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33feee-b5ec-4a3b-9089-15698c6ffdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:27.149366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33feee-b5ec-4a3b-9089-15698c6ffdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:27.149642 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33feee-b5ec-4a3b-9089-15698c6ffdc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:27.168858 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33feee-b5ec-4a3b-9089-15698c6ffdc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:27.171220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33feee-b5ec-4a3b-9089-15698c6ffdc8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:27.194196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-1f33feee-b5ec-4a3b-9089-15698c6ffdc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:27.194196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:27.194196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:27.194196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:27.194196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:27.194196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:27.194196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:27.194196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:27.194196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:27.194196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:27.194196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:27.194196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:27.194196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:27.194196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:27.194196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:27.195122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:27.196029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:27.196029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:27.196029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:27.196029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:27.199688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 358/733] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:27.204285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cc11c-d220-4cbd-95c8-d0e8f35b9b44 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:27.204570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cc11c-d220-4cbd-95c8-d0e8f35b9b44 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:27.204844 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cc11c-d220-4cbd-95c8-d0e8f35b9b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:27.224543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e66cc11c-d220-4cbd-95c8-d0e8f35b9b44 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:27.225757 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e66cc11c-d220-4cbd-95c8-d0e8f35b9b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:27.270984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0383be-a1b6-4989-bdfb-dbcf7b13fa09 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:27.301654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:27.308922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4038e-ee36-44e5-9551-430b9ac83a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:27.309592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4038e-ee36-44e5-9551-430b9ac83a22 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:27.309874 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4038e-ee36-44e5-9551-430b9ac83a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:27.310150 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4038e-ee36-44e5-9551-430b9ac83a22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:27.320219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 359/734] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:27.323140 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cc11c-d220-4cbd-95c8-d0e8f35b9b44 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:27.361889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:27.396498 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4038e-ee36-44e5-9551-430b9ac83a22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:27.397987 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4038e-ee36-44e5-9551-430b9ac83a22 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:27.467761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cc11c-d220-4cbd-95c8-d0e8f35b9b44 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:27.517277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e28125-3c20-4a70-8d3d-8cb7e5710c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:27.517277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e28125-3c20-4a70-8d3d-8cb7e5710c36 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:27.517277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e28125-3c20-4a70-8d3d-8cb7e5710c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:27.517753 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 376/735] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:17:27.517894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e28125-3c20-4a70-8d3d-8cb7e5710c36 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:27.518847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e28125-3c20-4a70-8d3d-8cb7e5710c36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:27.519219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e28125-3c20-4a70-8d3d-8cb7e5710c36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:27.519657 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4038e-ee36-44e5-9551-430b9ac83a22 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:27.520790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e28125-3c20-4a70-8d3d-8cb7e5710c36 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:27.539681 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 360/736] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:27.540850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e28125-3c20-4a70-8d3d-8cb7e5710c36 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:27.555961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:27.629647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4038e-ee36-44e5-9551-430b9ac83a22 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:27.652438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:27.672702 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e28125-3c20-4a70-8d3d-8cb7e5710c36 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:27.679559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c036-e9dd-4832-8ffd-579bf74bae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:27.680259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c036-e9dd-4832-8ffd-579bf74bae62 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:27.680545 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c036-e9dd-4832-8ffd-579bf74bae62 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:27.680819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c036-e9dd-4832-8ffd-579bf74bae62 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:27.682106 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93c036-e9dd-4832-8ffd-579bf74bae62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:27.683506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93c036-e9dd-4832-8ffd-579bf74bae62 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:27.707682 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 377/737] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 08:17:27 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:27.708940 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c036-e9dd-4832-8ffd-579bf74bae62 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:27.748043 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1eb34a-d4b4-4289-a6ce-314de498423f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:27.750218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1eb34a-d4b4-4289-a6ce-314de498423f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:27.752260 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1eb34a-d4b4-4289-a6ce-314de498423f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:27.752809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1eb34a-d4b4-4289-a6ce-314de498423f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:27.774223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1eb34a-d4b4-4289-a6ce-314de498423f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:27.777482 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1eb34a-d4b4-4289-a6ce-314de498423f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:27.808685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-6b1eb34a-d4b4-4289-a6ce-314de498423f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:27.808685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:27.808685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:27.808685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:27.808685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:27.808685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:27.808685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:27.808685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:27.808685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:27.808685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:27.808685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:27.808685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:27.808685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:27.808685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:27.808685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:27.809651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:27.810545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:27.810545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:27.810545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:27.810545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:27.813045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 361/738] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:27.819329 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1eb34a-d4b4-4289-a6ce-314de498423f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:27.893158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:27.907098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c036-e9dd-4832-8ffd-579bf74bae62 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:27.945613 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04289b7-c4e4-431c-a5b2-d3b1e230d47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:27.946540 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04289b7-c4e4-431c-a5b2-d3b1e230d47f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:27.947270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04289b7-c4e4-431c-a5b2-d3b1e230d47f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:27.947270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04289b7-c4e4-431c-a5b2-d3b1e230d47f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:27.954207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1eb34a-d4b4-4289-a6ce-314de498423f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:27.955967 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04289b7-c4e4-431c-a5b2-d3b1e230d47f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:27.957823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04289b7-c4e4-431c-a5b2-d3b1e230d47f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e04289b7-c4e4-431c-a5b2-d3b1e230d47f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:27.974115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:27.975309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:27.976307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:27.976307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:27.976307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:27.976307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:27.976307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:27.976307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:27.976307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:27.976307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:27.976307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:17:27.976307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:27.976307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 378/739] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:17:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:27.976900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ece27d-e34f-431c-a7e2-ec8411a65b80 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:27.976900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ece27d-e34f-431c-a7e2-ec8411a65b80 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:27.977125 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ece27d-e34f-431c-a7e2-ec8411a65b80 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:27.978512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 379/740] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:27.979483 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043cd10-8bba-4971-940d-e84a2f45aea4 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:27.983843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043cd10-8bba-4971-940d-e84a2f45aea4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:27.985427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043cd10-8bba-4971-940d-e84a2f45aea4 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:27.988202 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 380/741] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:27.989145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043cd10-8bba-4971-940d-e84a2f45aea4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:27.994534 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:28.001895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edefb95-425b-4763-a1c4-005d3dca914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:28.002599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edefb95-425b-4763-a1c4-005d3dca914e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:28.003124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edefb95-425b-4763-a1c4-005d3dca914e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:28.003436 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edefb95-425b-4763-a1c4-005d3dca914e None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:28.004328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edefb95-425b-4763-a1c4-005d3dca914e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:28.004639 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edefb95-425b-4763-a1c4-005d3dca914e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:28.006044 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edefb95-425b-4763-a1c4-005d3dca914e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:28.021149 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 362/742] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:28.022434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dc60a-7cc4-422d-84cf-033f24982d6f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:28.022726 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dc60a-7cc4-422d-84cf-033f24982d6f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:28.023007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dc60a-7cc4-422d-84cf-033f24982d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:28.040404 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-072dc60a-7cc4-422d-84cf-033f24982d6f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:28.041775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-072dc60a-7cc4-422d-84cf-033f24982d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:28.106518 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043cd10-8bba-4971-940d-e84a2f45aea4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:28.123623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 363/743] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:28.123623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa176d2-e6cc-4ebc-b50c-9754d95f13bb None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:28.123623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa176d2-e6cc-4ebc-b50c-9754d95f13bb None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:28.123623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa176d2-e6cc-4ebc-b50c-9754d95f13bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:28.139965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-4aa176d2-e6cc-4ebc-b50c-9754d95f13bb None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:28.141330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4aa176d2-e6cc-4ebc-b50c-9754d95f13bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:28.157029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751d381-e0e2-4172-8242-2a648ec3dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:28.158345 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751d381-e0e2-4172-8242-2a648ec3dd14 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:28.158881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751d381-e0e2-4172-8242-2a648ec3dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:28.159355 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751d381-e0e2-4172-8242-2a648ec3dd14 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:28.160613 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751d381-e0e2-4172-8242-2a648ec3dd14 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:28.161136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751d381-e0e2-4172-8242-2a648ec3dd14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:28.162662 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751d381-e0e2-4172-8242-2a648ec3dd14 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:28.186234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 381/744] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 21 08:17:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:28.186234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751d381-e0e2-4172-8242-2a648ec3dd14 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:28.196776 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:28.227625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 364/745] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:17:28.227625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa176d2-e6cc-4ebc-b50c-9754d95f13bb None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:28.282277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:28.304340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751d381-e0e2-4172-8242-2a648ec3dd14 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:28.335309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa176d2-e6cc-4ebc-b50c-9754d95f13bb None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:28.337671 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdde640-9934-4205-9123-ed95bd7b6d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:28.338483 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdde640-9934-4205-9123-ed95bd7b6d67 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:28.338763 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdde640-9934-4205-9123-ed95bd7b6d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:28.339036 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdde640-9934-4205-9123-ed95bd7b6d67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:28.345818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdde640-9934-4205-9123-ed95bd7b6d67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:28.347362 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdde640-9934-4205-9123-ed95bd7b6d67 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:28.361260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-afdde640-9934-4205-9123-ed95bd7b6d67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:28.361260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:28.361260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:28.361260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:28.361260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:28.361260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:28.361260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:28.361260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:28.361260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:28.361260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:28.361260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:28.361260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:28.361260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:28.361260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:28.361260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:28.362187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:28.363162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:28.363162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:28.363162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:28.363162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:28.363162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:28.363162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:28.363162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:28.363162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:28.363162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 382/746] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:28.363670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdde640-9934-4205-9123-ed95bd7b6d67 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:28.377304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00799f7e-ff11-4be7-937e-4435edd7da67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:28.378281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799f7e-ff11-4be7-937e-4435edd7da67 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:28.378681 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799f7e-ff11-4be7-937e-4435edd7da67 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:28.378980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799f7e-ff11-4be7-937e-4435edd7da67 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:28.379724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00799f7e-ff11-4be7-937e-4435edd7da67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:28.381262 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00799f7e-ff11-4be7-937e-4435edd7da67 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:28.401420 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 365/747] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 08:17:28 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:28.412805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00799f7e-ff11-4be7-937e-4435edd7da67 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:28.450351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:28.488605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdde640-9934-4205-9123-ed95bd7b6d67 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:28.535910 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267229fd-c616-47f4-8237-f89113656e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:28.536623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267229fd-c616-47f4-8237-f89113656e69 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:28.536908 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267229fd-c616-47f4-8237-f89113656e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:28.537178 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267229fd-c616-47f4-8237-f89113656e69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:28.552485 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00799f7e-ff11-4be7-937e-4435edd7da67 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:28.568226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:28.598005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cbb5f-8b4b-4628-8bde-b829b153494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:28.598823 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cbb5f-8b4b-4628-8bde-b829b153494f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:28.599104 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cbb5f-8b4b-4628-8bde-b829b153494f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:28.599380 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cbb5f-8b4b-4628-8bde-b829b153494f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:28.610861 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cbb5f-8b4b-4628-8bde-b829b153494f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-210cbb5f-8b4b-4628-8bde-b829b153494f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:28.618711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:28.619719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:28.620756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:28.620756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:28.620756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:28.620756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:28.620756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:28.620756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:28.620756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:28.620756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:28.620756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:28.620756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:28.620756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:17:28.620756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:28.620756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 366/748] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:17:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:28.620756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cbb5f-8b4b-4628-8bde-b829b153494f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:28.624225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267229fd-c616-47f4-8237-f89113656e69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:28.626052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267229fd-c616-47f4-8237-f89113656e69 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:28.709666 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:28.748212 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cbb5f-8b4b-4628-8bde-b829b153494f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:28.767709 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 383/749] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:17:28.769128 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267229fd-c616-47f4-8237-f89113656e69 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:28.795584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158303b-decf-4377-8e09-9e91fef80630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:28.796601 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158303b-decf-4377-8e09-9e91fef80630 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:28.796892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158303b-decf-4377-8e09-9e91fef80630 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:28.797171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158303b-decf-4377-8e09-9e91fef80630 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:28.797977 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158303b-decf-4377-8e09-9e91fef80630 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:28.798533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158303b-decf-4377-8e09-9e91fef80630 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:28.800698 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158303b-decf-4377-8e09-9e91fef80630 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:28.823776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 367/750] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:28.825027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158303b-decf-4377-8e09-9e91fef80630 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:28.880033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:28.884620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267229fd-c616-47f4-8237-f89113656e69 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:28.922867 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb53fe-87b1-446d-9742-efbc9bd468bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:28.923657 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb53fe-87b1-446d-9742-efbc9bd468bf None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:28.923891 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb53fe-87b1-446d-9742-efbc9bd468bf None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:28.924163 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb53fe-87b1-446d-9742-efbc9bd468bf None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:28.925066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb53fe-87b1-446d-9742-efbc9bd468bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:28.925485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb53fe-87b1-446d-9742-efbc9bd468bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:28.926945 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb53fe-87b1-446d-9742-efbc9bd468bf None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:28.942824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 384/751] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:17:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:28.942824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb53fe-87b1-446d-9742-efbc9bd468bf None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:28.956644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158303b-decf-4377-8e09-9e91fef80630 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:28.969684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:29.004045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d2ba0-16b2-44a3-8a34-796c1bec501c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:29.005860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d2ba0-16b2-44a3-8a34-796c1bec501c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:29.006384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d2ba0-16b2-44a3-8a34-796c1bec501c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:29.007174 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d2ba0-16b2-44a3-8a34-796c1bec501c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:29.021200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d2ba0-16b2-44a3-8a34-796c1bec501c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:29.023462 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d2ba0-16b2-44a3-8a34-796c1bec501c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:29.046285 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb53fe-87b1-446d-9742-efbc9bd468bf None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:29.050143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-4a0d2ba0-16b2-44a3-8a34-796c1bec501c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:29.050143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:29.050143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:29.050143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:29.050143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:29.050143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:29.050143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:29.050143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:29.050143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:29.050143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:29.050143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:29.050143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:29.050143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:29.050143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:29.050143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:29.051018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:29.051932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:29.051932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:29.051932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:29.051932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:29.054198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 368/752] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:29.055194 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d2ba0-16b2-44a3-8a34-796c1bec501c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:29.088168 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34702d21-62f0-4923-8854-4715f518ad74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:29.088936 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34702d21-62f0-4923-8854-4715f518ad74 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:29.089288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34702d21-62f0-4923-8854-4715f518ad74 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:29.089632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34702d21-62f0-4923-8854-4715f518ad74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:29.090631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34702d21-62f0-4923-8854-4715f518ad74 None admin] RBAC: Adding query filter params (role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=1898d568650f48a08a51b93cbd9359bc) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:29.091008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34702d21-62f0-4923-8854-4715f518ad74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:29.092687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34702d21-62f0-4923-8854-4715f518ad74 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:29.103651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 385/753] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:28 2022] GET /identity/v3/role_assignments?user.id=1898d568650f48a08a51b93cbd9359bc&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:29.103651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34702d21-62f0-4923-8854-4715f518ad74 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:29.199073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:29.235200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d2ba0-16b2-44a3-8a34-796c1bec501c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:29.280774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:29.297724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34702d21-62f0-4923-8854-4715f518ad74 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:29.299470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19344299-1ed3-43fd-93ac-3b356a7f8a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:29.301497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19344299-1ed3-43fd-93ac-3b356a7f8a6d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:29.302015 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19344299-1ed3-43fd-93ac-3b356a7f8a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:29.302494 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19344299-1ed3-43fd-93ac-3b356a7f8a6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:29.316142 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19344299-1ed3-43fd-93ac-3b356a7f8a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:29.318585 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19344299-1ed3-43fd-93ac-3b356a7f8a6d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:29.339151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9766d-747a-46bc-8ee3-8b9bf0ac4dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:29.339909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9766d-747a-46bc-8ee3-8b9bf0ac4dab None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:29.340190 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9766d-747a-46bc-8ee3-8b9bf0ac4dab None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:29.340467 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9766d-747a-46bc-8ee3-8b9bf0ac4dab None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:29.341203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9766d-747a-46bc-8ee3-8b9bf0ac4dab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:29.341506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9766d-747a-46bc-8ee3-8b9bf0ac4dab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:29.342906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9766d-747a-46bc-8ee3-8b9bf0ac4dab None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:29.343396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-19344299-1ed3-43fd-93ac-3b356a7f8a6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:29.343396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:29.343396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:29.343396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:29.343396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:29.343396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:29.343396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:29.343396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:29.343396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:29.343396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:29.343396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:29.343396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:29.343396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:29.343396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:29.343396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:29.344322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:29.345200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:29.345200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:29.345200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:29.345200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:29.348232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 369/754] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:29.354549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19344299-1ed3-43fd-93ac-3b356a7f8a6d None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:29.367286 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 386/755] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:29.372751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9766d-747a-46bc-8ee3-8b9bf0ac4dab None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:29.521739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9766d-747a-46bc-8ee3-8b9bf0ac4dab None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:29.561090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19344299-1ed3-43fd-93ac-3b356a7f8a6d None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:29.563019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54315d-f277-42c0-b0e0-f3456bded17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:29.564124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54315d-f277-42c0-b0e0-f3456bded17a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:29.564626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54315d-f277-42c0-b0e0-f3456bded17a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:29.565309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54315d-f277-42c0-b0e0-f3456bded17a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:29.574287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54315d-f277-42c0-b0e0-f3456bded17a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:29.576598 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54315d-f277-42c0-b0e0-f3456bded17a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:29.592824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-be54315d-f277-42c0-b0e0-f3456bded17a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:29.592824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:29.592824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:29.592824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:29.592824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:29.592824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:29.592824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:29.592824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:29.592824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:29.592824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:29.592824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:29.592824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:29.592824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:29.592824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:29.592824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:29.593881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:29.594780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:29.594780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:29.594780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:29.594780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:29.594780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:29.594780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:29.594780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:29.594780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:29.597614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 387/756] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:29.604692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54315d-f277-42c0-b0e0-f3456bded17a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:29.627005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfff96b-f271-4cda-b834-262c100941f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:29.627801 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfff96b-f271-4cda-b834-262c100941f2 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:29.628424 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfff96b-f271-4cda-b834-262c100941f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:29.628602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfff96b-f271-4cda-b834-262c100941f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:29.629303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfff96b-f271-4cda-b834-262c100941f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:29.629611 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfff96b-f271-4cda-b834-262c100941f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:29.631215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfff96b-f271-4cda-b834-262c100941f2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:29.637193 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:29.639592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:29.646327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 370/757] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:29.654011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfff96b-f271-4cda-b834-262c100941f2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:29.757680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfff96b-f271-4cda-b834-262c100941f2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:29.794480 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b24c98-9c65-4e9b-9600-153f539d5ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:29.795305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b24c98-9c65-4e9b-9600-153f539d5ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:29.795592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b24c98-9c65-4e9b-9600-153f539d5ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:29.795891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b24c98-9c65-4e9b-9600-153f539d5ea6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:29.804758 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b24c98-9c65-4e9b-9600-153f539d5ea6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:29.806464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b24c98-9c65-4e9b-9600-153f539d5ea6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:29.808988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54315d-f277-42c0-b0e0-f3456bded17a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-d2b24c98-9c65-4e9b-9600-153f539d5ea6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:29.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:29.822196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:29.823165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:29.823165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:29.823165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:29.823165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:29.823165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:29.823165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:29.823165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:29.823165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:29.823165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:17:29.823165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:29.827365 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 371/758] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 08:17:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:29.830396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b24c98-9c65-4e9b-9600-153f539d5ea6 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:29.854057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d36569-2c8f-4c1a-a4a2-57e009df7980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:29.855820 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d36569-2c8f-4c1a-a4a2-57e009df7980 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:29.856110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d36569-2c8f-4c1a-a4a2-57e009df7980 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:29.856384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d36569-2c8f-4c1a-a4a2-57e009df7980 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:29.859052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d36569-2c8f-4c1a-a4a2-57e009df7980 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:29.859371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d36569-2c8f-4c1a-a4a2-57e009df7980 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:29.863669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d36569-2c8f-4c1a-a4a2-57e009df7980 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:29.891110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 388/759] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:29.898567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d36569-2c8f-4c1a-a4a2-57e009df7980 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:29.944851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:29.998002 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:30.003274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b24c98-9c65-4e9b-9600-153f539d5ea6 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:30.035166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d36569-2c8f-4c1a-a4a2-57e009df7980 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:30.044746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d540117-c73c-4d44-a1ec-9a8221274621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:30.045363 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d540117-c73c-4d44-a1ec-9a8221274621 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:30.045741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d540117-c73c-4d44-a1ec-9a8221274621 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:30.046026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d540117-c73c-4d44-a1ec-9a8221274621 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:30.047025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d540117-c73c-4d44-a1ec-9a8221274621 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:30.047338 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d540117-c73c-4d44-a1ec-9a8221274621 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:30.048921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d540117-c73c-4d44-a1ec-9a8221274621 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:30.068496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 372/760] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 08:17:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:30.069877 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbf3c2-5d3a-414e-8dfc-0214c9736d4b None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:30.070165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbf3c2-5d3a-414e-8dfc-0214c9736d4b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:30.070534 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbf3c2-5d3a-414e-8dfc-0214c9736d4b None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:30.076100 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8e5be-4845-42b5-969f-526cfe0beeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:30.076331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 373/761] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:30.076973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8e5be-4845-42b5-969f-526cfe0beeea None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:30.077080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbf3c2-5d3a-414e-8dfc-0214c9736d4b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:30.077258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8e5be-4845-42b5-969f-526cfe0beeea None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:30.077537 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8e5be-4845-42b5-969f-526cfe0beeea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:30.078390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8e5be-4845-42b5-969f-526cfe0beeea None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=a8d7cfd6610a4df095daea14ecc37b21) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:30.078697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8e5be-4845-42b5-969f-526cfe0beeea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:30.080370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8e5be-4845-42b5-969f-526cfe0beeea None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:30.088065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 389/762] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:29 2022] GET /identity/v3/role_assignments?user.id=a8d7cfd6610a4df095daea14ecc37b21&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:30.089295 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2afda-742b-4228-b618-751f97f68192 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:30.089584 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2afda-742b-4228-b618-751f97f68192 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:30.089864 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2afda-742b-4228-b618-751f97f68192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:30.109789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0da2afda-742b-4228-b618-751f97f68192 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:30.111381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0da2afda-742b-4228-b618-751f97f68192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:30.195037 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 390/763] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:30.236176 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2afda-742b-4228-b618-751f97f68192 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:30.263306 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbf3c2-5d3a-414e-8dfc-0214c9736d4b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:30.278824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:30.303559 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723b7f2-8e31-4354-9995-38d4db086c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:30.304765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723b7f2-8e31-4354-9995-38d4db086c57 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:30.305297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723b7f2-8e31-4354-9995-38d4db086c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:30.305814 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723b7f2-8e31-4354-9995-38d4db086c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:30.324060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:30.327440 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723b7f2-8e31-4354-9995-38d4db086c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:30.329278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723b7f2-8e31-4354-9995-38d4db086c57 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:30.363405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2afda-742b-4228-b618-751f97f68192 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:30.372219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-4723b7f2-8e31-4354-9995-38d4db086c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:30.372219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:30.372219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:30.372219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:30.372219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:30.372219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:30.372219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:30.372219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:30.372219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:30.372219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:30.372219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:30.372219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:30.372219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:30.372219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:30.372219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:30.373141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:30.374026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:30.374026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:30.374026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:30.374026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:30.374026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 374/764] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:30.384651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723b7f2-8e31-4354-9995-38d4db086c57 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:30.408017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68cbba-d0f4-4a7e-98fe-dd2bcbcb7f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:30.409773 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68cbba-d0f4-4a7e-98fe-dd2bcbcb7f41 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:30.410174 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68cbba-d0f4-4a7e-98fe-dd2bcbcb7f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:30.410452 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68cbba-d0f4-4a7e-98fe-dd2bcbcb7f41 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:30.411183 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68cbba-d0f4-4a7e-98fe-dd2bcbcb7f41 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:30.412651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68cbba-d0f4-4a7e-98fe-dd2bcbcb7f41 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4a68cbba-d0f4-4a7e-98fe-dd2bcbcb7f41 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:30.427548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:30.429724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:30.430984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 391/765] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Jul 21 08:17:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:30.439538 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68cbba-d0f4-4a7e-98fe-dd2bcbcb7f41 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:30.575384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723b7f2-8e31-4354-9995-38d4db086c57 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:30.631889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43571b9-8091-4a3f-8d32-497be2a0d1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:30.632569 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43571b9-8091-4a3f-8d32-497be2a0d1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:30.632852 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43571b9-8091-4a3f-8d32-497be2a0d1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:30.633126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43571b9-8091-4a3f-8d32-497be2a0d1a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:30.633863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43571b9-8091-4a3f-8d32-497be2a0d1a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:30.634170 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43571b9-8091-4a3f-8d32-497be2a0d1a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:30.635563 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43571b9-8091-4a3f-8d32-497be2a0d1a1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:30.651629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68cbba-d0f4-4a7e-98fe-dd2bcbcb7f41 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:30.663296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 375/766] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:30.672613 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43571b9-8091-4a3f-8d32-497be2a0d1a1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:30.704603 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:30.717526 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee957e9-0d57-45f7-b6fb-ff2799d8dcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:30.718212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee957e9-0d57-45f7-b6fb-ff2799d8dcab None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:30.718497 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee957e9-0d57-45f7-b6fb-ff2799d8dcab None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:30.718775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee957e9-0d57-45f7-b6fb-ff2799d8dcab None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:30.719499 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee957e9-0d57-45f7-b6fb-ff2799d8dcab None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:30.719833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee957e9-0d57-45f7-b6fb-ff2799d8dcab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:30.721371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee957e9-0d57-45f7-b6fb-ff2799d8dcab None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:30.733663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 392/767] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 21 08:17:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:30.734959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:30.739322 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee957e9-0d57-45f7-b6fb-ff2799d8dcab None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:30.857200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43571b9-8091-4a3f-8d32-497be2a0d1a1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:30.895560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebcc41-1301-4ccc-9f72-07b702e57dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:30.896558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebcc41-1301-4ccc-9f72-07b702e57dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:30.897151 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebcc41-1301-4ccc-9f72-07b702e57dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:30.897436 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebcc41-1301-4ccc-9f72-07b702e57dc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:30.903052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee957e9-0d57-45f7-b6fb-ff2799d8dcab None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:30.907579 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebcc41-1301-4ccc-9f72-07b702e57dc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:30.909469 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebcc41-1301-4ccc-9f72-07b702e57dc4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:30.928540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-82ebcc41-1301-4ccc-9f72-07b702e57dc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:30.928540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:30.928540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:30.928540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:30.928540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:30.928540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:30.928540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:30.928540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:30.928540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:30.928540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:30.928540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:30.928540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:30.928540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:30.928540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:30.928540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:30.929510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:30.930379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:30.930379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:30.930379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:30.930379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:30.930379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:30.930379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:30.930379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:30.930379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:30.930806 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 376/768] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:30.932057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2d31-3438-4598-8563-8d284bf22690 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:30.932337 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2d31-3438-4598-8563-8d284bf22690 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:30.934997 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2d31-3438-4598-8563-8d284bf22690 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:30.938424 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 377/769] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:30.939340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2d31-3438-4598-8563-8d284bf22690 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:30.946147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8841f27-a16e-4049-a967-2bd53c71dce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:30.946946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8841f27-a16e-4049-a967-2bd53c71dce0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:30.947299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8841f27-a16e-4049-a967-2bd53c71dce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:30.947689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8841f27-a16e-4049-a967-2bd53c71dce0 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:30.948484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8841f27-a16e-4049-a967-2bd53c71dce0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:30.948858 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8841f27-a16e-4049-a967-2bd53c71dce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:30.950422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8841f27-a16e-4049-a967-2bd53c71dce0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:30.956371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 393/770] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 21 08:17:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:30.957923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c218e-5846-4f25-b134-b42b1082396e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:30.958296 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c218e-5846-4f25-b134-b42b1082396e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:30.958638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c218e-5846-4f25-b134-b42b1082396e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:30.977691 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2e2c218e-5846-4f25-b134-b42b1082396e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:30.979010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2e2c218e-5846-4f25-b134-b42b1082396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:31.036044 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:31.050704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:31.064039 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 394/771] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:31.066175 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c218e-5846-4f25-b134-b42b1082396e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:31.069881 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2d31-3438-4598-8563-8d284bf22690 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:31.111742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5dd3e-3c41-4e4f-846b-f4b0af03264a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:31.112847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5dd3e-3c41-4e4f-846b-f4b0af03264a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:31.113288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5dd3e-3c41-4e4f-846b-f4b0af03264a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:31.114002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5dd3e-3c41-4e4f-846b-f4b0af03264a None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:31.115229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5dd3e-3c41-4e4f-846b-f4b0af03264a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:31.115738 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5dd3e-3c41-4e4f-846b-f4b0af03264a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:31.118356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5dd3e-3c41-4e4f-846b-f4b0af03264a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:31.133515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 378/772] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:31.134539 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5dd3e-3c41-4e4f-846b-f4b0af03264a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:31.194578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c218e-5846-4f25-b134-b42b1082396e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:31.236765 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c64168-b43a-40e7-b8ae-2ca232721805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:31.238253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c64168-b43a-40e7-b8ae-2ca232721805 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:31.238826 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c64168-b43a-40e7-b8ae-2ca232721805 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:31.239349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c64168-b43a-40e7-b8ae-2ca232721805 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:31.240615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c64168-b43a-40e7-b8ae-2ca232721805 None admin] RBAC: Adding query filter params (interface=public, service_id=18814476063b4612877dd2276df61d17, region_id=RegionOne) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:31.241077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c64168-b43a-40e7-b8ae-2ca232721805 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:31.243401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c64168-b43a-40e7-b8ae-2ca232721805 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:31.258431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 395/773] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 08:17:31 2022] GET /identity/v3/endpoints?service_id=18814476063b4612877dd2276df61d17&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:31.258431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c64168-b43a-40e7-b8ae-2ca232721805 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:31.267671 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5dd3e-3c41-4e4f-846b-f4b0af03264a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:31.307293 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d267b-73b4-48e9-8e0d-107788c13653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:31.308309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d267b-73b4-48e9-8e0d-107788c13653 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:31.308593 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d267b-73b4-48e9-8e0d-107788c13653 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:31.308867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d267b-73b4-48e9-8e0d-107788c13653 None admin] PATH_INFO: `/v3/services/network` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:31.309531 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d267b-73b4-48e9-8e0d-107788c13653 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:31.310923 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d267b-73b4-48e9-8e0d-107788c13653 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:31.322076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-2d3d267b-73b4-48e9-8e0d-107788c13653 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:31.325707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:31.326704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:31.327520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:31.327520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:31.327520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:31.327520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:31.327520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:31.327520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:31.327520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:31.327520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:31.327520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:31.327520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:31.327520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:31.327520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:31.327520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:17:31.327520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:31.331867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 379/774] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:31 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:31.332832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d267b-73b4-48e9-8e0d-107788c13653 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:31.345769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:31.390059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c64168-b43a-40e7-b8ae-2ca232721805 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:31.431588 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe73b4-b270-42c1-8443-9ce7c6ab6344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:31.432496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe73b4-b270-42c1-8443-9ce7c6ab6344 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:31.432779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe73b4-b270-42c1-8443-9ce7c6ab6344 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:31.433055 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe73b4-b270-42c1-8443-9ce7c6ab6344 None admin] PATH_INFO: `/v3/projects/784795960efb40e5811f778fff6fceb1/users/131bb5462c8b478783a350d37caa76ae/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:31.438068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe73b4-b270-42c1-8443-9ce7c6ab6344 None admin] RBAC: Authorizing `identity:create_grant(project_id=784795960efb40e5811f778fff6fceb1, user_id=131bb5462c8b478783a350d37caa76ae, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:31.439716 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe73b4-b270-42c1-8443-9ce7c6ab6344 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:31.445955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d267b-73b4-48e9-8e0d-107788c13653 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:31.459407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 396/775] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:17:31 2022] PUT /identity/v3/projects/784795960efb40e5811f778fff6fceb1/users/131bb5462c8b478783a350d37caa76ae/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:17:31.468751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe73b4-b270-42c1-8443-9ce7c6ab6344 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:31.487118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37b17a-cef3-44dd-96ce-e25cf9d33b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:31.487482 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b17a-cef3-44dd-96ce-e25cf9d33b87 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:31.487834 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b17a-cef3-44dd-96ce-e25cf9d33b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:31.488163 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b17a-cef3-44dd-96ce-e25cf9d33b87 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:31.488881 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37b17a-cef3-44dd-96ce-e25cf9d33b87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:31.490378 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37b17a-cef3-44dd-96ce-e25cf9d33b87 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:31.505737 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 380/776] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 08:17:31 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:31.508459 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13dcb4-fbd4-4891-bb75-c316256fd503 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:31.509084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13dcb4-fbd4-4891-bb75-c316256fd503 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:31.509853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13dcb4-fbd4-4891-bb75-c316256fd503 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:31.513046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 381/777] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:31.522230 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02c563-ea43-423b-8951-efad1d619cee None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:31.523102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02c563-ea43-423b-8951-efad1d619cee None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:31.523564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02c563-ea43-423b-8951-efad1d619cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:31.549040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8b02c563-ea43-423b-8951-efad1d619cee None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:31.551186 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8b02c563-ea43-423b-8951-efad1d619cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:31.640961 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 382/778] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:31.670705 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02c563-ea43-423b-8951-efad1d619cee None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:31.673316 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:31.688784 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe73b4-b270-42c1-8443-9ce7c6ab6344 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:31.703885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:31.738503 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc9bcb-5e75-4015-af61-e674663ebc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:31.739362 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc9bcb-5e75-4015-af61-e674663ebc46 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:31.739811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc9bcb-5e75-4015-af61-e674663ebc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:31.740092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc9bcb-5e75-4015-af61-e674663ebc46 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:31.740830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc9bcb-5e75-4015-af61-e674663ebc46 None admin] RBAC: Adding query filter params (name=network) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:31.741132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc9bcb-5e75-4015-af61-e674663ebc46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:31.743323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc9bcb-5e75-4015-af61-e674663ebc46 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:31.754709 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 397/779] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 08:17:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:31.760482 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc9bcb-5e75-4015-af61-e674663ebc46 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:31.817138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02c563-ea43-423b-8951-efad1d619cee None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:31.863719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ce2a4-0fea-458f-9122-fea70e87f797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:31.864940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ce2a4-0fea-458f-9122-fea70e87f797 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:31.865424 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ce2a4-0fea-458f-9122-fea70e87f797 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:31.865895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ce2a4-0fea-458f-9122-fea70e87f797 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:31.877216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ce2a4-0fea-458f-9122-fea70e87f797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-018ce2a4-0fea-458f-9122-fea70e87f797 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:31.885690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:31.886651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:31.887489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:31.887489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:31.887489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:31.887489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:31.887489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:31.887489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:31.887489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:31.887489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:31.887489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:31.887489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:31.887489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:31.887489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:31.890249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc9bcb-5e75-4015-af61-e674663ebc46 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:31.890488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 383/780] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:31.901189 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ce2a4-0fea-458f-9122-fea70e87f797 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:31.943857 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f1486-bbb8-4657-86d6-b3675466c8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:31.944995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f1486-bbb8-4657-86d6-b3675466c8be None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:31.946661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f1486-bbb8-4657-86d6-b3675466c8be None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:31.947180 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f1486-bbb8-4657-86d6-b3675466c8be None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:31.948140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f1486-bbb8-4657-86d6-b3675466c8be None admin] RBAC: Adding query filter params (type=network) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:31.948840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f1486-bbb8-4657-86d6-b3675466c8be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:31.951920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f1486-bbb8-4657-86d6-b3675466c8be None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:31.962116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 398/781] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 08:17:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:31.968791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f1486-bbb8-4657-86d6-b3675466c8be None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:32.026732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:32.043096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:32.108979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f1486-bbb8-4657-86d6-b3675466c8be None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:32.142016 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ce2a4-0fea-458f-9122-fea70e87f797 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:32.145310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6062635-bc2a-411e-b158-931e9685dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:32.146236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6062635-bc2a-411e-b158-931e9685dace None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:32.146770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6062635-bc2a-411e-b158-931e9685dace None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:32.147272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6062635-bc2a-411e-b158-931e9685dace None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:32.148439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6062635-bc2a-411e-b158-931e9685dace None admin] RBAC: Adding query filter params (interface=public, service_id=d6dce70488584e3193345648ff39957b, region_id=RegionOne) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:32.148975 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6062635-bc2a-411e-b158-931e9685dace None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:32.150964 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6062635-bc2a-411e-b158-931e9685dace None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:32.157434 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 399/782] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 08:17:31 2022] GET /identity/v3/endpoints?service_id=d6dce70488584e3193345648ff39957b&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:32.165175 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6062635-bc2a-411e-b158-931e9685dace None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:32.208390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292b9f2-8834-41e0-a37a-fe0228f7a939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:32.209073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292b9f2-8834-41e0-a37a-fe0228f7a939 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:32.209359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292b9f2-8834-41e0-a37a-fe0228f7a939 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:32.209631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292b9f2-8834-41e0-a37a-fe0228f7a939 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:32.210398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292b9f2-8834-41e0-a37a-fe0228f7a939 None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:32.210705 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292b9f2-8834-41e0-a37a-fe0228f7a939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:32.212126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292b9f2-8834-41e0-a37a-fe0228f7a939 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:32.226783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 384/783] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:32.231886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292b9f2-8834-41e0-a37a-fe0228f7a939 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:32.367024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292b9f2-8834-41e0-a37a-fe0228f7a939 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:32.369517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6062635-bc2a-411e-b158-931e9685dace None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:32.371333 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:32.395744 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:32.408231 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97b6fd-0556-49b3-b0b3-6b4cfd6686d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:32.408985 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97b6fd-0556-49b3-b0b3-6b4cfd6686d6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:32.409356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97b6fd-0556-49b3-b0b3-6b4cfd6686d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:32.409658 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97b6fd-0556-49b3-b0b3-6b4cfd6686d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:32.418444 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed37d2b-20ef-4d4e-82da-124b50b4bed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:32.419449 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37d2b-20ef-4d4e-82da-124b50b4bed9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:32.419962 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37d2b-20ef-4d4e-82da-124b50b4bed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:32.420411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37d2b-20ef-4d4e-82da-124b50b4bed9 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:32.420898 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97b6fd-0556-49b3-b0b3-6b4cfd6686d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:32.421463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed37d2b-20ef-4d4e-82da-124b50b4bed9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:32.422495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97b6fd-0556-49b3-b0b3-6b4cfd6686d6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:32.423235 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed37d2b-20ef-4d4e-82da-124b50b4bed9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:32.429945 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 400/784] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 08:17:32 2022] GET /identity/v3/services => generated 772 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:32.436831 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090fbcf-9f53-4070-a88e-55f57895aa60 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:32.437398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090fbcf-9f53-4070-a88e-55f57895aa60 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:32.437857 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090fbcf-9f53-4070-a88e-55f57895aa60 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:32.439801 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 401/785] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:32.445081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-cd97b6fd-0556-49b3-b0b3-6b4cfd6686d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:32.445081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:32.445081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:32.445081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:32.445081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:32.445081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:32.445081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:32.445081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:32.445081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:32.445081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:32.445081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:32.445081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:32.445081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:32.445081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:32.445081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:32.446084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:32.447016 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:32.447016 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:32.447016 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:32.447016 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:32.447016 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 385/786] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:32.448923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafba9e-ad93-44d6-9201-57d6cc4550dd None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:32.449404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafba9e-ad93-44d6-9201-57d6cc4550dd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:32.449837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafba9e-ad93-44d6-9201-57d6cc4550dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:32.452085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97b6fd-0556-49b3-b0b3-6b4cfd6686d6 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:32.489045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fbafba9e-ad93-44d6-9201-57d6cc4550dd None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:32.490760 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fbafba9e-ad93-44d6-9201-57d6cc4550dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:32.575638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 402/787] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:17:32.615133 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafba9e-ad93-44d6-9201-57d6cc4550dd None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:32.621583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97b6fd-0556-49b3-b0b3-6b4cfd6686d6 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:32.690612 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d67a0e-aa9e-4ac7-a4c5-9ff3ef195126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:32.690612 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d67a0e-aa9e-4ac7-a4c5-9ff3ef195126 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:32.690612 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d67a0e-aa9e-4ac7-a4c5-9ff3ef195126 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:32.690612 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d67a0e-aa9e-4ac7-a4c5-9ff3ef195126 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:32.691323 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d67a0e-aa9e-4ac7-a4c5-9ff3ef195126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:32.693335 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d67a0e-aa9e-4ac7-a4c5-9ff3ef195126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:32.693335 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d67a0e-aa9e-4ac7-a4c5-9ff3ef195126 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:32.717964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 386/788] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:32.725008 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d67a0e-aa9e-4ac7-a4c5-9ff3ef195126 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:32.763821 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:32.767555 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:32.773048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafba9e-ad93-44d6-9201-57d6cc4550dd None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:32.811191 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0ba18-e290-4f8e-90d4-734c5621bddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:32.812125 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0ba18-e290-4f8e-90d4-734c5621bddf None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:32.812405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0ba18-e290-4f8e-90d4-734c5621bddf None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:32.812680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0ba18-e290-4f8e-90d4-734c5621bddf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:32.830086 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0ba18-e290-4f8e-90d4-734c5621bddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-5cd0ba18-e290-4f8e-90d4-734c5621bddf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:32.838512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:32.839478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:32.840402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:32.840402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:32.840402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:32.840402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:32.840402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:32.840402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:32.840402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:32.840402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:32.840402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:32.840402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:32.840402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:17:32.840402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:32.840402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 403/789] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:17:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:32.848970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0ba18-e290-4f8e-90d4-734c5621bddf None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:32.864476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d67a0e-aa9e-4ac7-a4c5-9ff3ef195126 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:32.937438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8414a-7720-4c82-860b-16428b2682f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:32.938324 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8414a-7720-4c82-860b-16428b2682f8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:32.938609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8414a-7720-4c82-860b-16428b2682f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:32.938887 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8414a-7720-4c82-860b-16428b2682f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:32.949467 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8414a-7720-4c82-860b-16428b2682f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:32.950961 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8414a-7720-4c82-860b-16428b2682f8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-f1f8414a-7720-4c82-860b-16428b2682f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:32.968261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:32.969269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:32.970218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:32.970218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:32.970218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:32.970218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:32.970218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:32.970218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:32.970218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:32.970218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:32.970218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:17:32.970218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:32.970218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 387/790] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 08:17:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:32.976230 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8414a-7720-4c82-860b-16428b2682f8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:33.012706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0ba18-e290-4f8e-90d4-734c5621bddf None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:33.074820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:33.081421 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8414a-7720-4c82-860b-16428b2682f8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:33.086139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15022dfe-2a48-43ba-9071-d65947a1fab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:33.086833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15022dfe-2a48-43ba-9071-d65947a1fab5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:33.087113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15022dfe-2a48-43ba-9071-d65947a1fab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:33.087476 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15022dfe-2a48-43ba-9071-d65947a1fab5 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:33.088313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15022dfe-2a48-43ba-9071-d65947a1fab5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:33.088616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15022dfe-2a48-43ba-9071-d65947a1fab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:33.090002 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15022dfe-2a48-43ba-9071-d65947a1fab5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:33.103800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 404/791] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:17:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:33.105474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15022dfe-2a48-43ba-9071-d65947a1fab5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:33.128582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:33.152218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e9bc4-21a1-4112-8a80-4024066379bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:33.152908 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e9bc4-21a1-4112-8a80-4024066379bc None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:33.153183 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e9bc4-21a1-4112-8a80-4024066379bc None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:33.153454 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e9bc4-21a1-4112-8a80-4024066379bc None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:33.154311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e9bc4-21a1-4112-8a80-4024066379bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:33.154613 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e9bc4-21a1-4112-8a80-4024066379bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:33.156086 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e9bc4-21a1-4112-8a80-4024066379bc None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:33.192141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 388/792] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 21 08:17:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:33.196652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e9bc4-21a1-4112-8a80-4024066379bc None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:33.265622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15022dfe-2a48-43ba-9071-d65947a1fab5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:33.362502 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58766e-e861-493c-98f6-b5538e7ae101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:33.363426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58766e-e861-493c-98f6-b5538e7ae101 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:33.366676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e9bc4-21a1-4112-8a80-4024066379bc None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:33.368141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58766e-e861-493c-98f6-b5538e7ae101 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:33.368433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58766e-e861-493c-98f6-b5538e7ae101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:33.391327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58766e-e861-493c-98f6-b5538e7ae101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:33.395189 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58766e-e861-493c-98f6-b5538e7ae101 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:33.432889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-7c58766e-e861-493c-98f6-b5538e7ae101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:33.432889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:33.432889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:33.432889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:33.432889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:33.432889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:33.432889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:33.432889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:33.432889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:33.432889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:33.432889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:33.432889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:33.432889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:33.432889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:33.432889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:33.433870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:33.434751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:33.434751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:33.434751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:33.434751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:33.443362 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 405/793] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:33.444699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe230157-a3e0-47ae-afc5-f4b768544d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:33.447629 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe230157-a3e0-47ae-afc5-f4b768544d1b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:33.447629 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe230157-a3e0-47ae-afc5-f4b768544d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:33.447629 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe230157-a3e0-47ae-afc5-f4b768544d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:33.447883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58766e-e861-493c-98f6-b5538e7ae101 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:33.480780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe230157-a3e0-47ae-afc5-f4b768544d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:33.482249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe230157-a3e0-47ae-afc5-f4b768544d1b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:33.523632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:33.524419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-fe230157-a3e0-47ae-afc5-f4b768544d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:33.524419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:33.524419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:33.524419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:33.524419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:33.524419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:33.524419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:33.524419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:33.524419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:33.524419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:33.524419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:33.524419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:33.524419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:33.524419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:33.524419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:33.525859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:33.527066 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:33.527066 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:33.527066 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:33.527066 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:33.527066 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 389/794] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:33.532966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe230157-a3e0-47ae-afc5-f4b768544d1b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:33.552373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:33.563118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58766e-e861-493c-98f6-b5538e7ae101 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:33.598771 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bc251-1943-4bb3-afa1-70d3f2e4c2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:33.599815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bc251-1943-4bb3-afa1-70d3f2e4c2eb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:33.600418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bc251-1943-4bb3-afa1-70d3f2e4c2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:33.600883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bc251-1943-4bb3-afa1-70d3f2e4c2eb None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:33.601796 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80bc251-1943-4bb3-afa1-70d3f2e4c2eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:33.602291 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80bc251-1943-4bb3-afa1-70d3f2e4c2eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:33.604072 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80bc251-1943-4bb3-afa1-70d3f2e4c2eb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:33.617531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 406/795] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:33.623028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bc251-1943-4bb3-afa1-70d3f2e4c2eb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:33.730206 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bc251-1943-4bb3-afa1-70d3f2e4c2eb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:33.763986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:33.767519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66a103-24e9-4ca2-aef4-e3257df292ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:33.768418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66a103-24e9-4ca2-aef4-e3257df292ca None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:33.768702 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66a103-24e9-4ca2-aef4-e3257df292ca None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:33.768978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66a103-24e9-4ca2-aef4-e3257df292ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:33.782458 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66a103-24e9-4ca2-aef4-e3257df292ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:33.784030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66a103-24e9-4ca2-aef4-e3257df292ca None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:33.800553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe230157-a3e0-47ae-afc5-f4b768544d1b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8a66a103-24e9-4ca2-aef4-e3257df292ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:33.809759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:33.810698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:33.811637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:33.811637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:33.811637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:33.811637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:33.811637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:33.811637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:33.811637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:33.811637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:33.811637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:17:33.811637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:33.816339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 407/796] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:17:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:33.825069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66a103-24e9-4ca2-aef4-e3257df292ca None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:33.872862 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c90e6-8f2b-45bd-ba80-4055f0240071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:33.873530 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c90e6-8f2b-45bd-ba80-4055f0240071 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:33.873807 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c90e6-8f2b-45bd-ba80-4055f0240071 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:33.874077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c90e6-8f2b-45bd-ba80-4055f0240071 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:33.874879 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c90e6-8f2b-45bd-ba80-4055f0240071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:33.875225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c90e6-8f2b-45bd-ba80-4055f0240071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:33.876629 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c90e6-8f2b-45bd-ba80-4055f0240071 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:33.906632 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 390/797] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:33.912805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c90e6-8f2b-45bd-ba80-4055f0240071 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:34.007905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66a103-24e9-4ca2-aef4-e3257df292ca None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:34.009792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:34.051049 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca0cbf-1a58-4f59-8017-64b3310e5612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:34.051677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca0cbf-1a58-4f59-8017-64b3310e5612 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:34.051963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca0cbf-1a58-4f59-8017-64b3310e5612 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:34.052229 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca0cbf-1a58-4f59-8017-64b3310e5612 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:34.053076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca0cbf-1a58-4f59-8017-64b3310e5612 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:34.053377 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca0cbf-1a58-4f59-8017-64b3310e5612 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:34.053554 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c90e6-8f2b-45bd-ba80-4055f0240071 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:34.054831 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca0cbf-1a58-4f59-8017-64b3310e5612 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:34.073455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 408/798] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 21 08:17:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:34.079515 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f426df-e799-4e0a-8c9f-0b85782f6adb None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:34.079828 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f426df-e799-4e0a-8c9f-0b85782f6adb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:34.080211 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f426df-e799-4e0a-8c9f-0b85782f6adb None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:34.081665 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 409/799] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:34.083677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca3499-7920-42a7-8f47-4e16c61b8e50 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:34.083677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca3499-7920-42a7-8f47-4e16c61b8e50 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:34.083677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca3499-7920-42a7-8f47-4e16c61b8e50 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:34.084903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 410/800] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:34.086194 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca3499-7920-42a7-8f47-4e16c61b8e50 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:34.098784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8b3a2-550e-4485-bc08-4676f221b61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:34.099871 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8b3a2-550e-4485-bc08-4676f221b61e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:34.100263 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8b3a2-550e-4485-bc08-4676f221b61e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:34.100535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8b3a2-550e-4485-bc08-4676f221b61e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:34.107922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8b3a2-550e-4485-bc08-4676f221b61e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:34.109575 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8b3a2-550e-4485-bc08-4676f221b61e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:34.124235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-26f8b3a2-550e-4485-bc08-4676f221b61e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:34.124235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:34.124235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:34.124235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:34.124235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:34.124235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:34.124235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:34.124235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:34.124235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:34.124235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:34.124235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:34.124235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:34.124235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:34.124235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:34.124235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:34.125166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:34.126045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:34.126045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:34.126045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:34.126045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:34.126045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:34.126045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:34.126045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:34.126045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:34.126045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 391/801] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:34.127028 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34112d-e113-4d23-9077-9ce90f77e96c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:34.127483 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34112d-e113-4d23-9077-9ce90f77e96c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:34.127854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34112d-e113-4d23-9077-9ce90f77e96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:34.137709 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:34.147333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-5a34112d-e113-4d23-9077-9ce90f77e96c None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:34.148760 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5a34112d-e113-4d23-9077-9ce90f77e96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:34.192363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca3499-7920-42a7-8f47-4e16c61b8e50 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:34.217017 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 392/802] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:34.218302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6540c-8906-4d6b-9dcc-e85b70009206 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:34.218638 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6540c-8906-4d6b-9dcc-e85b70009206 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:34.218938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6540c-8906-4d6b-9dcc-e85b70009206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:34.236283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-29a6540c-8906-4d6b-9dcc-e85b70009206 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:34.237530 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-29a6540c-8906-4d6b-9dcc-e85b70009206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:34.239236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b31313-beb8-4945-8680-7eeb4e14abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:34.240474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b31313-beb8-4945-8680-7eeb4e14abcc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:34.240992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b31313-beb8-4945-8680-7eeb4e14abcc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:34.241434 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b31313-beb8-4945-8680-7eeb4e14abcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:34.252563 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b31313-beb8-4945-8680-7eeb4e14abcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:34.254497 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b31313-beb8-4945-8680-7eeb4e14abcc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:34.272648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-66b31313-beb8-4945-8680-7eeb4e14abcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:34.272648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:34.272648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:34.272648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:34.272648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:34.272648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:34.272648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:34.272648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:34.272648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:34.272648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:34.272648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:34.272648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:34.272648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:34.272648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:34.272648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:34.273653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:34.274548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:34.274548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:34.274548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:34.274548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:34.274548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 411/803] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:34.275741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b31313-beb8-4945-8680-7eeb4e14abcc None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:34.298438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:34.317086 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 393/804] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:34.318242 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6540c-8906-4d6b-9dcc-e85b70009206 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:34.388812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:34.392183 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b31313-beb8-4945-8680-7eeb4e14abcc None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:34.420420 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6540c-8906-4d6b-9dcc-e85b70009206 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:34.430293 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112a384-24e6-4bd4-9b7c-979264c44bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:34.430935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112a384-24e6-4bd4-9b7c-979264c44bdd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:34.431215 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112a384-24e6-4bd4-9b7c-979264c44bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:34.431486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112a384-24e6-4bd4-9b7c-979264c44bdd None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:34.432320 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112a384-24e6-4bd4-9b7c-979264c44bdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:34.432628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112a384-24e6-4bd4-9b7c-979264c44bdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:34.436473 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112a384-24e6-4bd4-9b7c-979264c44bdd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:34.452521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 412/805] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:34.452521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112a384-24e6-4bd4-9b7c-979264c44bdd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:34.467777 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaac1c-6b66-4a76-a83f-9c3d9f5be24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:34.468699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaac1c-6b66-4a76-a83f-9c3d9f5be24f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:34.469029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaac1c-6b66-4a76-a83f-9c3d9f5be24f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:34.469372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaac1c-6b66-4a76-a83f-9c3d9f5be24f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:34.470042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbaac1c-6b66-4a76-a83f-9c3d9f5be24f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:34.471675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbaac1c-6b66-4a76-a83f-9c3d9f5be24f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ddbaac1c-6b66-4a76-a83f-9c3d9f5be24f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:34.483942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:34.485057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:34.486355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 394/806] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Jul 21 08:17:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:34.487327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaac1c-6b66-4a76-a83f-9c3d9f5be24f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:34.540758 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:34.563952 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112a384-24e6-4bd4-9b7c-979264c44bdd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:34.593828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaac1c-6b66-4a76-a83f-9c3d9f5be24f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:34.599158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb12ce9-f306-4dc9-9cfa-65f3e99b56de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:34.599986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb12ce9-f306-4dc9-9cfa-65f3e99b56de None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:34.600357 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb12ce9-f306-4dc9-9cfa-65f3e99b56de None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:34.601162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb12ce9-f306-4dc9-9cfa-65f3e99b56de None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:34.601992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb12ce9-f306-4dc9-9cfa-65f3e99b56de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:34.602394 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb12ce9-f306-4dc9-9cfa-65f3e99b56de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:34.604646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb12ce9-f306-4dc9-9cfa-65f3e99b56de None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:34.621278 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 413/807] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:34.621278 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb12ce9-f306-4dc9-9cfa-65f3e99b56de None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:34.634441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b3ff0-56ad-4646-ac2a-78269fc5ff36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:34.635395 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b3ff0-56ad-4646-ac2a-78269fc5ff36 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:34.635721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b3ff0-56ad-4646-ac2a-78269fc5ff36 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:34.636042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b3ff0-56ad-4646-ac2a-78269fc5ff36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:34.639354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:34.649857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b3ff0-56ad-4646-ac2a-78269fc5ff36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-438b3ff0-56ad-4646-ac2a-78269fc5ff36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:34.658083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:34.659241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:34.665179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:34.665179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:34.665179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:34.665179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:34.665179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:34.665179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:34.665179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:34.665179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:34.665179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:34.665179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:34.665179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:17:34.665179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:34.665179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 395/808] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:17:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:34.665179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b3ff0-56ad-4646-ac2a-78269fc5ff36 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:34.729940 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb12ce9-f306-4dc9-9cfa-65f3e99b56de None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:34.767030 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b3ff0-56ad-4646-ac2a-78269fc5ff36 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:34.767974 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78ddd0-9589-4696-a19e-dca5b7322836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:34.769037 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78ddd0-9589-4696-a19e-dca5b7322836 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:34.769314 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78ddd0-9589-4696-a19e-dca5b7322836 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:34.769595 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78ddd0-9589-4696-a19e-dca5b7322836 None admin] PATH_INFO: `/v3/projects/784795960efb40e5811f778fff6fceb1/users/1898d568650f48a08a51b93cbd9359bc/roles/d6d1bb4d1d4d43f6985c2b90e85ca6a6` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:34.779085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:34.786894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78ddd0-9589-4696-a19e-dca5b7322836 None admin] RBAC: Authorizing `identity:create_grant(project_id=784795960efb40e5811f778fff6fceb1, user_id=1898d568650f48a08a51b93cbd9359bc, role_id=d6d1bb4d1d4d43f6985c2b90e85ca6a6)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:34.788389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78ddd0-9589-4696-a19e-dca5b7322836 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:34.801914 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 414/809] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:17:34 2022] PUT /identity/v3/projects/784795960efb40e5811f778fff6fceb1/users/1898d568650f48a08a51b93cbd9359bc/roles/d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:17:34.802709 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78ddd0-9589-4696-a19e-dca5b7322836 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:34.815239 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2b264-8916-47de-8099-3503871b88ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:34.816505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2b264-8916-47de-8099-3503871b88ce None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:34.816934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2b264-8916-47de-8099-3503871b88ce None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:34.817306 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2b264-8916-47de-8099-3503871b88ce None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:34.818142 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2b264-8916-47de-8099-3503871b88ce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:34.818582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2b264-8916-47de-8099-3503871b88ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:34.820260 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2b264-8916-47de-8099-3503871b88ce None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:34.826253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 396/810] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 21 08:17:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:34.827246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2b264-8916-47de-8099-3503871b88ce None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:34.905516 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:34.940623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2b264-8916-47de-8099-3503871b88ce None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:34.940870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78ddd0-9589-4696-a19e-dca5b7322836 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:34.979078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38427e90-1e7c-4e96-a2fc-bad23a83658e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:34.979381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c69d4b-9914-46a8-805e-3561a0571025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:34.980103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38427e90-1e7c-4e96-a2fc-bad23a83658e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:34.980202 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c69d4b-9914-46a8-805e-3561a0571025 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:34.980511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38427e90-1e7c-4e96-a2fc-bad23a83658e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:34.980621 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c69d4b-9914-46a8-805e-3561a0571025 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:34.980900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38427e90-1e7c-4e96-a2fc-bad23a83658e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:34.980988 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c69d4b-9914-46a8-805e-3561a0571025 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:34.981711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c69d4b-9914-46a8-805e-3561a0571025 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:34.982014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c69d4b-9914-46a8-805e-3561a0571025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:34.983442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c69d4b-9914-46a8-805e-3561a0571025 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:34.989147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38427e90-1e7c-4e96-a2fc-bad23a83658e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:34.990779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38427e90-1e7c-4e96-a2fc-bad23a83658e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:34.994820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 397/811] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:17:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:34.995720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c69d4b-9914-46a8-805e-3561a0571025 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:35.009839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-38427e90-1e7c-4e96-a2fc-bad23a83658e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:35.009839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:35.009839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:35.009839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:35.009839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:35.009839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:35.009839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:35.009839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:35.009839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:35.009839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:35.009839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:35.009839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:35.009839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:35.009839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:35.009839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:35.010770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:35.011979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:35.011979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:35.011979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:35.011979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:35.011979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:35.011979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:35.011979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:35.011979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:35.011979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 415/812] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:35.012792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a94f2-e6a0-4759-87a5-16679c5560fc None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:35.012934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a94f2-e6a0-4759-87a5-16679c5560fc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:35.013228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a94f2-e6a0-4759-87a5-16679c5560fc None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:35.014608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 416/813] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:35.015632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a94f2-e6a0-4759-87a5-16679c5560fc None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:35.039715 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:35.114782 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c69d4b-9914-46a8-805e-3561a0571025 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:35.125129 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a94f2-e6a0-4759-87a5-16679c5560fc None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:35.150211 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f92b1-f1c0-466c-9524-7e292bb6a124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:35.151322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f92b1-f1c0-466c-9524-7e292bb6a124 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:35.151736 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f92b1-f1c0-466c-9524-7e292bb6a124 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:35.152129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f92b1-f1c0-466c-9524-7e292bb6a124 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:35.152919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f92b1-f1c0-466c-9524-7e292bb6a124 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:35.153320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f92b1-f1c0-466c-9524-7e292bb6a124 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:35.154779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f92b1-f1c0-466c-9524-7e292bb6a124 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:35.156677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:35.166025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 398/814] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 21 08:17:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:35.166025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f92b1-f1c0-466c-9524-7e292bb6a124 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:35.168865 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d06ffa-b68f-4d40-b9d5-c4ccf7be4704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:35.169712 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d06ffa-b68f-4d40-b9d5-c4ccf7be4704 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:35.169957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d06ffa-b68f-4d40-b9d5-c4ccf7be4704 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:35.170253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d06ffa-b68f-4d40-b9d5-c4ccf7be4704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:35.184192 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d06ffa-b68f-4d40-b9d5-c4ccf7be4704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:35.185643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d06ffa-b68f-4d40-b9d5-c4ccf7be4704 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:35.203767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b2d06ffa-b68f-4d40-b9d5-c4ccf7be4704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:35.203767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:35.203767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:35.203767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:35.203767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:35.203767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:35.203767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:35.203767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:35.203767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:35.203767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:35.203767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:35.203767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:35.203767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:35.203767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:35.203767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:35.204704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:35.205724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:35.205724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:35.205724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:35.205724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:35.205724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 417/815] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:35.206858 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b9028-546b-4774-ba09-980db6e45e26 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:35.206858 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b9028-546b-4774-ba09-980db6e45e26 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:35.207109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b9028-546b-4774-ba09-980db6e45e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:35.224464 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6f3b9028-546b-4774-ba09-980db6e45e26 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:35.225654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6f3b9028-546b-4774-ba09-980db6e45e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:35.272970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:35.276467 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f92b1-f1c0-466c-9524-7e292bb6a124 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:35.298774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 418/816] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:35.299855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b9028-546b-4774-ba09-980db6e45e26 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:35.325943 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a6aa7-3714-433e-bf5d-5feff13bec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:35.326623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a6aa7-3714-433e-bf5d-5feff13bec9b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:35.327042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a6aa7-3714-433e-bf5d-5feff13bec9b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:35.327323 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a6aa7-3714-433e-bf5d-5feff13bec9b None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:35.328208 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a6aa7-3714-433e-bf5d-5feff13bec9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:35.328528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a6aa7-3714-433e-bf5d-5feff13bec9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:35.330046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a6aa7-3714-433e-bf5d-5feff13bec9b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:35.347194 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 399/817] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:35.347194 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a6aa7-3714-433e-bf5d-5feff13bec9b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:35.406887 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b9028-546b-4774-ba09-980db6e45e26 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:35.420751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:35.445019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e38756-ded3-4348-a65c-59a4ff74bf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:35.445702 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e38756-ded3-4348-a65c-59a4ff74bf8e None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:35.445986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e38756-ded3-4348-a65c-59a4ff74bf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:35.446262 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e38756-ded3-4348-a65c-59a4ff74bf8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:35.447272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e38756-ded3-4348-a65c-59a4ff74bf8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:35.448685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e38756-ded3-4348-a65c-59a4ff74bf8e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:35.457570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a6aa7-3714-433e-bf5d-5feff13bec9b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:35.479639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 419/818] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 08:17:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:35.479639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e38756-ded3-4348-a65c-59a4ff74bf8e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:35.518870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd7cbe-d940-4c7d-9c95-7659236b0732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:35.519647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7cbe-d940-4c7d-9c95-7659236b0732 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:35.519951 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7cbe-d940-4c7d-9c95-7659236b0732 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:35.520196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7cbe-d940-4c7d-9c95-7659236b0732 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:35.520960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd7cbe-d940-4c7d-9c95-7659236b0732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:35.521263 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd7cbe-d940-4c7d-9c95-7659236b0732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:35.523659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd7cbe-d940-4c7d-9c95-7659236b0732 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:35.542415 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 400/819] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:35.543631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd7cbe-d940-4c7d-9c95-7659236b0732 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:35.564055 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:35.607643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e38756-ded3-4348-a65c-59a4ff74bf8e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:35.646408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382cbf6-c006-4810-a6db-7ea4e45bd1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:35.647422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382cbf6-c006-4810-a6db-7ea4e45bd1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:35.647834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382cbf6-c006-4810-a6db-7ea4e45bd1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:35.648232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382cbf6-c006-4810-a6db-7ea4e45bd1d3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:35.648988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382cbf6-c006-4810-a6db-7ea4e45bd1d3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:35.650778 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382cbf6-c006-4810-a6db-7ea4e45bd1d3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:35.660563 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd7cbe-d940-4c7d-9c95-7659236b0732 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-6382cbf6-c006-4810-a6db-7ea4e45bd1d3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:35.663890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:35.665114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:35.666108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:35.666108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:35.666108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:35.666108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:35.666108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:35.666108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:35.666108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:35.666108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:35.666108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:35.666108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:35.666108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:35.666108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:35.666108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:17:35.666108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:35.666108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 420/820] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:35 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:35.668396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382cbf6-c006-4810-a6db-7ea4e45bd1d3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:35.712169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:35.713998 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ebb9d-721d-4c86-95ac-613d25d632d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:35.715479 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ebb9d-721d-4c86-95ac-613d25d632d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:35.715898 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ebb9d-721d-4c86-95ac-613d25d632d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:35.716185 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ebb9d-721d-4c86-95ac-613d25d632d2 None admin] PATH_INFO: `/v3/projects/784795960efb40e5811f778fff6fceb1/users/a8d7cfd6610a4df095daea14ecc37b21/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:35.719250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ebb9d-721d-4c86-95ac-613d25d632d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=784795960efb40e5811f778fff6fceb1, user_id=a8d7cfd6610a4df095daea14ecc37b21, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:35.720312 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ebb9d-721d-4c86-95ac-613d25d632d2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:35.743711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 401/821] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:17:35 2022] PUT /identity/v3/projects/784795960efb40e5811f778fff6fceb1/users/a8d7cfd6610a4df095daea14ecc37b21/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:17:35.746653 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ebb9d-721d-4c86-95ac-613d25d632d2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:35.838595 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382cbf6-c006-4810-a6db-7ea4e45bd1d3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:35.921977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec480fb-5ce5-40be-a43a-2dc490a22822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:35.923153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec480fb-5ce5-40be-a43a-2dc490a22822 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:35.923674 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec480fb-5ce5-40be-a43a-2dc490a22822 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:35.924180 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec480fb-5ce5-40be-a43a-2dc490a22822 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:35.940343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec480fb-5ce5-40be-a43a-2dc490a22822 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:35.941942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec480fb-5ce5-40be-a43a-2dc490a22822 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-3ec480fb-5ce5-40be-a43a-2dc490a22822 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:35.957759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:35.958938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:35.960107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:35.960107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:35.960107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:35.960107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:35.960107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:35.960107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:35.960107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:35.960107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:35.960107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:17:35.960107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:35.960107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 421/822] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 08:17:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:35.966522 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec480fb-5ce5-40be-a43a-2dc490a22822 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:35.994826 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:36.029027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ebb9d-721d-4c86-95ac-613d25d632d2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:36.095254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbc82f-3553-4a58-b863-ea437234faed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:36.096122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbc82f-3553-4a58-b863-ea437234faed None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:36.096409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbc82f-3553-4a58-b863-ea437234faed None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:36.096728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbc82f-3553-4a58-b863-ea437234faed None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:36.097454 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbc82f-3553-4a58-b863-ea437234faed None admin] RBAC: Adding query filter params (name=network) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:36.097759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbc82f-3553-4a58-b863-ea437234faed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:36.099205 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbc82f-3553-4a58-b863-ea437234faed None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:36.110728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 402/823] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 08:17:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:36.117202 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbc82f-3553-4a58-b863-ea437234faed None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:36.129250 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:36.143053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec480fb-5ce5-40be-a43a-2dc490a22822 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:36.212418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937ebb5-82b2-4a91-9a27-339a8de821ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:36.215619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937ebb5-82b2-4a91-9a27-339a8de821ee None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:36.215619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937ebb5-82b2-4a91-9a27-339a8de821ee None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:36.215619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937ebb5-82b2-4a91-9a27-339a8de821ee None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:36.215619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937ebb5-82b2-4a91-9a27-339a8de821ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:36.215619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937ebb5-82b2-4a91-9a27-339a8de821ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:36.216478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937ebb5-82b2-4a91-9a27-339a8de821ee None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:36.261849 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 422/824] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 08:17:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:36.267939 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937ebb5-82b2-4a91-9a27-339a8de821ee None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:36.284086 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbc82f-3553-4a58-b863-ea437234faed None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:36.321650 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232e6d0-c10b-4a22-9c65-41b24ff486fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:36.322384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232e6d0-c10b-4a22-9c65-41b24ff486fe None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:36.322670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232e6d0-c10b-4a22-9c65-41b24ff486fe None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:36.322990 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232e6d0-c10b-4a22-9c65-41b24ff486fe None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:36.323949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232e6d0-c10b-4a22-9c65-41b24ff486fe None admin] RBAC: Adding query filter params (type=network) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:36.324270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232e6d0-c10b-4a22-9c65-41b24ff486fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:36.325976 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232e6d0-c10b-4a22-9c65-41b24ff486fe None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:36.331862 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 403/825] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 08:17:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:36.337500 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232e6d0-c10b-4a22-9c65-41b24ff486fe None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:36.355953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:36.427912 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937ebb5-82b2-4a91-9a27-339a8de821ee None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:36.465705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ec212-3178-4b02-ae71-2bbd85d1923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:36.466302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ec212-3178-4b02-ae71-2bbd85d1923e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:36.466585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ec212-3178-4b02-ae71-2bbd85d1923e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:36.466860 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ec212-3178-4b02-ae71-2bbd85d1923e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:36.488137 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:36.543859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ec212-3178-4b02-ae71-2bbd85d1923e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:36.545329 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ec212-3178-4b02-ae71-2bbd85d1923e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:36.629113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232e6d0-c10b-4a22-9c65-41b24ff486fe None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:36.704233 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd211fb-c89e-4cb9-86e3-6f8d48932815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:36.704907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd211fb-c89e-4cb9-86e3-6f8d48932815 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:36.705187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd211fb-c89e-4cb9-86e3-6f8d48932815 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:36.705645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd211fb-c89e-4cb9-86e3-6f8d48932815 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:36.706404 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd211fb-c89e-4cb9-86e3-6f8d48932815 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:36.708707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd211fb-c89e-4cb9-86e3-6f8d48932815 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:36.743168 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 423/826] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:17:36.749777 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ec212-3178-4b02-ae71-2bbd85d1923e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:36.763703 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 404/827] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 08:17:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:36.812043 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:36.858027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ec212-3178-4b02-ae71-2bbd85d1923e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:36.916323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81858f-b608-4b4f-8a1b-a9aa2dcf89cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:36.917156 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81858f-b608-4b4f-8a1b-a9aa2dcf89cc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:36.917429 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81858f-b608-4b4f-8a1b-a9aa2dcf89cc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:36.917706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81858f-b608-4b4f-8a1b-a9aa2dcf89cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:36.929811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81858f-b608-4b4f-8a1b-a9aa2dcf89cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:36.931325 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81858f-b608-4b4f-8a1b-a9aa2dcf89cc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:37.086619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ca8a7-6107-4a80-b4a0-16d46241c966 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:37.086954 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ca8a7-6107-4a80-b4a0-16d46241c966 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:37.087220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ca8a7-6107-4a80-b4a0-16d46241c966 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:37.089236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 405/828] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:37.094165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586b045-2bb9-42c2-8121-93202ed8df82 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:37.094449 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586b045-2bb9-42c2-8121-93202ed8df82 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:37.094727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586b045-2bb9-42c2-8121-93202ed8df82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:37.101575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4c81858f-b608-4b4f-8a1b-a9aa2dcf89cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:37.101575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:37.101575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:37.101575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:37.101575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:37.101575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:37.101575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:37.101575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:37.101575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:37.101575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:37.101575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:37.101575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:37.101575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:37.101575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:37.101575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:37.102511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:37.104040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:37.104040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:37.104040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:37.104040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:37.107481 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 424/829] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:37.108748 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81858f-b608-4b4f-8a1b-a9aa2dcf89cc None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:37.116926 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8586b045-2bb9-42c2-8121-93202ed8df82 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:37.118409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8586b045-2bb9-42c2-8121-93202ed8df82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:37.191965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:37.200855 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 406/830] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:17:37.232887 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586b045-2bb9-42c2-8121-93202ed8df82 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:37.237223 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:37.242425 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81858f-b608-4b4f-8a1b-a9aa2dcf89cc None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:37.286512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dfa48-1bc1-4d3c-961f-14af2999ccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:37.287652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dfa48-1bc1-4d3c-961f-14af2999ccea None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:37.288154 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dfa48-1bc1-4d3c-961f-14af2999ccea None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:37.288619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dfa48-1bc1-4d3c-961f-14af2999ccea None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:37.289557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9dfa48-1bc1-4d3c-961f-14af2999ccea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:37.290058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9dfa48-1bc1-4d3c-961f-14af2999ccea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:37.291669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9dfa48-1bc1-4d3c-961f-14af2999ccea None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:37.304181 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 425/831] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:37.309895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dfa48-1bc1-4d3c-961f-14af2999ccea None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:37.348047 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586b045-2bb9-42c2-8121-93202ed8df82 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:37.383731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef92f1-7de9-4179-8a0c-e2e8531401fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:37.383965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef92f1-7de9-4179-8a0c-e2e8531401fc None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:37.384193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef92f1-7de9-4179-8a0c-e2e8531401fc None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:37.384422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef92f1-7de9-4179-8a0c-e2e8531401fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:37.395150 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef92f1-7de9-4179-8a0c-e2e8531401fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-dfef92f1-7de9-4179-8a0c-e2e8531401fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:37.403721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:37.404666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:37.405522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:37.405522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:37.405522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:37.405522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:37.405522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:37.405522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:37.405522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:37.405522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:37.405522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:37.405522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:37.405522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:17:37.405522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:37.405522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 407/832] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:17:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:37.411667 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef92f1-7de9-4179-8a0c-e2e8531401fc None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:37.420158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dfa48-1bc1-4d3c-961f-14af2999ccea None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:37.455030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9a4cf-1acb-40a2-bbdd-0a915d073988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:37.456487 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9a4cf-1acb-40a2-bbdd-0a915d073988 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:37.457194 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9a4cf-1acb-40a2-bbdd-0a915d073988 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:37.463642 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9a4cf-1acb-40a2-bbdd-0a915d073988 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:37.465423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9a4cf-1acb-40a2-bbdd-0a915d073988 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:37.467059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9a4cf-1acb-40a2-bbdd-0a915d073988 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:37.473989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:37.482663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9ef9a4cf-1acb-40a2-bbdd-0a915d073988 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:37.482663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:37.482663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:37.482663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:37.482663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:37.482663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:37.482663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:37.482663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:37.482663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:37.482663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:37.482663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:37.482663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:37.482663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:37.482663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:37.482663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:37.483876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:37.484995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:37.484995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:37.484995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:37.484995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:37.484995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:37.484995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:37.484995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:37.484995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:37.491591 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 426/833] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:37.492711 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9a4cf-1acb-40a2-bbdd-0a915d073988 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:37.512921 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:37.543414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef92f1-7de9-4179-8a0c-e2e8531401fc None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:37.588184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae4b51-7985-41f9-ab9a-9c2e28e9b4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:37.589342 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae4b51-7985-41f9-ab9a-9c2e28e9b4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:37.589644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae4b51-7985-41f9-ab9a-9c2e28e9b4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:37.589926 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae4b51-7985-41f9-ab9a-9c2e28e9b4f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:37.590698 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae4b51-7985-41f9-ab9a-9c2e28e9b4f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:37.591027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae4b51-7985-41f9-ab9a-9c2e28e9b4f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:37.592849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae4b51-7985-41f9-ab9a-9c2e28e9b4f5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:37.602844 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9a4cf-1acb-40a2-bbdd-0a915d073988 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:37.607670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 408/834] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:17:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:37.610406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae4b51-7985-41f9-ab9a-9c2e28e9b4f5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:37.644785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5739596-0db8-4fa6-8207-5e69b25b8a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:37.645457 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5739596-0db8-4fa6-8207-5e69b25b8a42 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:37.645821 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5739596-0db8-4fa6-8207-5e69b25b8a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:37.646012 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5739596-0db8-4fa6-8207-5e69b25b8a42 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:37.646826 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5739596-0db8-4fa6-8207-5e69b25b8a42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:37.647147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5739596-0db8-4fa6-8207-5e69b25b8a42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:37.648657 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5739596-0db8-4fa6-8207-5e69b25b8a42 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:37.666808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 427/835] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:37.668429 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5739596-0db8-4fa6-8207-5e69b25b8a42 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:37.751349 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae4b51-7985-41f9-ab9a-9c2e28e9b4f5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:37.757630 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:37.771352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:37.792907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5739596-0db8-4fa6-8207-5e69b25b8a42 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:37.795107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5ae4f-058e-45b2-8965-e06dc03985d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:37.796038 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5ae4f-058e-45b2-8965-e06dc03985d2 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:37.797047 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5ae4f-058e-45b2-8965-e06dc03985d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:37.797047 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5ae4f-058e-45b2-8965-e06dc03985d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:37.808442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5ae4f-058e-45b2-8965-e06dc03985d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:37.810055 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5ae4f-058e-45b2-8965-e06dc03985d2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:37.827983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-dfd5ae4f-058e-45b2-8965-e06dc03985d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:37.827983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:37.827983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:37.827983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:37.827983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:37.827983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:37.827983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:37.827983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:37.827983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:37.827983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:37.827983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:37.827983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:37.827983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:37.827983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:37.827983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:37.829126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:37.830278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:37.830278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:37.830278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:37.830278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:37.831808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 409/836] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:37.837858 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5ae4f-058e-45b2-8965-e06dc03985d2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:37.843729 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa04d82-dd69-423d-98f9-aeb173b01db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:37.844530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa04d82-dd69-423d-98f9-aeb173b01db9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:37.844906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa04d82-dd69-423d-98f9-aeb173b01db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:37.845274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa04d82-dd69-423d-98f9-aeb173b01db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:37.846541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa04d82-dd69-423d-98f9-aeb173b01db9 None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=131bb5462c8b478783a350d37caa76ae) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:37.846942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa04d82-dd69-423d-98f9-aeb173b01db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:37.848560 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa04d82-dd69-423d-98f9-aeb173b01db9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:37.861374 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 428/837] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:37 2022] GET /identity/v3/role_assignments?user.id=131bb5462c8b478783a350d37caa76ae&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:37.923648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ffdf6-d999-4741-816f-ca60e0882795 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:37.923648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ffdf6-d999-4741-816f-ca60e0882795 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:37.923648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ffdf6-d999-4741-816f-ca60e0882795 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:37.926082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 429/838] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:17:37.932002 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34736c-4c67-43f4-a79a-03a2a550fbe8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:37.932628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34736c-4c67-43f4-a79a-03a2a550fbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:37.933103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34736c-4c67-43f4-a79a-03a2a550fbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:37.952674 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ca34736c-4c67-43f4-a79a-03a2a550fbe8 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:37.953899 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ca34736c-4c67-43f4-a79a-03a2a550fbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:37.961860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5ae4f-058e-45b2-8965-e06dc03985d2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:37.998671 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed807f8-46e6-48e5-8300-0639f26945df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:37.999810 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed807f8-46e6-48e5-8300-0639f26945df None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:38.000295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed807f8-46e6-48e5-8300-0639f26945df None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:38.000769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed807f8-46e6-48e5-8300-0639f26945df None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:38.001706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed807f8-46e6-48e5-8300-0639f26945df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:38.002269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed807f8-46e6-48e5-8300-0639f26945df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:38.003953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed807f8-46e6-48e5-8300-0639f26945df None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:38.021864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 410/839] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:38.030161 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed807f8-46e6-48e5-8300-0639f26945df None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:38.041141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 430/840] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:17:38.047896 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b58ef-844e-4531-8c78-fea92f361832 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:38.048186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b58ef-844e-4531-8c78-fea92f361832 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:38.048474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b58ef-844e-4531-8c78-fea92f361832 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:38.050148 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 431/841] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:17:38.055228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e975e-d587-4b6e-a6e8-a3ab7a89653b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:38.055519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e975e-d587-4b6e-a6e8-a3ab7a89653b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:38.055839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e975e-d587-4b6e-a6e8-a3ab7a89653b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:38.063916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:38.074542 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-843e975e-d587-4b6e-a6e8-a3ab7a89653b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:38.075058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-843e975e-d587-4b6e-a6e8-a3ab7a89653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:38.146837 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed807f8-46e6-48e5-8300-0639f26945df None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:38.155723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 432/842] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:38.155723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e975e-d587-4b6e-a6e8-a3ab7a89653b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:38.160210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:38.186525 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b642caa-8dc0-42e8-9c14-18cd2f22465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:38.187350 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b642caa-8dc0-42e8-9c14-18cd2f22465a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:38.187681 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b642caa-8dc0-42e8-9c14-18cd2f22465a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:38.187958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b642caa-8dc0-42e8-9c14-18cd2f22465a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:38.195487 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b642caa-8dc0-42e8-9c14-18cd2f22465a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:38.196975 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b642caa-8dc0-42e8-9c14-18cd2f22465a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-0b642caa-8dc0-42e8-9c14-18cd2f22465a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:38.212805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:38.214035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:38.214955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:38.214955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:38.214955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:38.214955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:38.214955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:38.214955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:38.214955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:38.214955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:38.214955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:17:38.214955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:38.214955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 411/843] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 08:17:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:38.215543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b642caa-8dc0-42e8-9c14-18cd2f22465a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:38.271744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e975e-d587-4b6e-a6e8-a3ab7a89653b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:38.303389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:38.310402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f713e-9c4d-4060-a1fe-37720a9c680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:38.311227 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f713e-9c4d-4060-a1fe-37720a9c680e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:38.311512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f713e-9c4d-4060-a1fe-37720a9c680e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:38.311824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f713e-9c4d-4060-a1fe-37720a9c680e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:38.312879 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f713e-9c4d-4060-a1fe-37720a9c680e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:38.314262 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f713e-9c4d-4060-a1fe-37720a9c680e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:38.321387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b642caa-8dc0-42e8-9c14-18cd2f22465a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-d74f713e-9c4d-4060-a1fe-37720a9c680e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:38.326523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:38.327486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:38.328386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:38.328386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:38.328386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:38.328386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:38.328386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:38.328386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:38.328386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:38.328386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:38.328386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:38.328386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:38.328386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:38.328386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:38.328386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:17:38.328386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:38.328386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 433/844] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:17:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:38.329177 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f713e-9c4d-4060-a1fe-37720a9c680e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:38.364739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84b1a1-85be-464a-8836-ffc7b4bc63d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:38.365550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b1a1-85be-464a-8836-ffc7b4bc63d0 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:38.365829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b1a1-85be-464a-8836-ffc7b4bc63d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:38.366098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b1a1-85be-464a-8836-ffc7b4bc63d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:38.376582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84b1a1-85be-464a-8836-ffc7b4bc63d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-af84b1a1-85be-464a-8836-ffc7b4bc63d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:38.384156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:38.385302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:38.386158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:38.386158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:38.386158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:38.386158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:38.386158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:38.386158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:38.386158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:38.386158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:38.386158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:38.386158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:38.386158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:17:38.386158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:38.391626 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 412/845] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:17:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:38.391626 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84b1a1-85be-464a-8836-ffc7b4bc63d0 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:38.408333 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:38.455517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f713e-9c4d-4060-a1fe-37720a9c680e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:38.495128 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1ae0f-82be-46b4-8425-84d0f6e59574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:38.495831 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1ae0f-82be-46b4-8425-84d0f6e59574 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:38.496113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1ae0f-82be-46b4-8425-84d0f6e59574 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:38.496387 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1ae0f-82be-46b4-8425-84d0f6e59574 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:38.497274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1ae0f-82be-46b4-8425-84d0f6e59574 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:38.497585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1ae0f-82be-46b4-8425-84d0f6e59574 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:38.499037 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1ae0f-82be-46b4-8425-84d0f6e59574 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:38.502808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84b1a1-85be-464a-8836-ffc7b4bc63d0 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:38.516828 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 434/846] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 21 08:17:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:38.517649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1ae0f-82be-46b4-8425-84d0f6e59574 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:38.544470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a4620-471d-4c5c-8984-fd9249518b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:38.545186 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a4620-471d-4c5c-8984-fd9249518b12 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:38.545481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a4620-471d-4c5c-8984-fd9249518b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:38.545751 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a4620-471d-4c5c-8984-fd9249518b12 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:38.546471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a4620-471d-4c5c-8984-fd9249518b12 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:38.546888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a4620-471d-4c5c-8984-fd9249518b12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:38.548454 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a4620-471d-4c5c-8984-fd9249518b12 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:38.558822 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 413/847] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:17:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:38.559568 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a4620-471d-4c5c-8984-fd9249518b12 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:38.571360 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:38.621726 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1ae0f-82be-46b4-8425-84d0f6e59574 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:38.650839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:38.664480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1b7eb-a3de-4887-8ef4-fe0e6490c426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:38.664652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a4620-471d-4c5c-8984-fd9249518b12 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:38.665097 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1b7eb-a3de-4887-8ef4-fe0e6490c426 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:38.665429 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1b7eb-a3de-4887-8ef4-fe0e6490c426 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:38.665712 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1b7eb-a3de-4887-8ef4-fe0e6490c426 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:38.667343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1b7eb-a3de-4887-8ef4-fe0e6490c426 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:38.667343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1b7eb-a3de-4887-8ef4-fe0e6490c426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:38.668447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1b7eb-a3de-4887-8ef4-fe0e6490c426 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:38.678142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 435/848] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:17:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:38.678969 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1b7eb-a3de-4887-8ef4-fe0e6490c426 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:38.704297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e9e8a-7e7b-48ea-8fba-2a9432b3b785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:38.705189 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e9e8a-7e7b-48ea-8fba-2a9432b3b785 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:38.705527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e9e8a-7e7b-48ea-8fba-2a9432b3b785 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:38.705790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e9e8a-7e7b-48ea-8fba-2a9432b3b785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:38.775935 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e9e8a-7e7b-48ea-8fba-2a9432b3b785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:38.777643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e9e8a-7e7b-48ea-8fba-2a9432b3b785 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:38.785271 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1b7eb-a3de-4887-8ef4-fe0e6490c426 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:38.788437 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:38.820416 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37866986-f78b-4b3d-bfa3-851bcc7553a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:38.821103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37866986-f78b-4b3d-bfa3-851bcc7553a3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:38.821368 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37866986-f78b-4b3d-bfa3-851bcc7553a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:38.821721 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37866986-f78b-4b3d-bfa3-851bcc7553a3 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:38.822338 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37866986-f78b-4b3d-bfa3-851bcc7553a3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:38.822657 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37866986-f78b-4b3d-bfa3-851bcc7553a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:38.824149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37866986-f78b-4b3d-bfa3-851bcc7553a3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:38.839631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 436/849] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:17:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:38.839631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37866986-f78b-4b3d-bfa3-851bcc7553a3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:38.909794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 414/850] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:38 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:17:38.910696 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:38.912646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e9e8a-7e7b-48ea-8fba-2a9432b3b785 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:38.986390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37866986-f78b-4b3d-bfa3-851bcc7553a3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:39.028219 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f9879-346d-4a34-a07f-69ba12c7c67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:39.029043 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f9879-346d-4a34-a07f-69ba12c7c67d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:39.029323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f9879-346d-4a34-a07f-69ba12c7c67d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:39.029598 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f9879-346d-4a34-a07f-69ba12c7c67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:39.032438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e9e8a-7e7b-48ea-8fba-2a9432b3b785 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:39.041726 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f9879-346d-4a34-a07f-69ba12c7c67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:39.047648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f9879-346d-4a34-a07f-69ba12c7c67d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:39.048788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:39.072850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba044d-a8f2-46fc-8c36-414321259d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:39.073649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba044d-a8f2-46fc-8c36-414321259d49 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:39.073863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-554f9879-346d-4a34-a07f-69ba12c7c67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:39.073863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:39.073863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:39.073863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:39.073863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:39.073863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:39.073863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:39.073863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:39.073863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:39.073863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:39.073863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:39.073863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:39.073863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:39.073863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:39.073863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:39.074942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:39.076059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:39.076059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:39.076059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:39.076059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:39.076286 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba044d-a8f2-46fc-8c36-414321259d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:39.076286 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba044d-a8f2-46fc-8c36-414321259d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:39.077145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 437/851] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:39.083679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f9879-346d-4a34-a07f-69ba12c7c67d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:39.093742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba044d-a8f2-46fc-8c36-414321259d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:39.096106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba044d-a8f2-46fc-8c36-414321259d49 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:39.117190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-62ba044d-a8f2-46fc-8c36-414321259d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:39.117190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:39.117190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:39.117190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:39.117190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:39.117190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:39.117190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:39.117190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:39.117190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:39.117190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:39.117190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:39.117190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:39.117190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:39.117190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:39.117190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:39.118146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:39.119063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:39.119063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:39.119063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:39.119063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:39.121162 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 415/852] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:39.128245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba044d-a8f2-46fc-8c36-414321259d49 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:39.208241 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f9879-346d-4a34-a07f-69ba12c7c67d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:39.210755 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:39.238831 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba044d-a8f2-46fc-8c36-414321259d49 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:39.250985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e89df-b46f-4855-b860-ba405f7973f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:39.251902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e89df-b46f-4855-b860-ba405f7973f9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:39.252030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e89df-b46f-4855-b860-ba405f7973f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:39.252246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e89df-b46f-4855-b860-ba405f7973f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:39.252971 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e89df-b46f-4855-b860-ba405f7973f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:39.253272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e89df-b46f-4855-b860-ba405f7973f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:39.254651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e89df-b46f-4855-b860-ba405f7973f9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:39.271087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 438/853] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:39.272450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e89df-b46f-4855-b860-ba405f7973f9 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:39.283473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996a18c-55d7-45c2-8627-4a38f9d350b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:39.284922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996a18c-55d7-45c2-8627-4a38f9d350b7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:39.285359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996a18c-55d7-45c2-8627-4a38f9d350b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:39.286213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996a18c-55d7-45c2-8627-4a38f9d350b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:39.287443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996a18c-55d7-45c2-8627-4a38f9d350b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:39.287932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996a18c-55d7-45c2-8627-4a38f9d350b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:39.290188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996a18c-55d7-45c2-8627-4a38f9d350b7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:39.309360 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 416/854] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:39.310492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996a18c-55d7-45c2-8627-4a38f9d350b7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:39.336207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:39.378151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e89df-b46f-4855-b860-ba405f7973f9 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:39.414102 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20e97f-f996-4224-a315-7ad9ad1a0f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:39.415175 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20e97f-f996-4224-a315-7ad9ad1a0f0a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:39.415523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20e97f-f996-4224-a315-7ad9ad1a0f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:39.415825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20e97f-f996-4224-a315-7ad9ad1a0f0a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:39.420602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996a18c-55d7-45c2-8627-4a38f9d350b7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:39.424336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20e97f-f996-4224-a315-7ad9ad1a0f0a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:39.425602 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20e97f-f996-4224-a315-7ad9ad1a0f0a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-3f20e97f-f996-4224-a315-7ad9ad1a0f0a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:39.446031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:39.447060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:39.448046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:39.448046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:39.448046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:39.448046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:39.448046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:39.448046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:39.448046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:39.448046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:39.448046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:17:39.448046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:39.455315 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 439/855] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:17:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:39.456319 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20e97f-f996-4224-a315-7ad9ad1a0f0a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:39.463050 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ebce4-f30f-4860-880d-cd237c822533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:39.464137 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ebce4-f30f-4860-880d-cd237c822533 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:39.464659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ebce4-f30f-4860-880d-cd237c822533 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:39.465148 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ebce4-f30f-4860-880d-cd237c822533 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:39.473229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ebce4-f30f-4860-880d-cd237c822533 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:39.475037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ebce4-f30f-4860-880d-cd237c822533 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:39.481570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:39.491804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-d10ebce4-f30f-4860-880d-cd237c822533 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:39.491804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:39.491804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:39.491804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:39.491804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:39.491804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:39.491804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:39.491804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:39.491804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:39.491804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:39.491804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:39.491804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:39.491804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:39.491804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:39.491804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:39.492732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:39.493607 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:39.493607 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:39.493607 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:39.493607 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:39.493607 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:39.493607 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:39.493607 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:39.493607 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:39.501024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 417/856] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:39.502710 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ebce4-f30f-4860-880d-cd237c822533 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:39.559708 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20e97f-f996-4224-a315-7ad9ad1a0f0a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:39.592642 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:39.596884 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bda9ab-1db3-4e17-b618-f117ea3e6c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:39.597604 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bda9ab-1db3-4e17-b618-f117ea3e6c88 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:39.597881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bda9ab-1db3-4e17-b618-f117ea3e6c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:39.598152 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bda9ab-1db3-4e17-b618-f117ea3e6c88 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:39.599590 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bda9ab-1db3-4e17-b618-f117ea3e6c88 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:39.600170 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bda9ab-1db3-4e17-b618-f117ea3e6c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:39.601483 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bda9ab-1db3-4e17-b618-f117ea3e6c88 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:39.616111 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ebce4-f30f-4860-880d-cd237c822533 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:39.625467 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 440/857] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 21 08:17:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:39.626880 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bda9ab-1db3-4e17-b618-f117ea3e6c88 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:39.654171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bd88e-bc7c-4503-bd5a-07f271db1d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:39.655254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bd88e-bc7c-4503-bd5a-07f271db1d22 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:39.655869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bd88e-bc7c-4503-bd5a-07f271db1d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:39.656430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bd88e-bc7c-4503-bd5a-07f271db1d22 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:39.657446 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bd88e-bc7c-4503-bd5a-07f271db1d22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:39.657953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bd88e-bc7c-4503-bd5a-07f271db1d22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:39.659868 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bd88e-bc7c-4503-bd5a-07f271db1d22 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:39.678775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 418/858] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:39.680154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bd88e-bc7c-4503-bd5a-07f271db1d22 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:39.711957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:39.733606 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bda9ab-1db3-4e17-b618-f117ea3e6c88 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:39.769550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4cd3c-c410-4971-9a52-d53cf60fd7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:39.770125 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4cd3c-c410-4971-9a52-d53cf60fd7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:39.770405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4cd3c-c410-4971-9a52-d53cf60fd7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:39.770676 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4cd3c-c410-4971-9a52-d53cf60fd7a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:39.793657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bd88e-bc7c-4503-bd5a-07f271db1d22 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:39.830646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6769a6-dd59-449f-941e-537ca0108343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:39.831991 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6769a6-dd59-449f-941e-537ca0108343 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:39.832481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6769a6-dd59-449f-941e-537ca0108343 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:39.832992 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6769a6-dd59-449f-941e-537ca0108343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:39.834132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6769a6-dd59-449f-941e-537ca0108343 None admin] RBAC: Adding query filter params (role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=1898d568650f48a08a51b93cbd9359bc) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:39.834675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6769a6-dd59-449f-941e-537ca0108343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:39.836447 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6769a6-dd59-449f-941e-537ca0108343 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:39.841655 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4cd3c-c410-4971-9a52-d53cf60fd7a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:39.843115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4cd3c-c410-4971-9a52-d53cf60fd7a1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:39.849311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 419/859] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:39 2022] GET /identity/v3/role_assignments?user.id=1898d568650f48a08a51b93cbd9359bc&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:39.935721 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:39.963725 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 441/860] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:39 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 08:17:39.965496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6769a6-dd59-449f-941e-537ca0108343 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:39.971546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:39.999668 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26d74c-9b3d-4952-8e19-db3c46dfef39 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:40.000023 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26d74c-9b3d-4952-8e19-db3c46dfef39 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:40.000222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26d74c-9b3d-4952-8e19-db3c46dfef39 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:40.001662 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 442/861] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:17:40.007968 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4be8ac-8536-4ff8-9908-4ad1ea3e5402 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:40.008257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4be8ac-8536-4ff8-9908-4ad1ea3e5402 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:40.008512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4be8ac-8536-4ff8-9908-4ad1ea3e5402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:40.029487 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-da4be8ac-8536-4ff8-9908-4ad1ea3e5402 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:40.030646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-da4be8ac-8536-4ff8-9908-4ad1ea3e5402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:40.104438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6769a6-dd59-449f-941e-537ca0108343 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:40.126256 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 443/862] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:40.145239 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc649236-a751-406c-9234-1f85488b3e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:40.146026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc649236-a751-406c-9234-1f85488b3e1b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:40.146380 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc649236-a751-406c-9234-1f85488b3e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:40.146591 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc649236-a751-406c-9234-1f85488b3e1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:40.149815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4be8ac-8536-4ff8-9908-4ad1ea3e5402 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:40.163058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc649236-a751-406c-9234-1f85488b3e1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:40.164857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc649236-a751-406c-9234-1f85488b3e1b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:40.182400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-cc649236-a751-406c-9234-1f85488b3e1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:40.182400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:40.182400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:40.182400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:40.182400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:40.182400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:40.182400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:40.182400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:40.182400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:40.182400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:40.182400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:40.182400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:40.182400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:40.182400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:40.182400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:40.183522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:40.184863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:40.184863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:40.184863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:40.184863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:40.184863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 420/863] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:40.189250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc649236-a751-406c-9234-1f85488b3e1b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:40.263451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:40.273076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4be8ac-8536-4ff8-9908-4ad1ea3e5402 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:40.286228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:40.312905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4552b5-3b96-47dd-86e3-1277451a7ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:40.313921 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4552b5-3b96-47dd-86e3-1277451a7ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:40.314266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4552b5-3b96-47dd-86e3-1277451a7ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:40.314685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4552b5-3b96-47dd-86e3-1277451a7ef4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:40.316099 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4552b5-3b96-47dd-86e3-1277451a7ef4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:40.317624 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4552b5-3b96-47dd-86e3-1277451a7ef4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:40.318803 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc649236-a751-406c-9234-1f85488b3e1b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-df4552b5-3b96-47dd-86e3-1277451a7ef4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:40.331287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:40.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:40.333582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:40.333582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:40.333582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:40.333582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:40.333582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:40.333582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:40.333582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:40.333582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:40.333582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:40.333582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:40.333582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:40.333582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:40.333582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:40.333582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:17:40.333582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:40.334946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 444/864] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Jul 21 08:17:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:40.341066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4552b5-3b96-47dd-86e3-1277451a7ef4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:40.357232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71019882-fe87-46b4-b1f3-6c531279b206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:40.357902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71019882-fe87-46b4-b1f3-6c531279b206 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:40.358183 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71019882-fe87-46b4-b1f3-6c531279b206 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:40.358756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71019882-fe87-46b4-b1f3-6c531279b206 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:40.359499 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71019882-fe87-46b4-b1f3-6c531279b206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:40.360284 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71019882-fe87-46b4-b1f3-6c531279b206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:40.362113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71019882-fe87-46b4-b1f3-6c531279b206 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:40.384725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 421/865] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:40.385650 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71019882-fe87-46b4-b1f3-6c531279b206 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:40.466644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4552b5-3b96-47dd-86e3-1277451a7ef4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:40.488850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71019882-fe87-46b4-b1f3-6c531279b206 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:40.510133 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:40.511917 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf27e59-180d-4732-a620-00477a82c5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:40.512744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf27e59-180d-4732-a620-00477a82c5ba None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:40.513033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf27e59-180d-4732-a620-00477a82c5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:40.513314 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf27e59-180d-4732-a620-00477a82c5ba None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:40.514034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf27e59-180d-4732-a620-00477a82c5ba None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:40.515969 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf27e59-180d-4732-a620-00477a82c5ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:40.515969 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf27e59-180d-4732-a620-00477a82c5ba None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:40.522600 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 445/866] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 08:17:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:40.529098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf27e59-180d-4732-a620-00477a82c5ba None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:40.538045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483410a8-db24-4862-bd35-7c6b09da1890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:40.538829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483410a8-db24-4862-bd35-7c6b09da1890 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:40.539106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483410a8-db24-4862-bd35-7c6b09da1890 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:40.539431 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483410a8-db24-4862-bd35-7c6b09da1890 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:40.546914 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483410a8-db24-4862-bd35-7c6b09da1890 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:40.548406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483410a8-db24-4862-bd35-7c6b09da1890 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:40.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-483410a8-db24-4862-bd35-7c6b09da1890 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:40.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:40.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:40.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:40.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:40.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:40.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:40.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:40.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:40.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:40.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:40.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:40.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:40.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:40.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:40.564451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:40.565966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:40.565966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:40.565966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:40.565966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:40.565966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:40.565966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:40.565966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:40.565966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:40.565966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 422/867] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:40.570496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483410a8-db24-4862-bd35-7c6b09da1890 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:40.582682 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:40.676456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf27e59-180d-4732-a620-00477a82c5ba None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:40.679608 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483410a8-db24-4862-bd35-7c6b09da1890 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:40.715412 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cd2ce-f2b8-40fd-a775-488a5a66c98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:40.716237 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cd2ce-f2b8-40fd-a775-488a5a66c98c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:40.716579 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cd2ce-f2b8-40fd-a775-488a5a66c98c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:40.716947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cd2ce-f2b8-40fd-a775-488a5a66c98c None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:40.717821 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cd2ce-f2b8-40fd-a775-488a5a66c98c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:40.718156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cd2ce-f2b8-40fd-a775-488a5a66c98c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:40.719756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cd2ce-f2b8-40fd-a775-488a5a66c98c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:40.722918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2523c-527d-435c-8437-b722070ec4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:40.723863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2523c-527d-435c-8437-b722070ec4df None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:40.724316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2523c-527d-435c-8437-b722070ec4df None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:40.724779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2523c-527d-435c-8437-b722070ec4df None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:40.725660 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2523c-527d-435c-8437-b722070ec4df None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:40.726131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2523c-527d-435c-8437-b722070ec4df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:40.727712 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2523c-527d-435c-8437-b722070ec4df None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:40.738903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 446/868] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 08:17:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:40.739557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 423/869] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:40.740552 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2523c-527d-435c-8437-b722070ec4df None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:40.854613 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2523c-527d-435c-8437-b722070ec4df None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:40.856937 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:40.893263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab234ca3-3262-49e7-a6a3-44f42172ec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:40.894125 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab234ca3-3262-49e7-a6a3-44f42172ec6d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:40.894405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab234ca3-3262-49e7-a6a3-44f42172ec6d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:40.894677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab234ca3-3262-49e7-a6a3-44f42172ec6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:40.895531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab234ca3-3262-49e7-a6a3-44f42172ec6d None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=a8d7cfd6610a4df095daea14ecc37b21) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:40.895872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab234ca3-3262-49e7-a6a3-44f42172ec6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:40.897336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab234ca3-3262-49e7-a6a3-44f42172ec6d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:40.905070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 447/870] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:40 2022] GET /identity/v3/role_assignments?user.id=a8d7cfd6610a4df095daea14ecc37b21&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:40.922769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24423664-f1aa-428e-8fa0-f7debafc039c None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:40.923150 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24423664-f1aa-428e-8fa0-f7debafc039c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:40.923309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24423664-f1aa-428e-8fa0-f7debafc039c None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:40.925788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 424/871] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:40.935392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a95c8-ecea-4acd-ac44-b5f03f58effe None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:40.935392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a95c8-ecea-4acd-ac44-b5f03f58effe None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:40.935895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a95c8-ecea-4acd-ac44-b5f03f58effe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:40.957124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f01a95c8-ecea-4acd-ac44-b5f03f58effe None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:40.958343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f01a95c8-ecea-4acd-ac44-b5f03f58effe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:41.034707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 448/872] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:41.058499 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24423664-f1aa-428e-8fa0-f7debafc039c None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:41.100849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:41.186066 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24423664-f1aa-428e-8fa0-f7debafc039c None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:41.222600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b6dbe-2dfd-49a5-a9c8-2f3f057c6b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:41.223323 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b6dbe-2dfd-49a5-a9c8-2f3f057c6b5d None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:41.223631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b6dbe-2dfd-49a5-a9c8-2f3f057c6b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:41.223909 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b6dbe-2dfd-49a5-a9c8-2f3f057c6b5d None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:41.224654 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b6dbe-2dfd-49a5-a9c8-2f3f057c6b5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:41.226038 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b6dbe-2dfd-49a5-a9c8-2f3f057c6b5d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:41.242106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 425/873] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 08:17:41 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:42.097958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168a4c4-c78a-4c27-91d6-87170bef8389 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:42.098513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168a4c4-c78a-4c27-91d6-87170bef8389 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:42.098513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168a4c4-c78a-4c27-91d6-87170bef8389 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:42.100343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 449/874] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:42.106022 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdf65d-dcb8-4939-bd71-e00a977dbe6a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:42.106557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdf65d-dcb8-4939-bd71-e00a977dbe6a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:42.106557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdf65d-dcb8-4939-bd71-e00a977dbe6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:42.125172 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-dbcdf65d-dcb8-4939-bd71-e00a977dbe6a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:42.126376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-dbcdf65d-dcb8-4939-bd71-e00a977dbe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:42.205325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 426/875] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:42 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:42.228572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168a4c4-c78a-4c27-91d6-87170bef8389 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:42.326229 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:42.334408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168a4c4-c78a-4c27-91d6-87170bef8389 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:42.369018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8351b73-f213-493e-8d82-2a92f081b750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:42.369775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8351b73-f213-493e-8d82-2a92f081b750 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:42.370053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8351b73-f213-493e-8d82-2a92f081b750 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:42.370367 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8351b73-f213-493e-8d82-2a92f081b750 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:42.381352 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8351b73-f213-493e-8d82-2a92f081b750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a8351b73-f213-493e-8d82-2a92f081b750 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:42.389461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:42.390389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:42.391687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:42.391687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:42.391687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:42.391687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:42.391687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:42.391687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:42.391687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:42.391687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:42.391687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:42.391687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:42.391687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:17:42.391687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:42.391687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 450/876] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 21 08:17:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:42.397349 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdf65d-dcb8-4939-bd71-e00a977dbe6a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:42.422514 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:42.519565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdf65d-dcb8-4939-bd71-e00a977dbe6a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:42.559498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8c581-ca88-4a79-9e58-39c021fad677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:42.560215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8c581-ca88-4a79-9e58-39c021fad677 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:42.560494 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8c581-ca88-4a79-9e58-39c021fad677 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:42.560765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8c581-ca88-4a79-9e58-39c021fad677 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:42.561535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8c581-ca88-4a79-9e58-39c021fad677 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:42.561842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8c581-ca88-4a79-9e58-39c021fad677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:42.563219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8c581-ca88-4a79-9e58-39c021fad677 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:42.572000 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 427/877] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 21 08:17:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:42.577335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8351b73-f213-493e-8d82-2a92f081b750 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:42.680841 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8351b73-f213-493e-8d82-2a92f081b750 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:42.715851 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffd95d-cd0b-4a8d-8b5d-c4a350bc35e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:42.716938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffd95d-cd0b-4a8d-8b5d-c4a350bc35e4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:42.717422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffd95d-cd0b-4a8d-8b5d-c4a350bc35e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:42.717880 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffd95d-cd0b-4a8d-8b5d-c4a350bc35e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:42.737882 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffd95d-cd0b-4a8d-8b5d-c4a350bc35e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:42.739588 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffd95d-cd0b-4a8d-8b5d-c4a350bc35e4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:42.757599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-5bffd95d-cd0b-4a8d-8b5d-c4a350bc35e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:42.757599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:42.757599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:42.757599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:42.757599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:42.757599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:42.757599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:42.757599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:42.757599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:42.757599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:42.757599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:42.757599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:42.757599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:42.757599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:42.757599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:42.758734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:42.759866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:42.759866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:42.759866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:42.759866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:42.761976 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 451/878] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:42.768026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8c581-ca88-4a79-9e58-39c021fad677 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:42.855496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:42.871892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aee4e6-5ba4-4970-b54c-1aabecc0ba1a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:42.872123 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8c581-ca88-4a79-9e58-39c021fad677 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:42.872208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aee4e6-5ba4-4970-b54c-1aabecc0ba1a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:42.872426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aee4e6-5ba4-4970-b54c-1aabecc0ba1a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:42.874041 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 452/879] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:17:42.879492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ca9ed-cf3b-4f83-b456-e5d0f3ee0762 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:42.879799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ca9ed-cf3b-4f83-b456-e5d0f3ee0762 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:42.880073 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ca9ed-cf3b-4f83-b456-e5d0f3ee0762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:42.899497 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-670ca9ed-cf3b-4f83-b456-e5d0f3ee0762 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:42.901298 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-670ca9ed-cf3b-4f83-b456-e5d0f3ee0762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:42.905242 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:42.907967 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa546fa9-eff3-41ed-a45c-a4fbff93513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:42.909002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa546fa9-eff3-41ed-a45c-a4fbff93513f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:42.909504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa546fa9-eff3-41ed-a45c-a4fbff93513f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:42.909983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa546fa9-eff3-41ed-a45c-a4fbff93513f None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:42.910901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa546fa9-eff3-41ed-a45c-a4fbff93513f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:42.911394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa546fa9-eff3-41ed-a45c-a4fbff93513f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:42.913017 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa546fa9-eff3-41ed-a45c-a4fbff93513f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:42.926936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 428/880] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:42.936833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa546fa9-eff3-41ed-a45c-a4fbff93513f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:42.987639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 453/881] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:42 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:17:43.008729 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ca9ed-cf3b-4f83-b456-e5d0f3ee0762 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:43.069992 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa546fa9-eff3-41ed-a45c-a4fbff93513f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:43.108233 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dad42c-9011-4814-a9f9-e9c17415dba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:43.109973 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dad42c-9011-4814-a9f9-e9c17415dba8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:43.110444 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dad42c-9011-4814-a9f9-e9c17415dba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:43.110935 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dad42c-9011-4814-a9f9-e9c17415dba8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:43.119711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dad42c-9011-4814-a9f9-e9c17415dba8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:43.121514 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dad42c-9011-4814-a9f9-e9c17415dba8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:43.133231 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ca9ed-cf3b-4f83-b456-e5d0f3ee0762 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-91dad42c-9011-4814-a9f9-e9c17415dba8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:43.139042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:43.140191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:43.141122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:43.141122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:43.141122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:43.141122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:43.141122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:43.141122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:43.141122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:43.141122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:43.141122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:17:43.141122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:43.143831 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 429/882] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 08:17:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:43.150862 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dad42c-9011-4814-a9f9-e9c17415dba8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:43.162074 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:43.176731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234d9cf-22b2-4c02-8a42-7010b2e9b600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:43.177434 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234d9cf-22b2-4c02-8a42-7010b2e9b600 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:43.177710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234d9cf-22b2-4c02-8a42-7010b2e9b600 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:43.177993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234d9cf-22b2-4c02-8a42-7010b2e9b600 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:43.178748 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234d9cf-22b2-4c02-8a42-7010b2e9b600 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:43.180192 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234d9cf-22b2-4c02-8a42-7010b2e9b600 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:43.192080 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:43.200483 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 454/883] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 08:17:43 2022] POST /identity/v3/services => generated 269 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:17:43.202274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c59422-db6d-43cf-b7f3-215d448556db None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:43.202649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c59422-db6d-43cf-b7f3-215d448556db None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:43.203153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c59422-db6d-43cf-b7f3-215d448556db None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:43.205388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 455/884] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:43.212141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba392726-0e95-40be-9bb4-d0b64a81f00f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:43.212560 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba392726-0e95-40be-9bb4-d0b64a81f00f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:43.212918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba392726-0e95-40be-9bb4-d0b64a81f00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:43.237261 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ba392726-0e95-40be-9bb4-d0b64a81f00f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:43.238806 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ba392726-0e95-40be-9bb4-d0b64a81f00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:43.270369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dad42c-9011-4814-a9f9-e9c17415dba8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:43.316656 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbc12c-40e9-4a29-9e25-33c9cb5a9ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:43.317788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbc12c-40e9-4a29-9e25-33c9cb5a9ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:43.318241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbc12c-40e9-4a29-9e25-33c9cb5a9ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:43.318682 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbc12c-40e9-4a29-9e25-33c9cb5a9ff5 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:43.319755 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbc12c-40e9-4a29-9e25-33c9cb5a9ff5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:43.320238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbc12c-40e9-4a29-9e25-33c9cb5a9ff5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:43.321996 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbc12c-40e9-4a29-9e25-33c9cb5a9ff5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:43.338030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 456/885] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:43.346688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 430/886] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 21 08:17:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:43.355650 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba392726-0e95-40be-9bb4-d0b64a81f00f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:43.361969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbc12c-40e9-4a29-9e25-33c9cb5a9ff5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:43.435343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:43.470055 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba392726-0e95-40be-9bb4-d0b64a81f00f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:43.486999 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbc12c-40e9-4a29-9e25-33c9cb5a9ff5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:43.498995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:43.507915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a0da7-2dc6-43d3-9c65-4b6957cd6c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:43.508874 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a0da7-2dc6-43d3-9c65-4b6957cd6c2d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:43.509384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a0da7-2dc6-43d3-9c65-4b6957cd6c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:43.509858 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a0da7-2dc6-43d3-9c65-4b6957cd6c2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:43.529653 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822480e7-3f83-4ac6-b8b5-0e7b36c2a0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:43.530473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822480e7-3f83-4ac6-b8b5-0e7b36c2a0fb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:43.530752 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822480e7-3f83-4ac6-b8b5-0e7b36c2a0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:43.531183 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822480e7-3f83-4ac6-b8b5-0e7b36c2a0fb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:43.531728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822480e7-3f83-4ac6-b8b5-0e7b36c2a0fb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:43.533100 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822480e7-3f83-4ac6-b8b5-0e7b36c2a0fb None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-822480e7-3f83-4ac6-b8b5-0e7b36c2a0fb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:43.545388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:43.546386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:43.547207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:43.547207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:43.547207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:43.547207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:43.547207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:43.547207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:43.547207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:43.547207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:43.547207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:43.547207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:43.547207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:43.547207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:43.547207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:17:43.547207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:43.547207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 431/887] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 08:17:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:43.548197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96ed66-42ed-4b43-8c8a-7aa2cbf24f5a None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:43.548197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96ed66-42ed-4b43-8c8a-7aa2cbf24f5a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:43.561932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96ed66-42ed-4b43-8c8a-7aa2cbf24f5a None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:43.561932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 432/888] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:43 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:43.561932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96ed66-42ed-4b43-8c8a-7aa2cbf24f5a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:43.593725 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a0da7-2dc6-43d3-9c65-4b6957cd6c2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:43.596273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a0da7-2dc6-43d3-9c65-4b6957cd6c2d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:43.677574 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96ed66-42ed-4b43-8c8a-7aa2cbf24f5a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:43.703695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 457/889] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:43 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:17:43.705023 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0d1b7-2316-46da-a789-4ebb8f788b26 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:43.705462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0d1b7-2316-46da-a789-4ebb8f788b26 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:43.705751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0d1b7-2316-46da-a789-4ebb8f788b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:43.709727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:43.723019 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9d853-1186-49d2-86cb-b50287a36ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:43.723711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9d853-1186-49d2-86cb-b50287a36ccc None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:43.723994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9d853-1186-49d2-86cb-b50287a36ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:43.724265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9d853-1186-49d2-86cb-b50287a36ccc None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:43.724844 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-62f0d1b7-2316-46da-a789-4ebb8f788b26 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:43.724965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9d853-1186-49d2-86cb-b50287a36ccc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:43.725271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9d853-1186-49d2-86cb-b50287a36ccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:43.726028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-62f0d1b7-2316-46da-a789-4ebb8f788b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:43.726654 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9d853-1186-49d2-86cb-b50287a36ccc None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:43.731952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 433/890] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 08:17:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:43.732596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9d853-1186-49d2-86cb-b50287a36ccc None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:43.757086 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:43.813650 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 458/891] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:43.814947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0d1b7-2316-46da-a789-4ebb8f788b26 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:43.845533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9d853-1186-49d2-86cb-b50287a36ccc None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:43.880498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50e4e7-ee74-4f1e-95f2-fe1b98907cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:43.881308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50e4e7-ee74-4f1e-95f2-fe1b98907cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:43.881584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50e4e7-ee74-4f1e-95f2-fe1b98907cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:43.881866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50e4e7-ee74-4f1e-95f2-fe1b98907cd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:43.895150 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50e4e7-ee74-4f1e-95f2-fe1b98907cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:43.896656 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50e4e7-ee74-4f1e-95f2-fe1b98907cd1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:43.916080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-da50e4e7-ee74-4f1e-95f2-fe1b98907cd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:43.916080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:43.916080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:43.916080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:43.916080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:43.916080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:43.916080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:43.916080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:43.916080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:43.916080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:43.916080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:43.916080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:43.916080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:43.916080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:43.916080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:43.917072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:43.918053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:43.918053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:43.918053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:43.918053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:43.922117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 434/892] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:43.922759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50e4e7-ee74-4f1e-95f2-fe1b98907cd1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:43.925431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0d1b7-2316-46da-a789-4ebb8f788b26 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:43.962398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645f4b7-fa46-4848-9ad9-66cf3c5e3efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:43.963018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645f4b7-fa46-4848-9ad9-66cf3c5e3efc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:43.963304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645f4b7-fa46-4848-9ad9-66cf3c5e3efc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:43.963663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645f4b7-fa46-4848-9ad9-66cf3c5e3efc None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:43.964390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645f4b7-fa46-4848-9ad9-66cf3c5e3efc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:43.964699 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645f4b7-fa46-4848-9ad9-66cf3c5e3efc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:43.966098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645f4b7-fa46-4848-9ad9-66cf3c5e3efc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:43.966408 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:43.983630 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 459/893] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 08:17:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:43.983630 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645f4b7-fa46-4848-9ad9-66cf3c5e3efc None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:44.010606 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:44.049959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50e4e7-ee74-4f1e-95f2-fe1b98907cd1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:44.093951 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aa479-85d9-4c4f-938f-68e62835b661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:44.095230 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aa479-85d9-4c4f-938f-68e62835b661 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:44.095652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aa479-85d9-4c4f-938f-68e62835b661 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:44.097026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aa479-85d9-4c4f-938f-68e62835b661 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:44.098070 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5aa479-85d9-4c4f-938f-68e62835b661 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:44.100235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5aa479-85d9-4c4f-938f-68e62835b661 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-7e5aa479-85d9-4c4f-938f-68e62835b661 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:44.115947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:44.117495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:44.118764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:44.118764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:44.118764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:44.118764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:44.118764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:44.118764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:44.118764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:44.118764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:44.118764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:44.118764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:44.118764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:44.118764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:44.118764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:17:44.118764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:44.122388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 435/894] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:17:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:44.123353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aa479-85d9-4c4f-938f-68e62835b661 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:44.124624 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645f4b7-fa46-4848-9ad9-66cf3c5e3efc None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:44.173698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b482fcf-eb19-42c3-a275-82868b8c81db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:44.174767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b482fcf-eb19-42c3-a275-82868b8c81db None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:44.175048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b482fcf-eb19-42c3-a275-82868b8c81db None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:44.175320 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b482fcf-eb19-42c3-a275-82868b8c81db None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:44.176095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b482fcf-eb19-42c3-a275-82868b8c81db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:44.176412 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b482fcf-eb19-42c3-a275-82868b8c81db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:44.177789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b482fcf-eb19-42c3-a275-82868b8c81db None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:44.192374 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 460/895] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:44.199820 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b482fcf-eb19-42c3-a275-82868b8c81db None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:44.240237 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aa479-85d9-4c4f-938f-68e62835b661 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:44.244093 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:44.288284 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:44.293165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b77e42-0bcd-4ab7-b80d-c4d2215a2634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:44.294330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b77e42-0bcd-4ab7-b80d-c4d2215a2634 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:44.294809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b77e42-0bcd-4ab7-b80d-c4d2215a2634 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:44.295348 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b77e42-0bcd-4ab7-b80d-c4d2215a2634 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:44.296320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b77e42-0bcd-4ab7-b80d-c4d2215a2634 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:44.297258 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b77e42-0bcd-4ab7-b80d-c4d2215a2634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:44.299197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b77e42-0bcd-4ab7-b80d-c4d2215a2634 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:44.306974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 436/896] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:17:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:44.310457 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b482fcf-eb19-42c3-a275-82868b8c81db None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:44.312305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b77e42-0bcd-4ab7-b80d-c4d2215a2634 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:44.355784 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4c8a2-c4c3-482c-9a52-a7bd32b90eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:44.356918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4c8a2-c4c3-482c-9a52-a7bd32b90eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:44.357396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4c8a2-c4c3-482c-9a52-a7bd32b90eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:44.358300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4c8a2-c4c3-482c-9a52-a7bd32b90eb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:44.368556 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4c8a2-c4c3-482c-9a52-a7bd32b90eb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:44.370960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4c8a2-c4c3-482c-9a52-a7bd32b90eb6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:44.392731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f3e4c8a2-c4c3-482c-9a52-a7bd32b90eb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:44.392731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:44.392731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:44.392731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:44.392731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:44.392731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:44.392731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:44.392731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:44.392731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:44.392731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:44.392731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:44.392731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:44.392731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:44.392731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:44.392731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:44.393722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:44.394581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:44.394581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:44.394581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:44.394581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:44.394581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:44.394581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:44.394581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:44.394581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:44.397804 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 461/897] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:44.404807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4c8a2-c4c3-482c-9a52-a7bd32b90eb6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:44.428415 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b77e42-0bcd-4ab7-b80d-c4d2215a2634 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:44.474166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094979c-00f6-4fc4-901d-b82a8501c95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:44.474842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094979c-00f6-4fc4-901d-b82a8501c95f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:44.475532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094979c-00f6-4fc4-901d-b82a8501c95f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:44.475855 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094979c-00f6-4fc4-901d-b82a8501c95f None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:44.476572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094979c-00f6-4fc4-901d-b82a8501c95f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:44.476878 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094979c-00f6-4fc4-901d-b82a8501c95f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:44.478781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094979c-00f6-4fc4-901d-b82a8501c95f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:44.485629 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 437/898] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:17:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:44.491563 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094979c-00f6-4fc4-901d-b82a8501c95f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:44.522625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:44.538308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4c8a2-c4c3-482c-9a52-a7bd32b90eb6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:44.579280 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc9fca-c995-4b4f-9afa-649df2877ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:44.580379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc9fca-c995-4b4f-9afa-649df2877ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:44.580877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc9fca-c995-4b4f-9afa-649df2877ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:44.581361 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc9fca-c995-4b4f-9afa-649df2877ac3 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:44.582408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc9fca-c995-4b4f-9afa-649df2877ac3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:44.582911 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc9fca-c995-4b4f-9afa-649df2877ac3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:44.584704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc9fca-c995-4b4f-9afa-649df2877ac3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:44.593521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094979c-00f6-4fc4-901d-b82a8501c95f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:44.602949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 462/899] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:44.604327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc9fca-c995-4b4f-9afa-649df2877ac3 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:44.607650 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:44.629313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52269f86-4db8-4d50-bcd1-62e756fec4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:44.630022 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269f86-4db8-4d50-bcd1-62e756fec4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:44.630341 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269f86-4db8-4d50-bcd1-62e756fec4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:44.630631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269f86-4db8-4d50-bcd1-62e756fec4f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:44.631421 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52269f86-4db8-4d50-bcd1-62e756fec4f7 None admin] RBAC: Adding query filter params (interface=public, service_id=5981f17fd62b465989251067289eb0e7, region_id=RegionOne) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:44.631774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52269f86-4db8-4d50-bcd1-62e756fec4f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:44.633195 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52269f86-4db8-4d50-bcd1-62e756fec4f7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:44.645319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 438/900] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 08:17:44 2022] GET /identity/v3/endpoints?service_id=5981f17fd62b465989251067289eb0e7&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:44.647224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52269f86-4db8-4d50-bcd1-62e756fec4f7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:44.718575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc9fca-c995-4b4f-9afa-649df2877ac3 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:44.742272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:44.748840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52269f86-4db8-4d50-bcd1-62e756fec4f7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:44.757463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc9156-97b3-47b9-a991-ea47e2fc12b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:44.758429 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc9156-97b3-47b9-a991-ea47e2fc12b3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:44.758909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc9156-97b3-47b9-a991-ea47e2fc12b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:44.759324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc9156-97b3-47b9-a991-ea47e2fc12b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:44.760445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc9156-97b3-47b9-a991-ea47e2fc12b3 None admin] RBAC: Adding query filter params (role.id=fc684ab3f3f04ccfbc26506de9e9dc2b, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=1898d568650f48a08a51b93cbd9359bc) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:44.760918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc9156-97b3-47b9-a991-ea47e2fc12b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:44.762637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc9156-97b3-47b9-a991-ea47e2fc12b3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:44.773526 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 463/901] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:44 2022] GET /identity/v3/role_assignments?user.id=1898d568650f48a08a51b93cbd9359bc&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=fc684ab3f3f04ccfbc26506de9e9dc2b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:44.796494 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c683da2-caee-446d-888d-4c53e79c5b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:44.798018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c683da2-caee-446d-888d-4c53e79c5b7d None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:44.798789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c683da2-caee-446d-888d-4c53e79c5b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:44.799564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c683da2-caee-446d-888d-4c53e79c5b7d None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:44.801089 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c683da2-caee-446d-888d-4c53e79c5b7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:44.803682 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c683da2-caee-446d-888d-4c53e79c5b7d None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:44.815188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 439/902] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 08:17:44 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:17:45.329009 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478ef1a-6bf9-4c2e-8cbb-860fb168ce78 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:45.329566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478ef1a-6bf9-4c2e-8cbb-860fb168ce78 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:45.329566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478ef1a-6bf9-4c2e-8cbb-860fb168ce78 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:45.331241 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 464/903] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:45.336660 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672ac37-67cd-4f13-aaca-1813b0ab68d9 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:45.337058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672ac37-67cd-4f13-aaca-1813b0ab68d9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:45.337256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672ac37-67cd-4f13-aaca-1813b0ab68d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:45.354605 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2672ac37-67cd-4f13-aaca-1813b0ab68d9 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:45.356003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2672ac37-67cd-4f13-aaca-1813b0ab68d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:45.424041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 440/904] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:45.446886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478ef1a-6bf9-4c2e-8cbb-860fb168ce78 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:45.518165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:45.555793 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478ef1a-6bf9-4c2e-8cbb-860fb168ce78 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:45.591492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98303d7-d0bf-4299-aa4e-ee7007a847f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:45.592274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98303d7-d0bf-4299-aa4e-ee7007a847f4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:45.592559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98303d7-d0bf-4299-aa4e-ee7007a847f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:45.592837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98303d7-d0bf-4299-aa4e-ee7007a847f4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:45.593503 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98303d7-d0bf-4299-aa4e-ee7007a847f4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:45.594898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98303d7-d0bf-4299-aa4e-ee7007a847f4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e98303d7-d0bf-4299-aa4e-ee7007a847f4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:45.608077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:45.609054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:45.609904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 465/905] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Jul 21 08:17:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:45.615699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672ac37-67cd-4f13-aaca-1813b0ab68d9 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:45.704613 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:45.718163 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672ac37-67cd-4f13-aaca-1813b0ab68d9 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:45.753874 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be879dcf-8d65-488d-9bf6-ea50c1a83be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:45.754550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be879dcf-8d65-488d-9bf6-ea50c1a83be5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:45.754834 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be879dcf-8d65-488d-9bf6-ea50c1a83be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:45.755113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be879dcf-8d65-488d-9bf6-ea50c1a83be5 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:45.755863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be879dcf-8d65-488d-9bf6-ea50c1a83be5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:45.756173 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be879dcf-8d65-488d-9bf6-ea50c1a83be5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:45.757557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be879dcf-8d65-488d-9bf6-ea50c1a83be5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:45.762956 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 441/906] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 08:17:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:45.768661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98303d7-d0bf-4299-aa4e-ee7007a847f4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:45.873961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98303d7-d0bf-4299-aa4e-ee7007a847f4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:45.905159 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:45.915386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7e045-aa7b-4fbc-b9c5-6b74d92d85c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:45.916137 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7e045-aa7b-4fbc-b9c5-6b74d92d85c8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:45.916476 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7e045-aa7b-4fbc-b9c5-6b74d92d85c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:45.916761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7e045-aa7b-4fbc-b9c5-6b74d92d85c8 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:45.917508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7e045-aa7b-4fbc-b9c5-6b74d92d85c8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:45.917818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7e045-aa7b-4fbc-b9c5-6b74d92d85c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:45.919253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7e045-aa7b-4fbc-b9c5-6b74d92d85c8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:45.926045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 466/907] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 08:17:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:45.931814 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be879dcf-8d65-488d-9bf6-ea50c1a83be5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:46.040555 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be879dcf-8d65-488d-9bf6-ea50c1a83be5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:46.079718 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa446a93-f7df-475e-b1e4-e90433f30e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:46.080811 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa446a93-f7df-475e-b1e4-e90433f30e9a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:46.081300 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa446a93-f7df-475e-b1e4-e90433f30e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:46.081812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa446a93-f7df-475e-b1e4-e90433f30e9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:46.082805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa446a93-f7df-475e-b1e4-e90433f30e9a None admin] RBAC: Adding query filter params (interface=public, service_id=2d24506408ad48f4a23581790632b4f5, region_id=RegionOne) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:46.083329 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa446a93-f7df-475e-b1e4-e90433f30e9a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:46.084923 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa446a93-f7df-475e-b1e4-e90433f30e9a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:46.090870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 442/908] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 08:17:45 2022] GET /identity/v3/endpoints?service_id=2d24506408ad48f4a23581790632b4f5&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:46.096355 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7e045-aa7b-4fbc-b9c5-6b74d92d85c8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:46.207588 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7e045-aa7b-4fbc-b9c5-6b74d92d85c8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:46.243300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b56e2b-044c-4066-9e3c-492492e433e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:46.244490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b56e2b-044c-4066-9e3c-492492e433e9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:46.244978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b56e2b-044c-4066-9e3c-492492e433e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:46.245490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b56e2b-044c-4066-9e3c-492492e433e9 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:46.246739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b56e2b-044c-4066-9e3c-492492e433e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:46.249381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b56e2b-044c-4066-9e3c-492492e433e9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:46.255821 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 467/909] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 08:17:46 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:17:46.257698 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa433-3d45-4648-ba84-4b2d5db73ee2 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:46.258058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa433-3d45-4648-ba84-4b2d5db73ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:46.258407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa433-3d45-4648-ba84-4b2d5db73ee2 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:46.259918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 443/910] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:46.270279 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcfe66-4f85-4221-9a7f-7190b3b5f639 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:46.270663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcfe66-4f85-4221-9a7f-7190b3b5f639 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:46.270830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcfe66-4f85-4221-9a7f-7190b3b5f639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:46.290278 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7dbcfe66-4f85-4221-9a7f-7190b3b5f639 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:46.291501 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7dbcfe66-4f85-4221-9a7f-7190b3b5f639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:46.351100 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:46.366315 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 468/911] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:17:46.389546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa433-3d45-4648-ba84-4b2d5db73ee2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:46.410459 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:46.502522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa433-3d45-4648-ba84-4b2d5db73ee2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:46.537461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7ae36-4006-4207-ba5b-42efcb0b1d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:46.538134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7ae36-4006-4207-ba5b-42efcb0b1d62 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:46.538413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7ae36-4006-4207-ba5b-42efcb0b1d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:46.538684 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7ae36-4006-4207-ba5b-42efcb0b1d62 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:46.539426 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7ae36-4006-4207-ba5b-42efcb0b1d62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:46.540989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7ae36-4006-4207-ba5b-42efcb0b1d62 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:46.557852 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 444/912] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 08:17:46 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:46.931126 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14694787-e006-4e9a-ad78-ffa76f31e96e None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:46.931552 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14694787-e006-4e9a-ad78-ffa76f31e96e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:46.931766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14694787-e006-4e9a-ad78-ffa76f31e96e None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:46.933443 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 469/913] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:46.938997 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f8327-f109-4bfb-9adc-e226393b27e6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:46.939311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f8327-f109-4bfb-9adc-e226393b27e6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:46.939663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f8327-f109-4bfb-9adc-e226393b27e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:46.957325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6c9f8327-f109-4bfb-9adc-e226393b27e6 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:46.958541 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6c9f8327-f109-4bfb-9adc-e226393b27e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:47.003381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c108a-c91a-4558-b68f-ff6322623c68 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:47.003739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c108a-c91a-4558-b68f-ff6322623c68 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:47.003954 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c108a-c91a-4558-b68f-ff6322623c68 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:47.005577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 470/914] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:47.010536 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f891488-532d-4aad-909c-6b3dcdf8be1d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:47.010818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f891488-532d-4aad-909c-6b3dcdf8be1d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:47.011095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f891488-532d-4aad-909c-6b3dcdf8be1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:47.028553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6f891488-532d-4aad-909c-6b3dcdf8be1d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:47.029741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6f891488-532d-4aad-909c-6b3dcdf8be1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:47.039747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 445/915] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:47.063731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f8327-f109-4bfb-9adc-e226393b27e6 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:47.067625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:47.129691 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 471/916] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:17:47.152649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f891488-532d-4aad-909c-6b3dcdf8be1d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:47.200951 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f8327-f109-4bfb-9adc-e226393b27e6 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:47.245033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efced87-2c5f-4555-8d1b-1c1589d135d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:47.245395 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efced87-2c5f-4555-8d1b-1c1589d135d4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:47.245681 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efced87-2c5f-4555-8d1b-1c1589d135d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:47.245963 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efced87-2c5f-4555-8d1b-1c1589d135d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:47.259877 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efced87-2c5f-4555-8d1b-1c1589d135d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-3efced87-2c5f-4555-8d1b-1c1589d135d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:47.269085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:47.270529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:47.271471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:47.271471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:47.271471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:47.271471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:47.271471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:47.271471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:47.271471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:47.271471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:47.271471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:47.271471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:47.271471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:17:47.271471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:47.279772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 446/917] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 21 08:17:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:47.282926 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efced87-2c5f-4555-8d1b-1c1589d135d4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:47.288990 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f891488-532d-4aad-909c-6b3dcdf8be1d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:47.316869 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:47.341556 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3de311-9b90-4825-bd3d-d672bdc8666e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:47.342671 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3de311-9b90-4825-bd3d-d672bdc8666e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:47.343126 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3de311-9b90-4825-bd3d-d672bdc8666e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:47.343778 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3de311-9b90-4825-bd3d-d672bdc8666e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:47.345187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3de311-9b90-4825-bd3d-d672bdc8666e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:47.347343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3de311-9b90-4825-bd3d-d672bdc8666e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:47.361233 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-bc3de311-9b90-4825-bd3d-d672bdc8666e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:47.363955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:47.365472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:47.366460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:47.366460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:47.366460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:47.366460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:47.366460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:47.366460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:47.366460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:47.366460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:47.366460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:47.366460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:47.366460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:47.366460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:47.366460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:17:47.366460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:47.374281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 472/918] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:17:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:47.375160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3de311-9b90-4825-bd3d-d672bdc8666e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:47.419015 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efced87-2c5f-4555-8d1b-1c1589d135d4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:47.465347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801b7e0-52e1-46fe-b777-dd5f3276772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:47.466113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801b7e0-52e1-46fe-b777-dd5f3276772e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:47.466533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801b7e0-52e1-46fe-b777-dd5f3276772e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:47.467073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801b7e0-52e1-46fe-b777-dd5f3276772e None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:47.468246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801b7e0-52e1-46fe-b777-dd5f3276772e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:47.468734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801b7e0-52e1-46fe-b777-dd5f3276772e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:47.470934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801b7e0-52e1-46fe-b777-dd5f3276772e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:47.487754 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 447/919] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 21 08:17:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:47.490648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801b7e0-52e1-46fe-b777-dd5f3276772e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:47.508052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3de311-9b90-4825-bd3d-d672bdc8666e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:47.555626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4feb1-e317-41c9-bf12-b498ceb54c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:47.556433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4feb1-e317-41c9-bf12-b498ceb54c86 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:47.556933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4feb1-e317-41c9-bf12-b498ceb54c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:47.557174 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4feb1-e317-41c9-bf12-b498ceb54c86 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:47.557999 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4feb1-e317-41c9-bf12-b498ceb54c86 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:47.558604 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4feb1-e317-41c9-bf12-b498ceb54c86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:47.560029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4feb1-e317-41c9-bf12-b498ceb54c86 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:47.571770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 473/920] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:17:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:47.572942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4feb1-e317-41c9-bf12-b498ceb54c86 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:47.629135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801b7e0-52e1-46fe-b777-dd5f3276772e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:47.635274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:47.657380 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:47.672163 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183fa36-7d6e-4835-be00-776d301a9c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:47.672991 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183fa36-7d6e-4835-be00-776d301a9c9b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:47.673275 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183fa36-7d6e-4835-be00-776d301a9c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:47.673554 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183fa36-7d6e-4835-be00-776d301a9c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:47.685605 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183fa36-7d6e-4835-be00-776d301a9c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:47.687349 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183fa36-7d6e-4835-be00-776d301a9c9b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:47.700739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4feb1-e317-41c9-bf12-b498ceb54c86 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:47.707706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-1183fa36-7d6e-4835-be00-776d301a9c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:47.707706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:47.707706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:47.707706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:47.707706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:47.707706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:47.707706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:47.707706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:47.707706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:47.707706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:47.707706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:47.707706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:47.707706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:47.707706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:47.707706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:47.708714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:47.709773 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:47.709773 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:47.709773 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:47.709773 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:47.715583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 448/921] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:47.717495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183fa36-7d6e-4835-be00-776d301a9c9b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:47.745003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c065734-5e81-4254-a98d-24f55f1aaf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:47.746096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c065734-5e81-4254-a98d-24f55f1aaf31 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:47.746599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c065734-5e81-4254-a98d-24f55f1aaf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:47.747103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c065734-5e81-4254-a98d-24f55f1aaf31 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:47.748089 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c065734-5e81-4254-a98d-24f55f1aaf31 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:47.748723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c065734-5e81-4254-a98d-24f55f1aaf31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:47.750504 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c065734-5e81-4254-a98d-24f55f1aaf31 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:47.756862 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 474/922] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 08:17:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:47.762866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c065734-5e81-4254-a98d-24f55f1aaf31 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:47.845824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183fa36-7d6e-4835-be00-776d301a9c9b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:47.873203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c065734-5e81-4254-a98d-24f55f1aaf31 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:47.885227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb5a47-5fc7-40e1-8190-241b9dc22a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:47.886375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb5a47-5fc7-40e1-8190-241b9dc22a13 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:47.886834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:47.887082 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb5a47-5fc7-40e1-8190-241b9dc22a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:47.887735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb5a47-5fc7-40e1-8190-241b9dc22a13 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:47.888527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb5a47-5fc7-40e1-8190-241b9dc22a13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:47.888933 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb5a47-5fc7-40e1-8190-241b9dc22a13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:47.890394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb5a47-5fc7-40e1-8190-241b9dc22a13 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:47.914442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 449/923] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:47.915376 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e0dd1-73af-4287-a42a-55b3febf918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:47.915956 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb5a47-5fc7-40e1-8190-241b9dc22a13 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:47.916753 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e0dd1-73af-4287-a42a-55b3febf918c None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:47.917276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e0dd1-73af-4287-a42a-55b3febf918c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:47.917771 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e0dd1-73af-4287-a42a-55b3febf918c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:47.918746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e0dd1-73af-4287-a42a-55b3febf918c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:47.920493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e0dd1-73af-4287-a42a-55b3febf918c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:47.949673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 475/924] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 08:17:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:17:47.960913 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:48.053104 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb5a47-5fc7-40e1-8190-241b9dc22a13 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:48.103802 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bbdfe-bdae-4c87-94f3-07b850fa9aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:48.104949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bbdfe-bdae-4c87-94f3-07b850fa9aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:48.105468 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bbdfe-bdae-4c87-94f3-07b850fa9aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:48.105858 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bbdfe-bdae-4c87-94f3-07b850fa9aa4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:48.118138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bbdfe-bdae-4c87-94f3-07b850fa9aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:48.119661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bbdfe-bdae-4c87-94f3-07b850fa9aa4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-2c4bbdfe-bdae-4c87-94f3-07b850fa9aa4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:48.138353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:48.139354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:48.140497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:48.140497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:48.140497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:48.140497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:48.140497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:48.140497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:48.140497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:48.140497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:48.140497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:17:48.140497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:48.143710 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 450/925] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 08:17:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:48.148386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e0dd1-73af-4287-a42a-55b3febf918c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:48.281996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e0dd1-73af-4287-a42a-55b3febf918c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:48.329606 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738bb99-f9ef-4ed6-8faa-91bb4e9f7bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:48.331141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738bb99-f9ef-4ed6-8faa-91bb4e9f7bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:48.339621 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738bb99-f9ef-4ed6-8faa-91bb4e9f7bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:48.340230 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738bb99-f9ef-4ed6-8faa-91bb4e9f7bb6 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:48.341293 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738bb99-f9ef-4ed6-8faa-91bb4e9f7bb6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:48.341775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738bb99-f9ef-4ed6-8faa-91bb4e9f7bb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:48.343387 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738bb99-f9ef-4ed6-8faa-91bb4e9f7bb6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:48.378955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bbdfe-bdae-4c87-94f3-07b850fa9aa4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:48.380067 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 476/926] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 21 08:17:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:48.591710 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:48.605223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bbdfe-bdae-4c87-94f3-07b850fa9aa4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:48.660808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f4dac-eab0-4e9e-875e-0e0325503d6e None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:48.661175 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f4dac-eab0-4e9e-875e-0e0325503d6e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:48.661359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f4dac-eab0-4e9e-875e-0e0325503d6e None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:48.667630 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 477/927] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:17:48.671619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a663865-c08b-4239-855d-f9a4c532d7e6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:48.671619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a663865-c08b-4239-855d-f9a4c532d7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:48.671619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a663865-c08b-4239-855d-f9a4c532d7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:48.679630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228e98d-219e-475d-917a-8428d58025b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:48.680109 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228e98d-219e-475d-917a-8428d58025b6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:48.680599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228e98d-219e-475d-917a-8428d58025b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:48.681111 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228e98d-219e-475d-917a-8428d58025b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:48.694725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228e98d-219e-475d-917a-8428d58025b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:48.696257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228e98d-219e-475d-917a-8428d58025b6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:48.711625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4a663865-c08b-4239-855d-f9a4c532d7e6 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:48.712843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4a663865-c08b-4239-855d-f9a4c532d7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:48.719524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-1228e98d-219e-475d-917a-8428d58025b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:48.719524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:48.719524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:48.719524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:48.719524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:48.719524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:48.719524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:48.719524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:48.719524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:48.719524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:48.719524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:48.719524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:48.719524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:48.719524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:48.719524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:48.720553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:48.721580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:48.721580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:48.721580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:48.721580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:48.726690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 451/928] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:48.728435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ada3b-62e4-4673-b015-aa559cbfeef5 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:48.728941 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ada3b-62e4-4673-b015-aa559cbfeef5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:48.729424 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ada3b-62e4-4673-b015-aa559cbfeef5 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:48.730971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 452/929] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:48.735369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ada3b-62e4-4673-b015-aa559cbfeef5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:48.745065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:48.815324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 478/930] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:48.816652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc16554-ca68-422c-ad31-674d08db9e70 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:48.816941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc16554-ca68-422c-ad31-674d08db9e70 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:48.817216 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc16554-ca68-422c-ad31-674d08db9e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:48.846445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7dc16554-ca68-422c-ad31-674d08db9e70 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:48.847550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7dc16554-ca68-422c-ad31-674d08db9e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:48.854691 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ada3b-62e4-4673-b015-aa559cbfeef5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:48.890659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e986dc-bb0c-4c1d-93db-fba78ef838dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:48.891331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e986dc-bb0c-4c1d-93db-fba78ef838dd None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:48.891634 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e986dc-bb0c-4c1d-93db-fba78ef838dd None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:48.891921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e986dc-bb0c-4c1d-93db-fba78ef838dd None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:48.892983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e986dc-bb0c-4c1d-93db-fba78ef838dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:48.893343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e986dc-bb0c-4c1d-93db-fba78ef838dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:48.894739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e986dc-bb0c-4c1d-93db-fba78ef838dd None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:48.911447 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 453/931] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:48.912359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e986dc-bb0c-4c1d-93db-fba78ef838dd None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:48.915910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:48.917113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 479/932] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:48.918076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc16554-ca68-422c-ad31-674d08db9e70 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:49.019642 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:49.030907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e986dc-bb0c-4c1d-93db-fba78ef838dd None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:49.036587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc16554-ca68-422c-ad31-674d08db9e70 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:49.064098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02f0d-fe51-4e27-a712-22a4368232d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:49.065056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02f0d-fe51-4e27-a712-22a4368232d3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:49.065335 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02f0d-fe51-4e27-a712-22a4368232d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:49.065616 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02f0d-fe51-4e27-a712-22a4368232d3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:49.066268 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f02f0d-fe51-4e27-a712-22a4368232d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:49.067687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f02f0d-fe51-4e27-a712-22a4368232d3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:49.070337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4e4f3-2962-42d5-876f-b3304c5e93ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:49.071141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4e4f3-2962-42d5-876f-b3304c5e93ec None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:49.071422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4e4f3-2962-42d5-876f-b3304c5e93ec None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:49.071719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4e4f3-2962-42d5-876f-b3304c5e93ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:49.078291 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4e4f3-2962-42d5-876f-b3304c5e93ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:49.079751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4e4f3-2962-42d5-876f-b3304c5e93ec None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-b5f02f0d-fe51-4e27-a712-22a4368232d3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:49.080018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:49.081014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:49.081931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 454/933] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Jul 21 08:17:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:49.082812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02f0d-fe51-4e27-a712-22a4368232d3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:49.099751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4cd4e4f3-2962-42d5-876f-b3304c5e93ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:49.099751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:49.099751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:49.099751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:49.099751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:49.099751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:49.099751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:49.099751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:49.099751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:49.099751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:49.099751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:49.099751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:49.099751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:49.099751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:49.099751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:49.100861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:49.101982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:49.101982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:49.101982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:49.101982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:49.101982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:49.101982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:49.101982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:49.101982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:49.101982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 480/934] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:49.101982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4e4f3-2962-42d5-876f-b3304c5e93ec None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:49.159988 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:49.194676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02f0d-fe51-4e27-a712-22a4368232d3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:49.205905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4e4f3-2962-42d5-876f-b3304c5e93ec None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:49.230090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0f23d-90dc-44a4-8a43-1f2d7b094244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:49.230918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0f23d-90dc-44a4-8a43-1f2d7b094244 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:49.231203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0f23d-90dc-44a4-8a43-1f2d7b094244 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:49.231481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0f23d-90dc-44a4-8a43-1f2d7b094244 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:49.232213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0f23d-90dc-44a4-8a43-1f2d7b094244 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:49.233631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0f23d-90dc-44a4-8a43-1f2d7b094244 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:49.239901 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5141c-c089-409f-b20d-eecf9b3db107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:49.240669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5141c-c089-409f-b20d-eecf9b3db107 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:49.241018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5141c-c089-409f-b20d-eecf9b3db107 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:49.241358 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5141c-c089-409f-b20d-eecf9b3db107 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:49.242149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5141c-c089-409f-b20d-eecf9b3db107 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:49.242517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5141c-c089-409f-b20d-eecf9b3db107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:49.244013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5141c-c089-409f-b20d-eecf9b3db107 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-eba0f23d-90dc-44a4-8a43-1f2d7b094244 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:49.246223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:49.247191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:49.248063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:49.248063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:49.248063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:49.248063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:49.248063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:49.248063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:49.248063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:49.248063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:49.248063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:49.248063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:49.248063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:49.248063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:49.248063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:17:49.248063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:49.256496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 481/935] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 08:17:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:49.256496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5141c-c089-409f-b20d-eecf9b3db107 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:49.256740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 455/936] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 08:17:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:49.256740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0f23d-90dc-44a4-8a43-1f2d7b094244 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:49.269427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:49.366428 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5141c-c089-409f-b20d-eecf9b3db107 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:49.370627 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0f23d-90dc-44a4-8a43-1f2d7b094244 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:49.404126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:49.407290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4aefe-efa8-4a5f-90cf-250437eb96c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:49.408005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4aefe-efa8-4a5f-90cf-250437eb96c1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:49.408340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4aefe-efa8-4a5f-90cf-250437eb96c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:49.408602 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4aefe-efa8-4a5f-90cf-250437eb96c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:49.409404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4aefe-efa8-4a5f-90cf-250437eb96c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:49.409700 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4aefe-efa8-4a5f-90cf-250437eb96c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:49.410240 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881b339-6eaa-4660-b3ce-4c3fc9554ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:49.410914 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881b339-6eaa-4660-b3ce-4c3fc9554ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:49.411149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4aefe-efa8-4a5f-90cf-250437eb96c1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:49.411254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881b339-6eaa-4660-b3ce-4c3fc9554ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:49.411479 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881b339-6eaa-4660-b3ce-4c3fc9554ce6 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:49.412222 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881b339-6eaa-4660-b3ce-4c3fc9554ce6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:49.412533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881b339-6eaa-4660-b3ce-4c3fc9554ce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:49.414264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881b339-6eaa-4660-b3ce-4c3fc9554ce6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:49.423821 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 456/937] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 08:17:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:49.423821 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881b339-6eaa-4660-b3ce-4c3fc9554ce6 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:49.424071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 482/938] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:49.425105 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4aefe-efa8-4a5f-90cf-250437eb96c1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:49.496359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:49.530677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4aefe-efa8-4a5f-90cf-250437eb96c1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:49.534099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881b339-6eaa-4660-b3ce-4c3fc9554ce6 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:49.565093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d0e02-4890-4477-82da-10a91e8010fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:49.565872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d0e02-4890-4477-82da-10a91e8010fa None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:49.566208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d0e02-4890-4477-82da-10a91e8010fa None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:49.566429 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d0e02-4890-4477-82da-10a91e8010fa None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:49.567139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d0e02-4890-4477-82da-10a91e8010fa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:49.567507 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d0e02-4890-4477-82da-10a91e8010fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:49.568712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a2e04-7962-4aa1-87b2-6793501ed426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:49.568839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d0e02-4890-4477-82da-10a91e8010fa None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:49.569419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a2e04-7962-4aa1-87b2-6793501ed426 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:49.569699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a2e04-7962-4aa1-87b2-6793501ed426 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:49.569982 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a2e04-7962-4aa1-87b2-6793501ed426 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:49.570852 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a2e04-7962-4aa1-87b2-6793501ed426 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:49.571038 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a2e04-7962-4aa1-87b2-6793501ed426 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:49.572463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a2e04-7962-4aa1-87b2-6793501ed426 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:49.579050 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 483/939] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 08:17:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:49.579050 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d0e02-4890-4477-82da-10a91e8010fa None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:49.587261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 457/940] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 08:17:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:49.587261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a2e04-7962-4aa1-87b2-6793501ed426 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:49.648887 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:49.684756 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d0e02-4890-4477-82da-10a91e8010fa None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:49.693410 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a2e04-7962-4aa1-87b2-6793501ed426 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:49.716938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:49.722580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5efb5a-e286-4c1b-b50c-e51771374769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:49.723492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5efb5a-e286-4c1b-b50c-e51771374769 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:49.723810 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5efb5a-e286-4c1b-b50c-e51771374769 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:49.724085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5efb5a-e286-4c1b-b50c-e51771374769 None admin] PATH_INFO: `/v3/projects/784795960efb40e5811f778fff6fceb1/users/1898d568650f48a08a51b93cbd9359bc/roles/fc684ab3f3f04ccfbc26506de9e9dc2b` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:49.726307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5efb5a-e286-4c1b-b50c-e51771374769 None admin] RBAC: Authorizing `identity:create_grant(project_id=784795960efb40e5811f778fff6fceb1, user_id=1898d568650f48a08a51b93cbd9359bc, role_id=fc684ab3f3f04ccfbc26506de9e9dc2b)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:49.727863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5efb5a-e286-4c1b-b50c-e51771374769 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:49.728790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a87684-d5f1-4027-ba6b-7f1b3be99ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:49.729446 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a87684-d5f1-4027-ba6b-7f1b3be99ecf None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:49.729727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a87684-d5f1-4027-ba6b-7f1b3be99ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:49.730007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a87684-d5f1-4027-ba6b-7f1b3be99ecf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:49.730801 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a87684-d5f1-4027-ba6b-7f1b3be99ecf None admin] RBAC: Adding query filter params (interface=public, service_id=eef633be2014414a90305b31406c2b5f, region_id=RegionOne) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:49.731115 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a87684-d5f1-4027-ba6b-7f1b3be99ecf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:49.732567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a87684-d5f1-4027-ba6b-7f1b3be99ecf None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:49.739171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 458/941] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 08:17:49 2022] GET /identity/v3/endpoints?service_id=eef633be2014414a90305b31406c2b5f&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:49.739799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a87684-d5f1-4027-ba6b-7f1b3be99ecf None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:49.749631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 484/942] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:17:49 2022] PUT /identity/v3/projects/784795960efb40e5811f778fff6fceb1/users/1898d568650f48a08a51b93cbd9359bc/roles/fc684ab3f3f04ccfbc26506de9e9dc2b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:17:49.750276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5efb5a-e286-4c1b-b50c-e51771374769 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:49.882382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a87684-d5f1-4027-ba6b-7f1b3be99ecf None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:49.903500 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5efb5a-e286-4c1b-b50c-e51771374769 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:49.916683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:49.934596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7624393-48a1-4a15-a442-1d082c99a2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:49.935290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7624393-48a1-4a15-a442-1d082c99a2f6 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:49.935558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7624393-48a1-4a15-a442-1d082c99a2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:49.935879 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7624393-48a1-4a15-a442-1d082c99a2f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:49.936630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7624393-48a1-4a15-a442-1d082c99a2f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:49.938021 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7624393-48a1-4a15-a442-1d082c99a2f6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:49.952368 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b787c-8a53-405b-b175-5976436f28fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:49.953167 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b787c-8a53-405b-b175-5976436f28fc None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:49.953453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b787c-8a53-405b-b175-5976436f28fc None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:49.953730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b787c-8a53-405b-b175-5976436f28fc None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:49.954428 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b787c-8a53-405b-b175-5976436f28fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:49.956413 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b787c-8a53-405b-b175-5976436f28fc None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:49.966117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 485/943] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 08:17:49 2022] GET /identity/v3/services => generated 1497 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:17:49.972280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 459/944] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 08:17:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:50.271668 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25091243-65f8-4483-a703-57ffff26a59f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:50.271867 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25091243-65f8-4483-a703-57ffff26a59f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:50.272161 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25091243-65f8-4483-a703-57ffff26a59f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:50.273781 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 486/945] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:50.279624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d73fd-a156-4cb6-a743-a903ef5b3fba None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:50.280180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d73fd-a156-4cb6-a743-a903ef5b3fba None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:50.280716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d73fd-a156-4cb6-a743-a903ef5b3fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:50.298434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-272d73fd-a156-4cb6-a743-a903ef5b3fba None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:50.300450 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-272d73fd-a156-4cb6-a743-a903ef5b3fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:50.377080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 460/946] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:50.405859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25091243-65f8-4483-a703-57ffff26a59f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:50.469638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:50.519713 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25091243-65f8-4483-a703-57ffff26a59f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:50.555579 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa01bd-c98c-42eb-80f7-94382d9cff34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:50.556200 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa01bd-c98c-42eb-80f7-94382d9cff34 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:50.556524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa01bd-c98c-42eb-80f7-94382d9cff34 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:50.556801 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa01bd-c98c-42eb-80f7-94382d9cff34 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:50.557522 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa01bd-c98c-42eb-80f7-94382d9cff34 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:50.559031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa01bd-c98c-42eb-80f7-94382d9cff34 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:50.560459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: WARNING keystone.server.flask.common [None req-27fa01bd-c98c-42eb-80f7-94382d9cff34 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 08:17:50.581705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.sql.core [None req-27fa01bd-c98c-42eb-80f7-94382d9cff34 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 08:17:50.581705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 08:17:50.581705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [parameters: {'id': 'f9537fc6265e4eb6982e12b13c08bf87', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 08:17:50.581705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80237) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 08:17:50.589750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-27fa01bd-c98c-42eb-80f7-94382d9cff34 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9537fc6265e4eb6982e12b13c08bf87.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9537fc6265e4eb6982e12b13c08bf87. Jul 21 08:17:50.589750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:50.589750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:17:50.589750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:17:50.589750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:17:50.589750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:17:50.589750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:17:50.589750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:17:50.589750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:17:50.589750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:17:50.589750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:17:50.589750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:17:50.589750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result.read() Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 08:17:50.590543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application yield resource Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise self.value Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application session.commit() Jul 21 08:17:50.591494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.session.flush() Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application compat.raise_( Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 08:17:50.592426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 08:17:50.593305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 08:17:50.593305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 08:17:50.593305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 08:17:50.593305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 08:17:50.593305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 08:17:50.593305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 08:17:50.593305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 08:17:50.593305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 08:17:50.593305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 08:17:50.593305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 08:17:50.593305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 08:17:50.593305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 08:17:50.593305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 08:17:50.593305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 08:17:50.593305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result.read() Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:17:50.594092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:17:50.594944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:17:50.594944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:17:50.594944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:17:50.594944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:17:50.594944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:17:50.594944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:17:50.594944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 08:17:50.594944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 08:17:50.594944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [parameters: {'id': 'f9537fc6265e4eb6982e12b13c08bf87', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 08:17:50.594944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 08:17:50.594944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:50.594944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:50.594944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:50.594944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:50.594944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:50.599146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:50.601326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:50.601326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 08:17:50.601326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 08:17:50.601326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:50.601326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:50.601326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 08:17:50.601326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 08:17:50.601326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9537fc6265e4eb6982e12b13c08bf87. Jul 21 08:17:50.601326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:50.601326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 487/947] 10.222.0.64 () {60 vars in 1140 bytes} [Thu Jul 21 08:17:50 2022] POST /identity/v3/projects => generated 262 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:50.602589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d73fd-a156-4cb6-a743-a903ef5b3fba None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:50.700524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d73fd-a156-4cb6-a743-a903ef5b3fba None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:50.708852 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:50.737034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e8f89-5ea6-488a-88a7-b41af80fcd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:50.737899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e8f89-5ea6-488a-88a7-b41af80fcd96 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:50.738235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e8f89-5ea6-488a-88a7-b41af80fcd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:50.738516 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e8f89-5ea6-488a-88a7-b41af80fcd96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:50.745809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e8f89-5ea6-488a-88a7-b41af80fcd96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:50.747486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e8f89-5ea6-488a-88a7-b41af80fcd96 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:50.763624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-fd8e8f89-5ea6-488a-88a7-b41af80fcd96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:50.763624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:50.763624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:50.763624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:50.763624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:50.763624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:50.763624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:50.763624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:50.763624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:50.763624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:50.763624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:50.763624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:50.763624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:50.763624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:50.763624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:50.765679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:50.767859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:50.767859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:50.767859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:50.767859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:50.767859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:50.767859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:50.767859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:50.767859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:50.771700 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 461/948] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:50.771895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa01bd-c98c-42eb-80f7-94382d9cff34 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:50.881687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa01bd-c98c-42eb-80f7-94382d9cff34 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:50.895672 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:50.919313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacb436-8cf0-4b40-ad10-f950fea607a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:50.920193 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacb436-8cf0-4b40-ad10-f950fea607a9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:50.920789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacb436-8cf0-4b40-ad10-f950fea607a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:50.921073 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacb436-8cf0-4b40-ad10-f950fea607a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:50.921851 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacb436-8cf0-4b40-ad10-f950fea607a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:50.922160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacb436-8cf0-4b40-ad10-f950fea607a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:50.923958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacb436-8cf0-4b40-ad10-f950fea607a9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:50.951802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 488/949] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 08:17:50 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:51.893411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b177d-3eb1-4989-9126-eace251a984b None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:51.893411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b177d-3eb1-4989-9126-eace251a984b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:51.893411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b177d-3eb1-4989-9126-eace251a984b None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:51.893411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 462/950] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:51.902199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982288a-1382-41ba-ad73-878c9261b74d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:51.902199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982288a-1382-41ba-ad73-878c9261b74d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:51.902199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982288a-1382-41ba-ad73-878c9261b74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:51.919448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9982288a-1382-41ba-ad73-878c9261b74d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:51.921331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9982288a-1382-41ba-ad73-878c9261b74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:51.987989 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 489/951] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:52.013338 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b177d-3eb1-4989-9126-eace251a984b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:52.119085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b177d-3eb1-4989-9126-eace251a984b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:52.123756 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88483820-6bed-4236-ae7a-6e997538fe69 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:52.124299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88483820-6bed-4236-ae7a-6e997538fe69 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:52.124772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88483820-6bed-4236-ae7a-6e997538fe69 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:52.126699 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 490/952] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:17:52.132197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793821df-8d5a-4c1a-8df6-16b4ac5f5b6b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:52.132492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793821df-8d5a-4c1a-8df6-16b4ac5f5b6b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:52.132775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793821df-8d5a-4c1a-8df6-16b4ac5f5b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:52.151299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-793821df-8d5a-4c1a-8df6-16b4ac5f5b6b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:52.152980 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-793821df-8d5a-4c1a-8df6-16b4ac5f5b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:52.158462 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed401da3-58b9-453b-b4ba-071e2c68df7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:52.159708 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed401da3-58b9-453b-b4ba-071e2c68df7f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:52.160221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed401da3-58b9-453b-b4ba-071e2c68df7f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:52.160692 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed401da3-58b9-453b-b4ba-071e2c68df7f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:52.174146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed401da3-58b9-453b-b4ba-071e2c68df7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ed401da3-58b9-453b-b4ba-071e2c68df7f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:52.182308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:52.183288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:52.184154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:52.184154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:52.184154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:52.184154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:52.184154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:52.184154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:52.184154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:52.184154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:52.184154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:52.184154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:52.184154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:17:52.184154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:52.184154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 463/953] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 21 08:17:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:52.189875 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454d458-b01e-45cb-80ea-6068816c367c None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:52.190161 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454d458-b01e-45cb-80ea-6068816c367c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:52.190435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454d458-b01e-45cb-80ea-6068816c367c None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:52.195767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 464/954] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:52.195767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454d458-b01e-45cb-80ea-6068816c367c None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:52.221118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:52.237006 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 491/955] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:52.245094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1016ef5-94d4-4f24-8a0f-ec694d2dfc71 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:52.245385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1016ef5-94d4-4f24-8a0f-ec694d2dfc71 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:52.245664 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1016ef5-94d4-4f24-8a0f-ec694d2dfc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:52.268046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a1016ef5-94d4-4f24-8a0f-ec694d2dfc71 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:52.269481 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a1016ef5-94d4-4f24-8a0f-ec694d2dfc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:52.300074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:52.310109 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454d458-b01e-45cb-80ea-6068816c367c None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:52.345044 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f40c8f-9bf4-4731-b81a-34a745fb7200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:52.345842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f40c8f-9bf4-4731-b81a-34a745fb7200 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:52.346126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f40c8f-9bf4-4731-b81a-34a745fb7200 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:52.346394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f40c8f-9bf4-4731-b81a-34a745fb7200 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:52.347152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f40c8f-9bf4-4731-b81a-34a745fb7200 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:52.347501 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f40c8f-9bf4-4731-b81a-34a745fb7200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:52.347990 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 492/956] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:52.348856 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f40c8f-9bf4-4731-b81a-34a745fb7200 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:52.349331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1016ef5-94d4-4f24-8a0f-ec694d2dfc71 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:52.362056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 465/957] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 21 08:17:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:52.362795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f40c8f-9bf4-4731-b81a-34a745fb7200 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:52.450695 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:52.462900 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f40c8f-9bf4-4731-b81a-34a745fb7200 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:52.476056 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1016ef5-94d4-4f24-8a0f-ec694d2dfc71 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:52.497905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4c0cf-59e6-4ca3-9aa7-3aa1b60b1b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:52.498718 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4c0cf-59e6-4ca3-9aa7-3aa1b60b1b11 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:52.499000 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4c0cf-59e6-4ca3-9aa7-3aa1b60b1b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:52.499282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4c0cf-59e6-4ca3-9aa7-3aa1b60b1b11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:52.513347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4c0cf-59e6-4ca3-9aa7-3aa1b60b1b11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:52.514808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4c0cf-59e6-4ca3-9aa7-3aa1b60b1b11 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:52.520827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a699a01-f813-4c03-81d8-c135b73379fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:52.521855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a699a01-f813-4c03-81d8-c135b73379fe None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:52.521965 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a699a01-f813-4c03-81d8-c135b73379fe None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:52.522182 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a699a01-f813-4c03-81d8-c135b73379fe None admin] PATH_INFO: `/v3/services/compute` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:52.522839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a699a01-f813-4c03-81d8-c135b73379fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:52.524272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a699a01-f813-4c03-81d8-c135b73379fe None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:52.533547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-16e4c0cf-59e6-4ca3-9aa7-3aa1b60b1b11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:52.533547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:52.533547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:52.533547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:52.533547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:52.533547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:52.533547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:52.533547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:52.533547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:52.533547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:52.533547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:52.533547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:52.533547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:52.533547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:52.533547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:52.534717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:52.536274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:52.536274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:52.536274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:52.536274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:52.536274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 466/958] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:52.536274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4c0cf-59e6-4ca3-9aa7-3aa1b60b1b11 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-3a699a01-f813-4c03-81d8-c135b73379fe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:52.541723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:52.542789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:52.543739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:52.543739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:52.543739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:52.543739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:52.543739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:52.543739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:52.543739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:52.543739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:52.543739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:52.543739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:52.543739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:52.543739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:52.543739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:17:52.543739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:52.543739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 493/959] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:52.545923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a699a01-f813-4c03-81d8-c135b73379fe None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:52.574802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:52.647270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4c0cf-59e6-4ca3-9aa7-3aa1b60b1b11 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:52.660515 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a699a01-f813-4c03-81d8-c135b73379fe None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:52.683989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95903d6a-c356-47a9-87bc-4fa319b3e31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:52.684701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95903d6a-c356-47a9-87bc-4fa319b3e31a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:52.685044 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95903d6a-c356-47a9-87bc-4fa319b3e31a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:52.685307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95903d6a-c356-47a9-87bc-4fa319b3e31a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:52.685905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95903d6a-c356-47a9-87bc-4fa319b3e31a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:52.687302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95903d6a-c356-47a9-87bc-4fa319b3e31a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:52.694724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcf294-a706-40e2-ad43-bdf8dc1f1ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:52.695390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcf294-a706-40e2-ad43-bdf8dc1f1ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:52.695825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcf294-a706-40e2-ad43-bdf8dc1f1ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:52.696171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcf294-a706-40e2-ad43-bdf8dc1f1ca1 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:52.696904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcf294-a706-40e2-ad43-bdf8dc1f1ca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:52.697206 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcf294-a706-40e2-ad43-bdf8dc1f1ca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:52.698577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcf294-a706-40e2-ad43-bdf8dc1f1ca1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-95903d6a-c356-47a9-87bc-4fa319b3e31a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:52.699778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:52.700769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:52.701609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:52.701609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:52.701609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:52.701609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:52.701609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:52.701609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:52.701609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:52.701609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:52.701609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:52.701609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:52.701609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:52.701609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:52.701609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:17:52.701609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:52.701609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 467/960] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 08:17:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:52.702406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95903d6a-c356-47a9-87bc-4fa319b3e31a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:52.706814 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:52.722867 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 494/961] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:52.722867 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcf294-a706-40e2-ad43-bdf8dc1f1ca1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:52.806632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:52.821135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95903d6a-c356-47a9-87bc-4fa319b3e31a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:52.823430 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcf294-a706-40e2-ad43-bdf8dc1f1ca1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:52.855948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1777343-5cf1-4326-ae14-1564246be906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:52.856796 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1777343-5cf1-4326-ae14-1564246be906 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:52.857083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1777343-5cf1-4326-ae14-1564246be906 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:52.857448 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1777343-5cf1-4326-ae14-1564246be906 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:52.858165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1777343-5cf1-4326-ae14-1564246be906 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:52.858470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1777343-5cf1-4326-ae14-1564246be906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:52.859676 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae396858-fd6c-4a44-af4b-ac206956be4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:52.859964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1777343-5cf1-4326-ae14-1564246be906 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:52.860362 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae396858-fd6c-4a44-af4b-ac206956be4d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:52.860651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae396858-fd6c-4a44-af4b-ac206956be4d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:52.860937 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae396858-fd6c-4a44-af4b-ac206956be4d None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:52.861674 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae396858-fd6c-4a44-af4b-ac206956be4d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:52.862083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae396858-fd6c-4a44-af4b-ac206956be4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:52.863465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae396858-fd6c-4a44-af4b-ac206956be4d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:52.865984 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 468/962] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 08:17:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:52.866988 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1777343-5cf1-4326-ae14-1564246be906 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:52.872626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 495/963] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 08:17:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:52.873758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae396858-fd6c-4a44-af4b-ac206956be4d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:52.938597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:52.979159 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae396858-fd6c-4a44-af4b-ac206956be4d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:52.979711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1777343-5cf1-4326-ae14-1564246be906 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:53.016847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173c39b-0a7d-47bb-a43d-9f103187ae9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:53.017581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc0c77-1f31-4df7-8198-fe842ed6af09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:53.018572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c39b-0a7d-47bb-a43d-9f103187ae9b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:53.018685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc0c77-1f31-4df7-8198-fe842ed6af09 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:53.019154 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc0c77-1f31-4df7-8198-fe842ed6af09 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:53.019385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c39b-0a7d-47bb-a43d-9f103187ae9b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:53.019661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc0c77-1f31-4df7-8198-fe842ed6af09 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:53.020100 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c39b-0a7d-47bb-a43d-9f103187ae9b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:53.020630 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc0c77-1f31-4df7-8198-fe842ed6af09 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:53.020942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc0c77-1f31-4df7-8198-fe842ed6af09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:53.022876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc0c77-1f31-4df7-8198-fe842ed6af09 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:53.030679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173c39b-0a7d-47bb-a43d-9f103187ae9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:53.030970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 496/964] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 08:17:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:53.032429 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc0c77-1f31-4df7-8198-fe842ed6af09 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:53.033416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173c39b-0a7d-47bb-a43d-9f103187ae9b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:53.054756 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-3173c39b-0a7d-47bb-a43d-9f103187ae9b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:53.057188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:53.059456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:53.060645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:53.060645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:53.060645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:53.060645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:53.060645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:53.060645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:53.060645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:53.060645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:53.060645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:17:53.060645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:53.060645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 469/965] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 08:17:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:53.066500 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173c39b-0a7d-47bb-a43d-9f103187ae9b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:53.160577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc0c77-1f31-4df7-8198-fe842ed6af09 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:53.178581 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173c39b-0a7d-47bb-a43d-9f103187ae9b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:53.197757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb78e94-c4ef-4fac-813b-c27b0c1b01c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:53.198444 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb78e94-c4ef-4fac-813b-c27b0c1b01c3 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:53.198730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb78e94-c4ef-4fac-813b-c27b0c1b01c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:53.199007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb78e94-c4ef-4fac-813b-c27b0c1b01c3 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:53.200264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb78e94-c4ef-4fac-813b-c27b0c1b01c3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:53.200983 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb78e94-c4ef-4fac-813b-c27b0c1b01c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:53.202397 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb78e94-c4ef-4fac-813b-c27b0c1b01c3 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:53.208864 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 497/966] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 08:17:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:53.209327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:53.211080 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab08fe-9b60-4e8e-bdf0-a30ef6c0f6ea None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:53.211372 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab08fe-9b60-4e8e-bdf0-a30ef6c0f6ea None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:53.211677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab08fe-9b60-4e8e-bdf0-a30ef6c0f6ea None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:53.213953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 498/967] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:53.214847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab08fe-9b60-4e8e-bdf0-a30ef6c0f6ea None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:53.222281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1e0b0-f59c-4429-82b4-2befcb72cafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:53.222971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1e0b0-f59c-4429-82b4-2befcb72cafb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:53.223249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1e0b0-f59c-4429-82b4-2befcb72cafb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:53.223522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1e0b0-f59c-4429-82b4-2befcb72cafb None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:53.224407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1e0b0-f59c-4429-82b4-2befcb72cafb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:53.224720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1e0b0-f59c-4429-82b4-2befcb72cafb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:53.226167 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1e0b0-f59c-4429-82b4-2befcb72cafb None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:53.247714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 470/968] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 21 08:17:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:53.247714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4f393-0401-4898-92b6-d7dbb76d131d None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:53.247714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4f393-0401-4898-92b6-d7dbb76d131d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:53.247714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4f393-0401-4898-92b6-d7dbb76d131d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:53.263749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8db4f393-0401-4898-92b6-d7dbb76d131d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:53.265001 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8db4f393-0401-4898-92b6-d7dbb76d131d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:53.305061 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:53.329068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab08fe-9b60-4e8e-bdf0-a30ef6c0f6ea None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:53.337113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 471/969] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:53.337863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4f393-0401-4898-92b6-d7dbb76d131d None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:53.378992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf358-82ee-49f5-a92e-83c2656713fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:53.379719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf358-82ee-49f5-a92e-83c2656713fb None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:53.379977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf358-82ee-49f5-a92e-83c2656713fb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:53.380254 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf358-82ee-49f5-a92e-83c2656713fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:53.381021 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bf358-82ee-49f5-a92e-83c2656713fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:53.382408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bf358-82ee-49f5-a92e-83c2656713fb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:53.404597 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 499/970] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 08:17:53 2022] POST /identity/v3/endpoints => generated 349 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:53.405411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf358-82ee-49f5-a92e-83c2656713fb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:53.473062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4f393-0401-4898-92b6-d7dbb76d131d None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:53.492517 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:53.520747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5258a8b-b3f7-4ebb-80b3-3c246417a282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:53.521530 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5258a8b-b3f7-4ebb-80b3-3c246417a282 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:53.521905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5258a8b-b3f7-4ebb-80b3-3c246417a282 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:53.522276 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5258a8b-b3f7-4ebb-80b3-3c246417a282 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:53.581082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf358-82ee-49f5-a92e-83c2656713fb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:53.601779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5258a8b-b3f7-4ebb-80b3-3c246417a282 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:53.603272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5258a8b-b3f7-4ebb-80b3-3c246417a282 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:53.639041 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b9b09-b48d-48eb-a784-0e11d93cd112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:53.640036 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b9b09-b48d-48eb-a784-0e11d93cd112 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:53.640492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b9b09-b48d-48eb-a784-0e11d93cd112 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:53.640915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b9b09-b48d-48eb-a784-0e11d93cd112 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:53.641816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b9b09-b48d-48eb-a784-0e11d93cd112 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:53.643741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b9b09-b48d-48eb-a784-0e11d93cd112 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:53.652521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:53.660586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.sql.core [None req-112b9b09-b48d-48eb-a784-0e11d93cd112 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 08:17:53.660586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 08:17:53.660586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [parameters: {'user_id': 'f258ccb186624767b81a744907cb9193', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 08:17:53.660586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80237) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 08:17:53.669033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-112b9b09-b48d-48eb-a784-0e11d93cd112 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 08:17:53.669033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:53.669033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:17:53.669033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:17:53.669033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:17:53.669033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:17:53.669033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:17:53.669033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:17:53.669033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:17:53.669033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:17:53.669033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:17:53.669033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:17:53.669033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:17:53.669033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result.read() Jul 21 08:17:53.669033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:17:53.669909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application yield resource Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise self.value Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application session.commit() Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 08:17:53.671303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.session.flush() Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application compat.raise_( Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 08:17:53.672508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:17:53.673447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application result.read() Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:17:53.674282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:17:53.675120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:17:53.675120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:17:53.675120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:17:53.675120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:17:53.675120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 08:17:53.675120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 08:17:53.675120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f258ccb186624767b81a744907cb9193', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 08:17:53.675120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 08:17:53.675120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:53.675120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:53.675120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:53.675120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:53.675120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:53.675120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:53.675120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 08:17:53.677421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 08:17:53.679568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 08:17:53.679568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 08:17:53.679568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 08:17:53.679568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 08:17:53.679568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 08:17:53.679568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:53.679568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 500/971] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 21 08:17:53 2022] POST /identity/v3/users => generated 160 bytes in 265 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:53.679568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b9b09-b48d-48eb-a784-0e11d93cd112 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:53.732255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 472/972] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:53 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:17:53.737941 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5258a8b-b3f7-4ebb-80b3-3c246417a282 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:53.753335 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:53.790708 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b9b09-b48d-48eb-a784-0e11d93cd112 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:53.828021 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad37f4-ae9b-475a-a994-ac8f5e56c35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:53.828793 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad37f4-ae9b-475a-a994-ac8f5e56c35b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:53.829078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad37f4-ae9b-475a-a994-ac8f5e56c35b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:53.829352 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad37f4-ae9b-475a-a994-ac8f5e56c35b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:53.838461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad37f4-ae9b-475a-a994-ac8f5e56c35b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:53.840264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad37f4-ae9b-475a-a994-ac8f5e56c35b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:53.848763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5258a8b-b3f7-4ebb-80b3-3c246417a282 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-10ad37f4-ae9b-475a-a994-ac8f5e56c35b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:53.855627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:53.856581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:53.857953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:53.857953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:53.857953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:53.857953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:53.857953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:53.857953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:53.857953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:53.857953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:53.857953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:17:53.857953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:53.862207 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 501/973] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:17:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:53.863048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad37f4-ae9b-475a-a994-ac8f5e56c35b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:53.890458 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd753e5-ef3f-401e-b88f-5be0d4d5e029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:53.891832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd753e5-ef3f-401e-b88f-5be0d4d5e029 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:53.892478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd753e5-ef3f-401e-b88f-5be0d4d5e029 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:53.893231 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd753e5-ef3f-401e-b88f-5be0d4d5e029 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:53.904989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd753e5-ef3f-401e-b88f-5be0d4d5e029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:53.906896 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd753e5-ef3f-401e-b88f-5be0d4d5e029 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:53.924814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:53.927884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-fbd753e5-ef3f-401e-b88f-5be0d4d5e029 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:53.927884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:53.927884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:53.927884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:53.927884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:53.927884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:53.927884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:53.927884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:53.927884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:53.927884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:53.927884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:53.927884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:53.927884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:53.927884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:53.927884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:53.928790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:53.929712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:53.929712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:53.929712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:53.929712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:53.932209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 473/974] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:53.937695 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd753e5-ef3f-401e-b88f-5be0d4d5e029 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:53.972714 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad37f4-ae9b-475a-a994-ac8f5e56c35b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:54.016048 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:54.021592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e910ea-8bbb-4c27-b5ae-72279a871bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:54.023712 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e910ea-8bbb-4c27-b5ae-72279a871bdf None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:54.024407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e910ea-8bbb-4c27-b5ae-72279a871bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:54.025164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e910ea-8bbb-4c27-b5ae-72279a871bdf None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:54.026482 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e910ea-8bbb-4c27-b5ae-72279a871bdf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:54.026957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e910ea-8bbb-4c27-b5ae-72279a871bdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:54.029092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e910ea-8bbb-4c27-b5ae-72279a871bdf None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:54.062930 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd753e5-ef3f-401e-b88f-5be0d4d5e029 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:54.080754 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 502/975] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 08:17:53 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:54.104528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f2951-ca20-4352-a6ab-f3d97b41a15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:54.105295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f2951-ca20-4352-a6ab-f3d97b41a15b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:54.105575 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f2951-ca20-4352-a6ab-f3d97b41a15b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:54.105908 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f2951-ca20-4352-a6ab-f3d97b41a15b None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:54.106679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f2951-ca20-4352-a6ab-f3d97b41a15b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:54.106987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f2951-ca20-4352-a6ab-f3d97b41a15b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:54.108466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f2951-ca20-4352-a6ab-f3d97b41a15b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:54.123279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 474/976] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:54.129059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e910ea-8bbb-4c27-b5ae-72279a871bdf None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:54.254107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e910ea-8bbb-4c27-b5ae-72279a871bdf None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:54.269390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:54.291977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf8d13-d9ef-4f62-bd6a-64701c3a70b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:54.292794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf8d13-d9ef-4f62-bd6a-64701c3a70b7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:54.293078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf8d13-d9ef-4f62-bd6a-64701c3a70b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:54.293349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf8d13-d9ef-4f62-bd6a-64701c3a70b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:54.300617 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf8d13-d9ef-4f62-bd6a-64701c3a70b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:54.302086 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf8d13-d9ef-4f62-bd6a-64701c3a70b7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:54.316424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-33cf8d13-d9ef-4f62-bd6a-64701c3a70b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:54.316424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:54.316424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:54.316424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:54.316424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:54.316424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:54.316424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:54.316424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:54.316424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:54.316424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:54.316424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:54.316424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:54.316424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:54.316424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:54.316424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:54.317310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:54.318197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:54.318197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:54.318197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:54.318197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:54.318197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:54.318197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:54.318197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:54.318197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:54.318197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 503/977] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:54.325002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f2951-ca20-4352-a6ab-f3d97b41a15b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:54.425932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f2951-ca20-4352-a6ab-f3d97b41a15b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:54.456254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:54.465052 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e4627-f2cc-4dbf-b418-77a298db0128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:54.465714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e4627-f2cc-4dbf-b418-77a298db0128 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:54.465991 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e4627-f2cc-4dbf-b418-77a298db0128 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:54.466266 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e4627-f2cc-4dbf-b418-77a298db0128 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:54.467055 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e4627-f2cc-4dbf-b418-77a298db0128 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:54.467366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e4627-f2cc-4dbf-b418-77a298db0128 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:54.468828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e4627-f2cc-4dbf-b418-77a298db0128 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:54.481282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 475/978] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:54.487271 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf8d13-d9ef-4f62-bd6a-64701c3a70b7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:54.595030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf8d13-d9ef-4f62-bd6a-64701c3a70b7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:54.630543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ff225-1df3-4ad2-a627-25deff412809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:54.631625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ff225-1df3-4ad2-a627-25deff412809 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:54.632113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ff225-1df3-4ad2-a627-25deff412809 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:54.632587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ff225-1df3-4ad2-a627-25deff412809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:54.633682 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ff225-1df3-4ad2-a627-25deff412809 None admin] RBAC: Adding query filter params (role.id=fc684ab3f3f04ccfbc26506de9e9dc2b, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=1898d568650f48a08a51b93cbd9359bc) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:54.634212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ff225-1df3-4ad2-a627-25deff412809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:54.635938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ff225-1df3-4ad2-a627-25deff412809 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:54.643663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 504/979] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:54 2022] GET /identity/v3/role_assignments?user.id=1898d568650f48a08a51b93cbd9359bc&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=fc684ab3f3f04ccfbc26506de9e9dc2b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:55.177360 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7116e0-7cfb-4125-bb6e-7ad823f92e6d None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:55.177949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7116e0-7cfb-4125-bb6e-7ad823f92e6d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:55.177949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7116e0-7cfb-4125-bb6e-7ad823f92e6d None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:55.179258 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 476/980] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:55.184942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5a3c3-4f14-4435-91c9-165fd34513c7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:55.185366 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5a3c3-4f14-4435-91c9-165fd34513c7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:55.185470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5a3c3-4f14-4435-91c9-165fd34513c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:55.203351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-79b5a3c3-4f14-4435-91c9-165fd34513c7 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:55.204967 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-79b5a3c3-4f14-4435-91c9-165fd34513c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:55.237225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:55.278340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 505/981] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:55.301195 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7116e0-7cfb-4125-bb6e-7ad823f92e6d None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:55.406096 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7116e0-7cfb-4125-bb6e-7ad823f92e6d None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:55.451652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55500b6d-a972-49a2-9aed-6172984bfb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:55.452387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55500b6d-a972-49a2-9aed-6172984bfb6c None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:55.452678 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55500b6d-a972-49a2-9aed-6172984bfb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:55.452950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55500b6d-a972-49a2-9aed-6172984bfb6c None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:55.453688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55500b6d-a972-49a2-9aed-6172984bfb6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:55.455251 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55500b6d-a972-49a2-9aed-6172984bfb6c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:55.474608 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 477/982] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 08:17:55 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:55.564945 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de146e08-5a40-4887-8e10-28e635b0294f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:55.565290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de146e08-5a40-4887-8e10-28e635b0294f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:55.565499 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de146e08-5a40-4887-8e10-28e635b0294f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:55.566919 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 506/983] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:55.572643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501ff1e-8b8d-4d12-abe6-65219a9a94e4 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:55.572932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501ff1e-8b8d-4d12-abe6-65219a9a94e4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:55.573216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501ff1e-8b8d-4d12-abe6-65219a9a94e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:55.591639 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8501ff1e-8b8d-4d12-abe6-65219a9a94e4 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:55.592878 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8501ff1e-8b8d-4d12-abe6-65219a9a94e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:55.647188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:55.687709 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 478/984] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:55.711074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de146e08-5a40-4887-8e10-28e635b0294f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:55.824130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de146e08-5a40-4887-8e10-28e635b0294f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:55.859298 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f5d2a-04af-494e-ae09-38d77b228897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:55.860149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f5d2a-04af-494e-ae09-38d77b228897 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:55.860433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f5d2a-04af-494e-ae09-38d77b228897 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:55.860712 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f5d2a-04af-494e-ae09-38d77b228897 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:55.861402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f5d2a-04af-494e-ae09-38d77b228897 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:55.862794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f5d2a-04af-494e-ae09-38d77b228897 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-478f5d2a-04af-494e-ae09-38d77b228897 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:55.875264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:55.876531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:55.877470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:55.877470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:55.877470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:55.877470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:55.877470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:55.877470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:55.877470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:55.877470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:55.877470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:55.877470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:55.877470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:55.877470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:55.877470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:17:55.877470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:55.879699 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 507/985] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 08:17:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:55.883025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501ff1e-8b8d-4d12-abe6-65219a9a94e4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:55.989124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501ff1e-8b8d-4d12-abe6-65219a9a94e4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:56.027907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c681378-3f21-4fa4-ba0f-2730a4c8e7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:56.028576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c681378-3f21-4fa4-ba0f-2730a4c8e7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:56.028852 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c681378-3f21-4fa4-ba0f-2730a4c8e7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:56.029127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c681378-3f21-4fa4-ba0f-2730a4c8e7d8 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:56.029895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c681378-3f21-4fa4-ba0f-2730a4c8e7d8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:56.030205 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c681378-3f21-4fa4-ba0f-2730a4c8e7d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:56.031571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c681378-3f21-4fa4-ba0f-2730a4c8e7d8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:56.042105 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 479/986] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 08:17:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:56.043169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f5d2a-04af-494e-ae09-38d77b228897 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:56.078940 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:56.151843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f5d2a-04af-494e-ae09-38d77b228897 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:56.187365 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721a289-ec64-43cb-84ac-e345070f3ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:56.188063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721a289-ec64-43cb-84ac-e345070f3ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:56.188331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721a289-ec64-43cb-84ac-e345070f3ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:56.188615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721a289-ec64-43cb-84ac-e345070f3ae1 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:56.189533 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721a289-ec64-43cb-84ac-e345070f3ae1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:56.190086 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721a289-ec64-43cb-84ac-e345070f3ae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:56.191491 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721a289-ec64-43cb-84ac-e345070f3ae1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:56.197129 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 508/987] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 08:17:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:56.202897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c681378-3f21-4fa4-ba0f-2730a4c8e7d8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:56.240653 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:56.309094 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c681378-3f21-4fa4-ba0f-2730a4c8e7d8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:56.349831 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf806dc-0a66-4b68-a418-5be01c7756eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:56.350496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf806dc-0a66-4b68-a418-5be01c7756eb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:56.350777 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf806dc-0a66-4b68-a418-5be01c7756eb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:56.351052 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf806dc-0a66-4b68-a418-5be01c7756eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:56.351897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf806dc-0a66-4b68-a418-5be01c7756eb None admin] RBAC: Adding query filter params (interface=admin, service_id=eef633be2014414a90305b31406c2b5f, region_id=RegionOne) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:56.352210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf806dc-0a66-4b68-a418-5be01c7756eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:56.353584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf806dc-0a66-4b68-a418-5be01c7756eb None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:56.358923 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 480/988] 10.222.0.64 () {56 vars in 1249 bytes} [Thu Jul 21 08:17:56 2022] GET /identity/v3/endpoints?service_id=eef633be2014414a90305b31406c2b5f&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:56.364813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721a289-ec64-43cb-84ac-e345070f3ae1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:56.470196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:56.476554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721a289-ec64-43cb-84ac-e345070f3ae1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:56.512204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f69ff-8c40-4fa4-92c0-788a257cf5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:56.512788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f69ff-8c40-4fa4-92c0-788a257cf5de None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:56.513066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f69ff-8c40-4fa4-92c0-788a257cf5de None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:56.513337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f69ff-8c40-4fa4-92c0-788a257cf5de None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:56.514015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f69ff-8c40-4fa4-92c0-788a257cf5de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:56.515387 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f69ff-8c40-4fa4-92c0-788a257cf5de None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:56.522408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 509/989] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 08:17:56 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:17:56.730157 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf827a-45e7-49b6-9b8f-308f628a8070 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:56.730401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf827a-45e7-49b6-9b8f-308f628a8070 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:56.730714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf827a-45e7-49b6-9b8f-308f628a8070 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:56.732282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 481/990] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:56.737937 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29374ed2-2ed0-40e1-b058-b3faa5d3994e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:56.738201 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29374ed2-2ed0-40e1-b058-b3faa5d3994e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:56.738499 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29374ed2-2ed0-40e1-b058-b3faa5d3994e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:56.757969 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-29374ed2-2ed0-40e1-b058-b3faa5d3994e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:56.759171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-29374ed2-2ed0-40e1-b058-b3faa5d3994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:56.828897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 510/991] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:56.851078 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf827a-45e7-49b6-9b8f-308f628a8070 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:56.950820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:56.957788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf827a-45e7-49b6-9b8f-308f628a8070 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:56.995730 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce37800-30ac-42de-9d77-3a00ebc6ee22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:56.996590 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce37800-30ac-42de-9d77-3a00ebc6ee22 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:56.996866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce37800-30ac-42de-9d77-3a00ebc6ee22 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:56.997196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce37800-30ac-42de-9d77-3a00ebc6ee22 None admin] PATH_INFO: `/v3/services/image` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:56.997860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce37800-30ac-42de-9d77-3a00ebc6ee22 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:56.999254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce37800-30ac-42de-9d77-3a00ebc6ee22 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-1ce37800-30ac-42de-9d77-3a00ebc6ee22 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:57.011370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:57.012503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:57.013406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:57.013406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:57.013406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:57.013406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:57.013406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:57.013406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:57.013406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:57.013406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:57.013406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:57.013406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:57.013406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:57.013406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:57.013406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:17:57.013406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:57.014771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 482/992] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Jul 21 08:17:56 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:57.019165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29374ed2-2ed0-40e1-b058-b3faa5d3994e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:57.123079 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:57.134003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29374ed2-2ed0-40e1-b058-b3faa5d3994e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:57.169432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9733c7-48f2-4771-88f8-25ec0cfa7a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:57.170125 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9733c7-48f2-4771-88f8-25ec0cfa7a82 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:57.170402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9733c7-48f2-4771-88f8-25ec0cfa7a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:57.170667 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9733c7-48f2-4771-88f8-25ec0cfa7a82 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:57.171403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9733c7-48f2-4771-88f8-25ec0cfa7a82 None admin] RBAC: Adding query filter params (name=image) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:57.171745 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9733c7-48f2-4771-88f8-25ec0cfa7a82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:57.173114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9733c7-48f2-4771-88f8-25ec0cfa7a82 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:57.182966 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 511/993] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:57.184692 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce37800-30ac-42de-9d77-3a00ebc6ee22 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:57.292087 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce37800-30ac-42de-9d77-3a00ebc6ee22 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:57.325280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979cf2e-3d7e-4b57-b500-1746f1cef834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:57.325937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979cf2e-3d7e-4b57-b500-1746f1cef834 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:57.326270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979cf2e-3d7e-4b57-b500-1746f1cef834 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:57.326546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979cf2e-3d7e-4b57-b500-1746f1cef834 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:57.327254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979cf2e-3d7e-4b57-b500-1746f1cef834 None admin] RBAC: Adding query filter params (type=image) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:57.327560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979cf2e-3d7e-4b57-b500-1746f1cef834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:57.328973 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979cf2e-3d7e-4b57-b500-1746f1cef834 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:57.339828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 483/994] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:57.549080 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca264ae4-622c-405c-95ba-e72aa0b27725 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:57.549737 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca264ae4-622c-405c-95ba-e72aa0b27725 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:57.549737 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca264ae4-622c-405c-95ba-e72aa0b27725 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:57.551239 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 512/995] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:57.556541 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775057a9-8352-4cf3-bc23-169cc3e20c84 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:57.556794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775057a9-8352-4cf3-bc23-169cc3e20c84 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:57.557096 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775057a9-8352-4cf3-bc23-169cc3e20c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:57.574016 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-775057a9-8352-4cf3-bc23-169cc3e20c84 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:57.575213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-775057a9-8352-4cf3-bc23-169cc3e20c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:57.596108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:57.647701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 484/996] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:17:57.670634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca264ae4-622c-405c-95ba-e72aa0b27725 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:57.780821 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca264ae4-622c-405c-95ba-e72aa0b27725 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:57.818553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b422c29-a166-495e-adf1-33e056ff712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:57.819382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b422c29-a166-495e-adf1-33e056ff712a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:57.819678 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b422c29-a166-495e-adf1-33e056ff712a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:57.819948 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b422c29-a166-495e-adf1-33e056ff712a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:57.820638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b422c29-a166-495e-adf1-33e056ff712a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:57.822079 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b422c29-a166-495e-adf1-33e056ff712a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9b422c29-a166-495e-adf1-33e056ff712a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:57.834113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:57.835120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:57.841166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:57.841166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:57.841166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:57.841166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:57.841166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:57.841166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:57.841166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:57.841166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:57.841166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:57.841166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:57.841166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:57.841166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:57.841166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:17:57.841166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:17:57.841166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 513/997] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:57.842076 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775057a9-8352-4cf3-bc23-169cc3e20c84 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:57.940076 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775057a9-8352-4cf3-bc23-169cc3e20c84 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:57.973543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28531e67-d977-4075-8ae9-2c19f74a4965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:57.974209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28531e67-d977-4075-8ae9-2c19f74a4965 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:57.974486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28531e67-d977-4075-8ae9-2c19f74a4965 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:57.974881 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28531e67-d977-4075-8ae9-2c19f74a4965 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:57.975653 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28531e67-d977-4075-8ae9-2c19f74a4965 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:57.975958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28531e67-d977-4075-8ae9-2c19f74a4965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:57.977377 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28531e67-d977-4075-8ae9-2c19f74a4965 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:57.982668 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 485/998] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 08:17:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:17:57.988460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b422c29-a166-495e-adf1-33e056ff712a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:58.010179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:58.098029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b422c29-a166-495e-adf1-33e056ff712a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:58.132151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f13548-2e5c-4564-998b-bbca251f918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:58.132822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f13548-2e5c-4564-998b-bbca251f918b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:58.133093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f13548-2e5c-4564-998b-bbca251f918b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:58.133383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f13548-2e5c-4564-998b-bbca251f918b None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:58.134088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f13548-2e5c-4564-998b-bbca251f918b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:58.134393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f13548-2e5c-4564-998b-bbca251f918b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:58.135810 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f13548-2e5c-4564-998b-bbca251f918b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:58.140862 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 514/999] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 08:17:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:58.146697 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28531e67-d977-4075-8ae9-2c19f74a4965 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:58.170869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:58.251904 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28531e67-d977-4075-8ae9-2c19f74a4965 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:58.287769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9068b1-e798-48d2-91db-463f2c60387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:58.288422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9068b1-e798-48d2-91db-463f2c60387b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:58.288699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9068b1-e798-48d2-91db-463f2c60387b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:58.288966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9068b1-e798-48d2-91db-463f2c60387b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:58.289872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9068b1-e798-48d2-91db-463f2c60387b None admin] RBAC: Adding query filter params (interface=public, service_id=af1f1aefa50a4312ad8b38acebc85335, region_id=RegionOne) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:58.290178 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9068b1-e798-48d2-91db-463f2c60387b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:58.291559 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9068b1-e798-48d2-91db-463f2c60387b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:58.296884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 486/1000] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 08:17:58 2022] GET /identity/v3/endpoints?service_id=af1f1aefa50a4312ad8b38acebc85335&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:58.302330 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f13548-2e5c-4564-998b-bbca251f918b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:58.387094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:58.406248 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f13548-2e5c-4564-998b-bbca251f918b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:58.452186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6fec5-bc8d-4d45-ab4d-a2f13e47848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:58.452888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6fec5-bc8d-4d45-ab4d-a2f13e47848d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:58.453167 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6fec5-bc8d-4d45-ab4d-a2f13e47848d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:58.453442 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6fec5-bc8d-4d45-ab4d-a2f13e47848d None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:58.454148 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6fec5-bc8d-4d45-ab4d-a2f13e47848d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:58.456082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6fec5-bc8d-4d45-ab4d-a2f13e47848d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:58.471676 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 515/1001] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 08:17:58 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:17:58.564055 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bac54-0a33-47ab-a895-0375f8b299aa None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:58.564363 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bac54-0a33-47ab-a895-0375f8b299aa None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:58.564751 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bac54-0a33-47ab-a895-0375f8b299aa None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:58.566286 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 487/1002] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:58.571868 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64968750-049c-4013-9be3-8b3d3812f325 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:58.572385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64968750-049c-4013-9be3-8b3d3812f325 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:58.572385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64968750-049c-4013-9be3-8b3d3812f325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:58.590293 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-64968750-049c-4013-9be3-8b3d3812f325 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:58.591521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-64968750-049c-4013-9be3-8b3d3812f325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:58.665204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 516/1003] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:58.688859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bac54-0a33-47ab-a895-0375f8b299aa None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:58.786686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:58.805363 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bac54-0a33-47ab-a895-0375f8b299aa None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:58.839943 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf747b9-2284-4629-87e8-cf4c9fe5a191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:58.840777 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf747b9-2284-4629-87e8-cf4c9fe5a191 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:58.841053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf747b9-2284-4629-87e8-cf4c9fe5a191 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:58.841328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf747b9-2284-4629-87e8-cf4c9fe5a191 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:58.841987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf747b9-2284-4629-87e8-cf4c9fe5a191 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:58.843361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf747b9-2284-4629-87e8-cf4c9fe5a191 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-0bf747b9-2284-4629-87e8-cf4c9fe5a191 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:58.855950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:58.856918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:58.857794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:58.857794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:58.857794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:58.857794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:58.857794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:58.857794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:58.857794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:58.857794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:58.857794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:58.857794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:58.857794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:58.857794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:58.857794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:17:58.857794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:17:58.859972 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 488/1004] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 08:17:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:58.864029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64968750-049c-4013-9be3-8b3d3812f325 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:58.945158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:58.970095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64968750-049c-4013-9be3-8b3d3812f325 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:59.005747 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1adb3a-99bb-45fd-8cfa-d624592c3e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:59.006420 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1adb3a-99bb-45fd-8cfa-d624592c3e81 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:59.006700 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1adb3a-99bb-45fd-8cfa-d624592c3e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:59.006972 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1adb3a-99bb-45fd-8cfa-d624592c3e81 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:59.007703 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1adb3a-99bb-45fd-8cfa-d624592c3e81 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:59.008007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1adb3a-99bb-45fd-8cfa-d624592c3e81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:59.009382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1adb3a-99bb-45fd-8cfa-d624592c3e81 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:59.019766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 517/1005] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 08:17:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:59.021545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf747b9-2284-4629-87e8-cf4c9fe5a191 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:59.131818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf747b9-2284-4629-87e8-cf4c9fe5a191 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:59.167334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25dc67-bbe3-4a3b-92ac-fb365a4aa78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:59.168043 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25dc67-bbe3-4a3b-92ac-fb365a4aa78a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:59.168327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25dc67-bbe3-4a3b-92ac-fb365a4aa78a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:59.168604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25dc67-bbe3-4a3b-92ac-fb365a4aa78a None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:59.169320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25dc67-bbe3-4a3b-92ac-fb365a4aa78a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:59.169627 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25dc67-bbe3-4a3b-92ac-fb365a4aa78a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:59.171007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25dc67-bbe3-4a3b-92ac-fb365a4aa78a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:59.176750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 489/1006] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 08:17:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:59.182535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1adb3a-99bb-45fd-8cfa-d624592c3e81 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:59.287411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1adb3a-99bb-45fd-8cfa-d624592c3e81 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:59.322037 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97745472-8625-4c84-9a8f-ce9d0cf779d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:59.322707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97745472-8625-4c84-9a8f-ce9d0cf779d4 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:59.322989 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97745472-8625-4c84-9a8f-ce9d0cf779d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:59.323268 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97745472-8625-4c84-9a8f-ce9d0cf779d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:59.324067 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97745472-8625-4c84-9a8f-ce9d0cf779d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:59.325456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97745472-8625-4c84-9a8f-ce9d0cf779d4 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:59.336805 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:59.350256 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 518/1007] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 08:17:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:59.393255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8e94f-49e3-4f9b-8a47-43dbc4d73b39 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:59.393799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8e94f-49e3-4f9b-8a47-43dbc4d73b39 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:59.393799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8e94f-49e3-4f9b-8a47-43dbc4d73b39 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:59.395457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 490/1008] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:59.401885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1ed18-6a0c-4554-8653-f83ca92bc158 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:59.402145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1ed18-6a0c-4554-8653-f83ca92bc158 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:59.402453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1ed18-6a0c-4554-8653-f83ca92bc158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:59.423803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-38f1ed18-6a0c-4554-8653-f83ca92bc158 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:59.425058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-38f1ed18-6a0c-4554-8653-f83ca92bc158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:59.518143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 519/1009] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:59.541201 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8e94f-49e3-4f9b-8a47-43dbc4d73b39 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:59.557264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:59.653215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8e94f-49e3-4f9b-8a47-43dbc4d73b39 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:59.687816 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53cdc7-00f3-41ab-b91f-c1fccdd6f541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:59.688467 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53cdc7-00f3-41ab-b91f-c1fccdd6f541 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:59.688885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53cdc7-00f3-41ab-b91f-c1fccdd6f541 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:59.689125 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53cdc7-00f3-41ab-b91f-c1fccdd6f541 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:59.689864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53cdc7-00f3-41ab-b91f-c1fccdd6f541 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:59.691244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53cdc7-00f3-41ab-b91f-c1fccdd6f541 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:59.709072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 491/1010] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 08:17:59 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:00.541247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe0a6b-eb66-4525-b2cb-9556a94766b0 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:00.541794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe0a6b-eb66-4525-b2cb-9556a94766b0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:00.541794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe0a6b-eb66-4525-b2cb-9556a94766b0 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:00.543394 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 520/1011] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:00.549351 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a925611-7a29-4b7e-b141-3afc7fa043a4 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:00.549814 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a925611-7a29-4b7e-b141-3afc7fa043a4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:00.549889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a925611-7a29-4b7e-b141-3afc7fa043a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:00.567241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6a925611-7a29-4b7e-b141-3afc7fa043a4 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:00.568639 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6a925611-7a29-4b7e-b141-3afc7fa043a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:00.638931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:00.650092 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 492/1012] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:00 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:00.670664 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe0a6b-eb66-4525-b2cb-9556a94766b0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:00.778516 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe0a6b-eb66-4525-b2cb-9556a94766b0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:00.805452 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:00.818341 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45656391-2049-433d-b9ae-e4097934e274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:00.819166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45656391-2049-433d-b9ae-e4097934e274 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:00.819451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45656391-2049-433d-b9ae-e4097934e274 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:00.819757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45656391-2049-433d-b9ae-e4097934e274 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:00.820421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45656391-2049-433d-b9ae-e4097934e274 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:00.821829 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45656391-2049-433d-b9ae-e4097934e274 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-45656391-2049-433d-b9ae-e4097934e274 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:00.834455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:00.835548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:00.841823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:00.841823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:00.841823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:00.841823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:00.841823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:00.841823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:00.841823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:00.841823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:00.841823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:00.841823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:00.841823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:18:00.841823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:18:00.841823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:18:00.841823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:00.841823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 521/1013] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:18:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:00.844304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a925611-7a29-4b7e-b141-3afc7fa043a4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:00.953858 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a925611-7a29-4b7e-b141-3afc7fa043a4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:00.988123 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b542894-29af-482b-9c54-b0dc9866daaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:00.988821 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b542894-29af-482b-9c54-b0dc9866daaf None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:00.989099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b542894-29af-482b-9c54-b0dc9866daaf None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:00.989375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b542894-29af-482b-9c54-b0dc9866daaf None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:00.990088 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b542894-29af-482b-9c54-b0dc9866daaf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:00.990393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b542894-29af-482b-9c54-b0dc9866daaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:00.991799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b542894-29af-482b-9c54-b0dc9866daaf None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:00.996966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 493/1014] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 08:18:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:01.002879 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45656391-2049-433d-b9ae-e4097934e274 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:01.114816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45656391-2049-433d-b9ae-e4097934e274 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:01.150123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39782a-c58e-4093-bca0-71081180b6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:01.150837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39782a-c58e-4093-bca0-71081180b6fe None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:01.151145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39782a-c58e-4093-bca0-71081180b6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:01.151452 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39782a-c58e-4093-bca0-71081180b6fe None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:01.152219 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39782a-c58e-4093-bca0-71081180b6fe None admin] RBAC: Adding query filter params (type=compute) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:01.152507 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39782a-c58e-4093-bca0-71081180b6fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:01.153932 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39782a-c58e-4093-bca0-71081180b6fe None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:01.164197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 522/1015] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 08:18:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:01.165829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b542894-29af-482b-9c54-b0dc9866daaf None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:01.229906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:01.270450 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b542894-29af-482b-9c54-b0dc9866daaf None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:01.306907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6791427-7796-407b-a57d-4ccfb23c6af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:01.307566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6791427-7796-407b-a57d-4ccfb23c6af7 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:01.307875 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6791427-7796-407b-a57d-4ccfb23c6af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:01.308151 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6791427-7796-407b-a57d-4ccfb23c6af7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:01.308920 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6791427-7796-407b-a57d-4ccfb23c6af7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:01.310303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6791427-7796-407b-a57d-4ccfb23c6af7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:01.330512 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 494/1016] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 08:18:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:01.406815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d7fb5-1149-481e-8767-d6b467e4f544 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:01.407187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d7fb5-1149-481e-8767-d6b467e4f544 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:01.407347 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d7fb5-1149-481e-8767-d6b467e4f544 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:01.409256 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 523/1017] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:01.415133 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24938196-fd35-42f4-84fd-855e4979a51e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:01.415369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24938196-fd35-42f4-84fd-855e4979a51e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:01.415684 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24938196-fd35-42f4-84fd-855e4979a51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:01.436407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-24938196-fd35-42f4-84fd-855e4979a51e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:01.436407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-24938196-fd35-42f4-84fd-855e4979a51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:01.521601 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 495/1018] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:01.545339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d7fb5-1149-481e-8767-d6b467e4f544 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:01.606522 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:01.654807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d7fb5-1149-481e-8767-d6b467e4f544 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:01.690521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ba839-4ca9-4b1b-b52a-76084ed95d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:01.691311 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ba839-4ca9-4b1b-b52a-76084ed95d9d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:01.691592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ba839-4ca9-4b1b-b52a-76084ed95d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:01.691891 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ba839-4ca9-4b1b-b52a-76084ed95d9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:01.693070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ba839-4ca9-4b1b-b52a-76084ed95d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:01.694524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ba839-4ca9-4b1b-b52a-76084ed95d9d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:01.696205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 524/1019] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:01.702280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24938196-fd35-42f4-84fd-855e4979a51e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:01.748466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:01.800488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c760fb-cb86-4fa2-abcc-27510db0ff5b None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:01.800827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c760fb-cb86-4fa2-abcc-27510db0ff5b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:01.801051 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c760fb-cb86-4fa2-abcc-27510db0ff5b None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:01.802577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 525/1020] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:18:01.807553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e39529-5ac9-43e6-9785-31b06db4b070 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:01.807795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24938196-fd35-42f4-84fd-855e4979a51e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:01.808279 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e39529-5ac9-43e6-9785-31b06db4b070 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:01.808757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e39529-5ac9-43e6-9785-31b06db4b070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:01.831108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-24e39529-5ac9-43e6-9785-31b06db4b070 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:01.833069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-24e39529-5ac9-43e6-9785-31b06db4b070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:01.844166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460cee4-95a6-48fa-8984-d89e034dadd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:01.844837 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460cee4-95a6-48fa-8984-d89e034dadd2 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:01.845259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460cee4-95a6-48fa-8984-d89e034dadd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:01.845538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460cee4-95a6-48fa-8984-d89e034dadd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:01.846614 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460cee4-95a6-48fa-8984-d89e034dadd2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:01.848398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460cee4-95a6-48fa-8984-d89e034dadd2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:01.877134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 496/1021] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 08:18:01 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:01.922148 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 526/1022] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:01.950556 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460cee4-95a6-48fa-8984-d89e034dadd2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:02.062843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:02.071280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460cee4-95a6-48fa-8984-d89e034dadd2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:02.107986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c951ef0-f2d1-4216-af30-3ba3e16a5572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:02.109052 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c951ef0-f2d1-4216-af30-3ba3e16a5572 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:02.109505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c951ef0-f2d1-4216-af30-3ba3e16a5572 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:02.109943 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c951ef0-f2d1-4216-af30-3ba3e16a5572 None admin] PATH_INFO: `/v3/services/image` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:02.110893 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c951ef0-f2d1-4216-af30-3ba3e16a5572 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:02.112746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c951ef0-f2d1-4216-af30-3ba3e16a5572 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-4c951ef0-f2d1-4216-af30-3ba3e16a5572 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:02.124978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:02.126085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:02.127506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:02.127506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:02.127506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:02.127506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:02.127506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:02.127506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:02.127506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:02.127506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:02.127506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:02.127506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:02.127506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:18:02.127506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:18:02.127506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:18:02.127506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:02.132676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 497/1023] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Jul 21 08:18:01 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:02.135064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e39529-5ac9-43e6-9785-31b06db4b070 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:02.193023 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:02.243025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e39529-5ac9-43e6-9785-31b06db4b070 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:02.279770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adc267-1975-44f6-bca5-941d14c332dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:02.280756 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adc267-1975-44f6-bca5-941d14c332dd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:02.281222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adc267-1975-44f6-bca5-941d14c332dd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:02.281677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adc267-1975-44f6-bca5-941d14c332dd None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:02.282791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adc267-1975-44f6-bca5-941d14c332dd None admin] RBAC: Adding query filter params (name=image) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:02.283543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adc267-1975-44f6-bca5-941d14c332dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:02.285123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adc267-1975-44f6-bca5-941d14c332dd None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:02.295178 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 527/1024] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:02.296488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c951ef0-f2d1-4216-af30-3ba3e16a5572 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:02.403068 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c951ef0-f2d1-4216-af30-3ba3e16a5572 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:02.439930 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1670184-0069-425c-ab01-da8b3d6864fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:02.440636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1670184-0069-425c-ab01-da8b3d6864fd None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:02.440919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1670184-0069-425c-ab01-da8b3d6864fd None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:02.441192 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1670184-0069-425c-ab01-da8b3d6864fd None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:02.441907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1670184-0069-425c-ab01-da8b3d6864fd None admin] RBAC: Adding query filter params (type=image) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:02.442214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1670184-0069-425c-ab01-da8b3d6864fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:02.443591 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1670184-0069-425c-ab01-da8b3d6864fd None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:02.451760 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 498/1025] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:02.455183 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adc267-1975-44f6-bca5-941d14c332dd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:02.557766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adc267-1975-44f6-bca5-941d14c332dd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:02.576017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:02.598374 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707949cf-b3cd-48b1-9add-48f9a6deb884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:02.599044 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707949cf-b3cd-48b1-9add-48f9a6deb884 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:02.599331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707949cf-b3cd-48b1-9add-48f9a6deb884 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:02.599624 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707949cf-b3cd-48b1-9add-48f9a6deb884 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:02.600436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707949cf-b3cd-48b1-9add-48f9a6deb884 None admin] RBAC: Adding query filter params (interface=public, service_id=7a8a208eb16b4c83995227eea855f636, region_id=RegionOne) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:02.600753 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707949cf-b3cd-48b1-9add-48f9a6deb884 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:02.602155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707949cf-b3cd-48b1-9add-48f9a6deb884 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:02.612422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 528/1026] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 08:18:02 2022] GET /identity/v3/endpoints?service_id=7a8a208eb16b4c83995227eea855f636&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:02.613531 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1670184-0069-425c-ab01-da8b3d6864fd None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:02.640528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:02.721254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1670184-0069-425c-ab01-da8b3d6864fd None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:02.755403 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505d10b-3645-487c-9c8f-f575c3d1e1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:02.756100 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505d10b-3645-487c-9c8f-f575c3d1e1fb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:02.756371 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505d10b-3645-487c-9c8f-f575c3d1e1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:02.756652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505d10b-3645-487c-9c8f-f575c3d1e1fb None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:02.757345 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505d10b-3645-487c-9c8f-f575c3d1e1fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:02.758813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505d10b-3645-487c-9c8f-f575c3d1e1fb None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:02.765553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 499/1027] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 08:18:02 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:18:03.501081 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0964ed1-e3dc-4bd1-bb05-345f22900500 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:03.501606 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0964ed1-e3dc-4bd1-bb05-345f22900500 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:03.501904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0964ed1-e3dc-4bd1-bb05-345f22900500 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:03.503505 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 529/1028] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:03.509256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dd691-b718-44ec-8599-171e1ff12c18 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:03.509549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dd691-b718-44ec-8599-171e1ff12c18 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:03.509933 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dd691-b718-44ec-8599-171e1ff12c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:03.527347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-653dd691-b718-44ec-8599-171e1ff12c18 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:03.528559 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-653dd691-b718-44ec-8599-171e1ff12c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:03.594538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 500/1029] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:18:03.618177 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0964ed1-e3dc-4bd1-bb05-345f22900500 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:03.721517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0964ed1-e3dc-4bd1-bb05-345f22900500 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:03.755533 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0bc20-8cc3-4bc2-a1ce-b3d931c4a9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:03.756381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0bc20-8cc3-4bc2-a1ce-b3d931c4a9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:03.756656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0bc20-8cc3-4bc2-a1ce-b3d931c4a9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:03.756926 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0bc20-8cc3-4bc2-a1ce-b3d931c4a9c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:03.767550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0bc20-8cc3-4bc2-a1ce-b3d931c4a9c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9cb0bc20-8cc3-4bc2-a1ce-b3d931c4a9c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:03.776218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:03.777146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:03.777988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:03.777988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:03.777988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:03.777988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:03.777988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:03.777988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:03.777988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:03.777988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:03.777988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:03.777988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:03.777988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:18:03.777988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:03.779684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 530/1030] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 21 08:18:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:03.783747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653dd691-b718-44ec-8599-171e1ff12c18 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:03.802067 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:03.887229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653dd691-b718-44ec-8599-171e1ff12c18 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:03.923652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7ebda-35ee-427b-89ce-6f1aa4df24df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:03.924350 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7ebda-35ee-427b-89ce-6f1aa4df24df None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:03.924650 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7ebda-35ee-427b-89ce-6f1aa4df24df None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:03.924899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7ebda-35ee-427b-89ce-6f1aa4df24df None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:03.925657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7ebda-35ee-427b-89ce-6f1aa4df24df None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:03.925957 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7ebda-35ee-427b-89ce-6f1aa4df24df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:03.927330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7ebda-35ee-427b-89ce-6f1aa4df24df None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:03.936082 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 501/1031] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 21 08:18:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:03.941956 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0bc20-8cc3-4bc2-a1ce-b3d931c4a9c4 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:03.986466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7f3a6-73be-4933-a432-7f63fb1bffb0 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:03.986670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7f3a6-73be-4933-a432-7f63fb1bffb0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:03.986917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7f3a6-73be-4933-a432-7f63fb1bffb0 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:03.988232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:03.988602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 502/1032] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:18:03.993719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08da45c-f3f1-47b5-ab60-cf0f247d9d5c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:03.994020 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08da45c-f3f1-47b5-ab60-cf0f247d9d5c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:03.994298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08da45c-f3f1-47b5-ab60-cf0f247d9d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:04.015644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-d08da45c-f3f1-47b5-ab60-cf0f247d9d5c None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:04.017051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d08da45c-f3f1-47b5-ab60-cf0f247d9d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:04.059722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0bc20-8cc3-4bc2-a1ce-b3d931c4a9c4 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:04.091731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 503/1033] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:18:04.093529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efe3f2-396a-45c8-9541-7a8af16814d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:04.094411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efe3f2-396a-45c8-9541-7a8af16814d1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:04.094777 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efe3f2-396a-45c8-9541-7a8af16814d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:04.095292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efe3f2-396a-45c8-9541-7a8af16814d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:04.107204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efe3f2-396a-45c8-9541-7a8af16814d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:04.108882 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efe3f2-396a-45c8-9541-7a8af16814d1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:04.112117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08da45c-f3f1-47b5-ab60-cf0f247d9d5c None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:04.123739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:04.127359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-e2efe3f2-396a-45c8-9541-7a8af16814d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:04.127359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:04.127359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:04.127359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:04.127359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:04.127359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:04.127359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:04.127359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:04.127359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:04.127359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:04.127359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:04.127359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:04.127359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:18:04.127359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:18:04.127359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:04.128427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:04.129328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:18:04.129328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:18:04.129328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:04.129328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:04.129328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 531/1034] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:04.134297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efe3f2-396a-45c8-9541-7a8af16814d1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:04.223157 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08da45c-f3f1-47b5-ab60-cf0f247d9d5c None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:04.233559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:04.243910 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efe3f2-396a-45c8-9541-7a8af16814d1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:04.258855 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852fdc0-f805-4686-9179-12ba302f3587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:04.259752 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852fdc0-f805-4686-9179-12ba302f3587 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:04.260038 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852fdc0-f805-4686-9179-12ba302f3587 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:04.260315 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852fdc0-f805-4686-9179-12ba302f3587 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:04.261510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852fdc0-f805-4686-9179-12ba302f3587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:04.262963 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852fdc0-f805-4686-9179-12ba302f3587 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:04.264652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 504/1035] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:04.271327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852fdc0-f805-4686-9179-12ba302f3587 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:04.286346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af884146-9ee6-4d69-b862-3a052ab6044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:04.287082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af884146-9ee6-4d69-b862-3a052ab6044e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:04.287364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af884146-9ee6-4d69-b862-3a052ab6044e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:04.287743 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af884146-9ee6-4d69-b862-3a052ab6044e None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:04.288482 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af884146-9ee6-4d69-b862-3a052ab6044e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:04.288811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af884146-9ee6-4d69-b862-3a052ab6044e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:04.290196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af884146-9ee6-4d69-b862-3a052ab6044e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:04.303034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 532/1036] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:04.309117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af884146-9ee6-4d69-b862-3a052ab6044e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:04.355390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:04.379260 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852fdc0-f805-4686-9179-12ba302f3587 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:04.417309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428f2bb-b38f-4873-9d9b-4b34a46110f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:04.418020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af884146-9ee6-4d69-b862-3a052ab6044e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:04.418134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428f2bb-b38f-4873-9d9b-4b34a46110f2 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:04.418319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428f2bb-b38f-4873-9d9b-4b34a46110f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:04.418540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428f2bb-b38f-4873-9d9b-4b34a46110f2 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:04.419255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428f2bb-b38f-4873-9d9b-4b34a46110f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:04.420829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428f2bb-b38f-4873-9d9b-4b34a46110f2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:04.447121 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 505/1037] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:18:04 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:18:04.472190 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0d582-64ad-4101-a513-5eb15e93ef34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:04.473034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0d582-64ad-4101-a513-5eb15e93ef34 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:04.473322 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0d582-64ad-4101-a513-5eb15e93ef34 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:04.473597 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0d582-64ad-4101-a513-5eb15e93ef34 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:04.482762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0d582-64ad-4101-a513-5eb15e93ef34 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:04.484323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0d582-64ad-4101-a513-5eb15e93ef34 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-07d0d582-64ad-4101-a513-5eb15e93ef34 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:18:04.501057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:04.502138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:04.508786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:04.508786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:04.508786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:18:04.508786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:18:04.508786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:18:04.508786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:18:04.508786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:18:04.508786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:18:04.508786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:18:04.508786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:04.508786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 533/1038] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 08:18:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:18:04.510899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428f2bb-b38f-4873-9d9b-4b34a46110f2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:04.628749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428f2bb-b38f-4873-9d9b-4b34a46110f2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:04.662911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45888cf4-0fd2-4a5b-a256-9b4e1e378838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:04.663570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45888cf4-0fd2-4a5b-a256-9b4e1e378838 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:04.663946 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45888cf4-0fd2-4a5b-a256-9b4e1e378838 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:04.664364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45888cf4-0fd2-4a5b-a256-9b4e1e378838 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:04.665182 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45888cf4-0fd2-4a5b-a256-9b4e1e378838 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:04.665491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45888cf4-0fd2-4a5b-a256-9b4e1e378838 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:04.666926 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45888cf4-0fd2-4a5b-a256-9b4e1e378838 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:04.668647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:04.687249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 506/1039] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 08:18:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:04.693120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0d582-64ad-4101-a513-5eb15e93ef34 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:04.709088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:04.798717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0d582-64ad-4101-a513-5eb15e93ef34 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:04.833409 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ab1ec-6aef-48ab-b9ad-f7f276a10a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:04.834104 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ab1ec-6aef-48ab-b9ad-f7f276a10a71 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:04.834389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ab1ec-6aef-48ab-b9ad-f7f276a10a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:04.834670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ab1ec-6aef-48ab-b9ad-f7f276a10a71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:04.834780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b586f5-1bde-490b-bbef-425c7e8269a0 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:04.835206 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b586f5-1bde-490b-bbef-425c7e8269a0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:04.835389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b586f5-1bde-490b-bbef-425c7e8269a0 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:04.837042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 507/1040] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:04.842163 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191014d-24b9-4655-834a-c86b30b82ff8 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:04.842450 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191014d-24b9-4655-834a-c86b30b82ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:04.842724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191014d-24b9-4655-834a-c86b30b82ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:04.859864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-4191014d-24b9-4655-834a-c86b30b82ff8 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:04.861139 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4191014d-24b9-4655-834a-c86b30b82ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:04.909895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ab1ec-6aef-48ab-b9ad-f7f276a10a71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:04.911376 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ab1ec-6aef-48ab-b9ad-f7f276a10a71 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:04.926179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:04.932934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 508/1041] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:18:04.956166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191014d-24b9-4655-834a-c86b30b82ff8 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:05.019860 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 534/1042] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:04 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:18:05.026103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ab1ec-6aef-48ab-b9ad-f7f276a10a71 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:05.067518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191014d-24b9-4655-834a-c86b30b82ff8 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:05.092430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:05.106880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2a2a4-fd08-4346-890e-f74fea431552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:05.107826 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2a2a4-fd08-4346-890e-f74fea431552 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:05.108067 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2a2a4-fd08-4346-890e-f74fea431552 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:05.108368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2a2a4-fd08-4346-890e-f74fea431552 None admin] PATH_INFO: `/v3/services/image` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:05.109136 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2a2a4-fd08-4346-890e-f74fea431552 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:05.110685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2a2a4-fd08-4346-890e-f74fea431552 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-29d2a2a4-fd08-4346-890e-f74fea431552 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:05.129297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:05.130414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:05.131252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:05.131252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:05.131252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:05.131252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:05.131252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:05.131252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:05.131252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:05.131252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:05.131252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:05.131252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:05.131252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:18:05.131252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:18:05.131252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:18:05.131252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:05.131252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 509/1043] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Jul 21 08:18:04 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:18:05.136314 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ab1ec-6aef-48ab-b9ad-f7f276a10a71 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:05.136908 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2a2a4-fd08-4346-890e-f74fea431552 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:05.155797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:05.180248 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1bacb-2950-4c1a-8a28-0aefca74cbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:05.181058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1bacb-2950-4c1a-8a28-0aefca74cbce None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:05.181340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1bacb-2950-4c1a-8a28-0aefca74cbce None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:05.181612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1bacb-2950-4c1a-8a28-0aefca74cbce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:05.192774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1bacb-2950-4c1a-8a28-0aefca74cbce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:05.194250 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1bacb-2950-4c1a-8a28-0aefca74cbce None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:05.212359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-97f1bacb-2950-4c1a-8a28-0aefca74cbce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:05.212359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:05.212359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:05.212359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:05.212359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:05.212359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:05.212359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:05.212359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:05.212359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:05.212359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:05.212359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:05.212359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:05.212359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:18:05.212359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:18:05.212359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:05.213294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:05.214236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:18:05.214236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:18:05.214236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:05.214236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:05.214236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 535/1044] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:05.220794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1bacb-2950-4c1a-8a28-0aefca74cbce None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:05.252870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2a2a4-fd08-4346-890e-f74fea431552 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:05.290775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e6ad6-9464-42a6-a195-167545b0fb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:05.291718 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e6ad6-9464-42a6-a195-167545b0fb9c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:05.291848 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e6ad6-9464-42a6-a195-167545b0fb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:05.292024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e6ad6-9464-42a6-a195-167545b0fb9c None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:05.292736 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e6ad6-9464-42a6-a195-167545b0fb9c None admin] RBAC: Adding query filter params (name=image) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:05.293046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e6ad6-9464-42a6-a195-167545b0fb9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:05.294431 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e6ad6-9464-42a6-a195-167545b0fb9c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:05.299984 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 510/1045] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:05.305805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e6ad6-9464-42a6-a195-167545b0fb9c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:05.325930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1bacb-2950-4c1a-8a28-0aefca74cbce None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:05.360424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8d042-cc7c-4266-9aef-938748edb586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:05.361065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:05.361379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8d042-cc7c-4266-9aef-938748edb586 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:05.361663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8d042-cc7c-4266-9aef-938748edb586 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:05.361938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8d042-cc7c-4266-9aef-938748edb586 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:05.362669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8d042-cc7c-4266-9aef-938748edb586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:05.362976 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8d042-cc7c-4266-9aef-938748edb586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:05.365202 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8d042-cc7c-4266-9aef-938748edb586 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:05.377462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 536/1046] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:05.382902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8d042-cc7c-4266-9aef-938748edb586 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:05.412390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:05.417084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e6ad6-9464-42a6-a195-167545b0fb9c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:05.456921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97dc53-633d-4cb5-a02c-5d5b12347ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:05.457688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97dc53-633d-4cb5-a02c-5d5b12347ebc None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:05.458038 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97dc53-633d-4cb5-a02c-5d5b12347ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:05.458385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97dc53-633d-4cb5-a02c-5d5b12347ebc None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:05.459178 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97dc53-633d-4cb5-a02c-5d5b12347ebc None admin] RBAC: Adding query filter params (type=image) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:05.459556 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97dc53-633d-4cb5-a02c-5d5b12347ebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:05.461040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97dc53-633d-4cb5-a02c-5d5b12347ebc None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:05.466098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 511/1047] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:05.472076 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97dc53-633d-4cb5-a02c-5d5b12347ebc None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:05.498238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8d042-cc7c-4266-9aef-938748edb586 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:05.538027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eab625-c7db-4329-b009-7569f129500c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:05.539128 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eab625-c7db-4329-b009-7569f129500c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:05.539579 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eab625-c7db-4329-b009-7569f129500c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:05.540048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eab625-c7db-4329-b009-7569f129500c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:05.547801 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eab625-c7db-4329-b009-7569f129500c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:05.549684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eab625-c7db-4329-b009-7569f129500c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:05.565062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-42eab625-c7db-4329-b009-7569f129500c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:18:05.565062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:05.565062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:05.565062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:05.565062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:05.565062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:05.565062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:05.565062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:05.565062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:05.565062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:05.565062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:05.565062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:05.565062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:18:05.565062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:18:05.565062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:05.565953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:05.566895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:18:05.566895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:18:05.566895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:18:05.566895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:18:05.566895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:18:05.566895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:18:05.566895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:18:05.566895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:05.569295 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 537/1048] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:18:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:18:05.574872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eab625-c7db-4329-b009-7569f129500c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:05.578919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97dc53-633d-4cb5-a02c-5d5b12347ebc None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:05.593334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:05.617347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b927ab-2c3a-436f-8dc5-b0464da0c6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:05.617999 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b927ab-2c3a-436f-8dc5-b0464da0c6d3 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:05.618647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b927ab-2c3a-436f-8dc5-b0464da0c6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:05.618647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b927ab-2c3a-436f-8dc5-b0464da0c6d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:05.619309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b927ab-2c3a-436f-8dc5-b0464da0c6d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:05.620937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b927ab-2c3a-436f-8dc5-b0464da0c6d3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:05.655640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 512/1049] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 08:18:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:18:05.674001 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:05.694211 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eab625-c7db-4329-b009-7569f129500c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:05.739101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0453d7-eaaa-4fe3-a9b5-168642c907b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:05.739823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0453d7-eaaa-4fe3-a9b5-168642c907b5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:05.740109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0453d7-eaaa-4fe3-a9b5-168642c907b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:05.740383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0453d7-eaaa-4fe3-a9b5-168642c907b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:05.741208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0453d7-eaaa-4fe3-a9b5-168642c907b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:05.741525 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0453d7-eaaa-4fe3-a9b5-168642c907b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:05.743010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0453d7-eaaa-4fe3-a9b5-168642c907b5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:05.756643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 538/1050] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:18:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:05.762912 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b927ab-2c3a-436f-8dc5-b0464da0c6d3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:05.872072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b927ab-2c3a-436f-8dc5-b0464da0c6d3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:05.906373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a8826-7759-4b17-a9b5-8fcbcee033fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:05.907032 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a8826-7759-4b17-a9b5-8fcbcee033fd None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:05.907413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a8826-7759-4b17-a9b5-8fcbcee033fd None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:05.907718 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a8826-7759-4b17-a9b5-8fcbcee033fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:05.908578 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a8826-7759-4b17-a9b5-8fcbcee033fd None admin] RBAC: Adding query filter params (role.id=fc684ab3f3f04ccfbc26506de9e9dc2b, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=131bb5462c8b478783a350d37caa76ae) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:05.908901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a8826-7759-4b17-a9b5-8fcbcee033fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:05.910347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a8826-7759-4b17-a9b5-8fcbcee033fd None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:05.916522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 513/1051] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:05 2022] GET /identity/v3/role_assignments?user.id=131bb5462c8b478783a350d37caa76ae&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=fc684ab3f3f04ccfbc26506de9e9dc2b => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:06.566936 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b239f1-cb69-4194-8790-7d68df3a1cab None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:06.567323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b239f1-cb69-4194-8790-7d68df3a1cab None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:06.567495 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b239f1-cb69-4194-8790-7d68df3a1cab None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:06.568908 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 539/1052] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:06.574468 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c79a73-6c4b-4d5a-921c-59a714344809 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:06.574761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c79a73-6c4b-4d5a-921c-59a714344809 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:06.575020 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c79a73-6c4b-4d5a-921c-59a714344809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:06.593082 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e8c79a73-6c4b-4d5a-921c-59a714344809 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:06.594271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e8c79a73-6c4b-4d5a-921c-59a714344809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:06.621729 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:06.665898 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 514/1053] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:06.688905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b239f1-cb69-4194-8790-7d68df3a1cab None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:06.795286 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b239f1-cb69-4194-8790-7d68df3a1cab None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:06.830339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01377d-4c24-43d8-97ab-6619752d86fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:06.831147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01377d-4c24-43d8-97ab-6619752d86fd None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:06.831428 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01377d-4c24-43d8-97ab-6619752d86fd None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:06.831727 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01377d-4c24-43d8-97ab-6619752d86fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:06.839389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:06.843065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01377d-4c24-43d8-97ab-6619752d86fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-aa01377d-4c24-43d8-97ab-6619752d86fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:06.851385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:06.852496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:06.853340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:06.853340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:06.853340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:06.853340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:06.853340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:06.853340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:06.853340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:06.853340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:06.853340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:06.853340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:06.853340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:06.853340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:06.855993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 540/1054] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:06.858637 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c79a73-6c4b-4d5a-921c-59a714344809 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:06.959723 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c79a73-6c4b-4d5a-921c-59a714344809 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:06.994604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b2114-1636-4faf-b4d7-5d5c0483d79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:06.995283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b2114-1636-4faf-b4d7-5d5c0483d79f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:06.995564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b2114-1636-4faf-b4d7-5d5c0483d79f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:06.995870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b2114-1636-4faf-b4d7-5d5c0483d79f None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:06.996637 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b2114-1636-4faf-b4d7-5d5c0483d79f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:06.996945 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b2114-1636-4faf-b4d7-5d5c0483d79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:06.998361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b2114-1636-4faf-b4d7-5d5c0483d79f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:07.008597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 515/1055] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:07.014251 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01377d-4c24-43d8-97ab-6619752d86fd None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:07.115072 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01377d-4c24-43d8-97ab-6619752d86fd None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:07.154245 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a15fb-9d00-4a15-a495-702f9c1cc569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:07.155141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a15fb-9d00-4a15-a495-702f9c1cc569 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:07.155423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a15fb-9d00-4a15-a495-702f9c1cc569 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:07.155729 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a15fb-9d00-4a15-a495-702f9c1cc569 None admin] PATH_INFO: `/v3/users/1d93efc41be5464aacbc9ce07c0d7340` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:07.169614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a15fb-9d00-4a15-a495-702f9c1cc569 None admin] RBAC: Authorizing `identity:get_user(user_id=1d93efc41be5464aacbc9ce07c0d7340)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:07.171072 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a15fb-9d00-4a15-a495-702f9c1cc569 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:07.177820 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 541/1056] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:07 2022] GET /identity/v3/users/1d93efc41be5464aacbc9ce07c0d7340 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:07.179446 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b2114-1636-4faf-b4d7-5d5c0483d79f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:07.208033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:07.282094 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b2114-1636-4faf-b4d7-5d5c0483d79f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:07.315834 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080a065-2607-44b1-98e2-41428ed4205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:07.316489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080a065-2607-44b1-98e2-41428ed4205f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:07.316767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080a065-2607-44b1-98e2-41428ed4205f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:07.317039 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080a065-2607-44b1-98e2-41428ed4205f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:07.384959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080a065-2607-44b1-98e2-41428ed4205f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:07.386323 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080a065-2607-44b1-98e2-41428ed4205f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:07.412863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:07.503498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 516/1057] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 08:18:07.504953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a15fb-9d00-4a15-a495-702f9c1cc569 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:07.567524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:07.611793 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a15fb-9d00-4a15-a495-702f9c1cc569 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:07.646714 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01e4dc-8794-4bfd-8254-286b2a2337e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:07.647500 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01e4dc-8794-4bfd-8254-286b2a2337e5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:07.647807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01e4dc-8794-4bfd-8254-286b2a2337e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:07.648079 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01e4dc-8794-4bfd-8254-286b2a2337e5 None admin] PATH_INFO: `/v3/projects/fb63731c74cd4ded829ba352c7baea56` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:07.649587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01e4dc-8794-4bfd-8254-286b2a2337e5 None admin] RBAC: Authorizing `identity:get_project(project_id=fb63731c74cd4ded829ba352c7baea56)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:07.651071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01e4dc-8794-4bfd-8254-286b2a2337e5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:07.653045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 542/1058] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:07 2022] GET /identity/v3/projects/fb63731c74cd4ded829ba352c7baea56 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:07.659175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080a065-2607-44b1-98e2-41428ed4205f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:07.703549 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e46d83-ea7f-44f8-9c6a-8c0f54f4a4a9 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:07.703941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e46d83-ea7f-44f8-9c6a-8c0f54f4a4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:07.704189 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e46d83-ea7f-44f8-9c6a-8c0f54f4a4a9 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:07.705885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 543/1059] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:07.710672 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f505b5-fdc9-4fb9-956d-bfc1360587f6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:07.710950 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f505b5-fdc9-4fb9-956d-bfc1360587f6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:07.711225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f505b5-fdc9-4fb9-956d-bfc1360587f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:07.728825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-94f505b5-fdc9-4fb9-956d-bfc1360587f6 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:07.730015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-94f505b5-fdc9-4fb9-956d-bfc1360587f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:07.761316 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080a065-2607-44b1-98e2-41428ed4205f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:07.788863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:07.797821 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21699e62-040c-479c-b30b-addbdafd6b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:07.798491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21699e62-040c-479c-b30b-addbdafd6b71 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:07.798766 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21699e62-040c-479c-b30b-addbdafd6b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:07.799039 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21699e62-040c-479c-b30b-addbdafd6b71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:07.799891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21699e62-040c-479c-b30b-addbdafd6b71 None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=fb63731c74cd4ded829ba352c7baea56, user.id=1d93efc41be5464aacbc9ce07c0d7340) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:07.800205 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21699e62-040c-479c-b30b-addbdafd6b71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:07.807640 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 544/1060] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:18:07.808213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21699e62-040c-479c-b30b-addbdafd6b71 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:07.808213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 517/1061] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:07 2022] GET /identity/v3/role_assignments?user.id=1d93efc41be5464aacbc9ce07c0d7340&scope.project.id=fb63731c74cd4ded829ba352c7baea56&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:07.827103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f505b5-fdc9-4fb9-956d-bfc1360587f6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:07.892109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:07.923507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb005-afdd-4b60-aaae-637ee7e7a8a1 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:07.924328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb005-afdd-4b60-aaae-637ee7e7a8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:07.924621 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb005-afdd-4b60-aaae-637ee7e7a8a1 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:07.926271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 518/1062] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:07.932817 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a220ae-bc4e-4062-b7a0-4cbe4774ae7a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:07.933175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a220ae-bc4e-4062-b7a0-4cbe4774ae7a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:07.933370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a220ae-bc4e-4062-b7a0-4cbe4774ae7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:07.945421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f505b5-fdc9-4fb9-956d-bfc1360587f6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:07.954698 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c7a220ae-bc4e-4062-b7a0-4cbe4774ae7a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:07.956024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c7a220ae-bc4e-4062-b7a0-4cbe4774ae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:07.986644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09124146-627b-4356-9cc9-61c50bfd31ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:07.987311 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09124146-627b-4356-9cc9-61c50bfd31ef None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:07.987589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09124146-627b-4356-9cc9-61c50bfd31ef None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:07.987888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09124146-627b-4356-9cc9-61c50bfd31ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:08.055645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 519/1063] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:08.057648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09124146-627b-4356-9cc9-61c50bfd31ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:08.059116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09124146-627b-4356-9cc9-61c50bfd31ef None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:08.076257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a220ae-bc4e-4062-b7a0-4cbe4774ae7a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:08.117737 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:08.181399 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 545/1064] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:18:08.183166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09124146-627b-4356-9cc9-61c50bfd31ef None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:08.189676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a220ae-bc4e-4062-b7a0-4cbe4774ae7a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:08.212410 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:08.229666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abdae0-dded-4407-81f6-2c3b5ecb7da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:08.230497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abdae0-dded-4407-81f6-2c3b5ecb7da7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:08.230777 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abdae0-dded-4407-81f6-2c3b5ecb7da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:08.231053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abdae0-dded-4407-81f6-2c3b5ecb7da7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:08.242119 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abdae0-dded-4407-81f6-2c3b5ecb7da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-a5abdae0-dded-4407-81f6-2c3b5ecb7da7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:08.250307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:08.251570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:08.252538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:08.252538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:08.252538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:08.252538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:08.252538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:08.252538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:08.252538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:08.252538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:08.252538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:08.252538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:08.252538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:18:08.252538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:08.257145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 520/1065] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 21 08:18:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:08.257829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abdae0-dded-4407-81f6-2c3b5ecb7da7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:08.291159 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09124146-627b-4356-9cc9-61c50bfd31ef None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:08.328028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09019f-19a5-42c2-8725-7ea0dd2a445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:08.328836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09019f-19a5-42c2-8725-7ea0dd2a445b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:08.329170 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09019f-19a5-42c2-8725-7ea0dd2a445b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:08.329449 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09019f-19a5-42c2-8725-7ea0dd2a445b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:08.339954 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09019f-19a5-42c2-8725-7ea0dd2a445b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:08.341431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09019f-19a5-42c2-8725-7ea0dd2a445b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:08.359292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-8c09019f-19a5-42c2-8725-7ea0dd2a445b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:08.359292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:08.359292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:08.359292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:08.359292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:08.359292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:08.359292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:08.359292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:08.359292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:08.359292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:08.359292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:08.359292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:08.359292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:18:08.359292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:18:08.359292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:08.360455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:08.361592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:18:08.361592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:18:08.361592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:08.361592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:08.361592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 546/1066] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:08.366555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09019f-19a5-42c2-8725-7ea0dd2a445b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:08.374638 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abdae0-dded-4407-81f6-2c3b5ecb7da7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:08.378270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:08.412057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222030c-567d-4146-8ce3-8c7f3b3e8a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:08.413015 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222030c-567d-4146-8ce3-8c7f3b3e8a6a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:08.413445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222030c-567d-4146-8ce3-8c7f3b3e8a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:08.413861 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222030c-567d-4146-8ce3-8c7f3b3e8a6a None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:08.414756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222030c-567d-4146-8ce3-8c7f3b3e8a6a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:08.415220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222030c-567d-4146-8ce3-8c7f3b3e8a6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:08.416808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222030c-567d-4146-8ce3-8c7f3b3e8a6a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:08.425308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 521/1067] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 21 08:18:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:08.430970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222030c-567d-4146-8ce3-8c7f3b3e8a6a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:08.481195 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:08.483423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09019f-19a5-42c2-8725-7ea0dd2a445b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:08.520970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4aedc9-562d-45f7-bf7e-32f7ffe77a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:08.521647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aedc9-562d-45f7-bf7e-32f7ffe77a4b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:08.522065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aedc9-562d-45f7-bf7e-32f7ffe77a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:08.522399 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aedc9-562d-45f7-bf7e-32f7ffe77a4b None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:08.523450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4aedc9-562d-45f7-bf7e-32f7ffe77a4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:08.523926 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4aedc9-562d-45f7-bf7e-32f7ffe77a4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:08.525657 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4aedc9-562d-45f7-bf7e-32f7ffe77a4b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:08.538224 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 547/1068] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:08.542010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222030c-567d-4146-8ce3-8c7f3b3e8a6a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:08.580560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021197a4-95f5-480b-b2f2-9757bf445cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:08.581390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021197a4-95f5-480b-b2f2-9757bf445cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:08.581643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021197a4-95f5-480b-b2f2-9757bf445cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:08.581944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021197a4-95f5-480b-b2f2-9757bf445cb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:08.594964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021197a4-95f5-480b-b2f2-9757bf445cb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:08.596659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021197a4-95f5-480b-b2f2-9757bf445cb4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:08.615910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-021197a4-95f5-480b-b2f2-9757bf445cb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:08.615910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:08.615910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:08.615910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:08.615910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:08.615910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:08.615910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:08.615910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:08.615910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:08.615910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:08.615910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:08.615910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:08.615910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:18:08.615910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:18:08.615910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:08.616915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:08.617863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:18:08.617863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:18:08.617863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:08.617863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:08.617863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 522/1069] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:18:08.623636 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4aedc9-562d-45f7-bf7e-32f7ffe77a4b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:08.692896 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:08.732170 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4aedc9-562d-45f7-bf7e-32f7ffe77a4b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:08.768185 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760d1cd-c738-4be1-97f9-8c3831bdd9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:08.769061 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760d1cd-c738-4be1-97f9-8c3831bdd9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:08.769409 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760d1cd-c738-4be1-97f9-8c3831bdd9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:08.769686 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760d1cd-c738-4be1-97f9-8c3831bdd9f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:08.770426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760d1cd-c738-4be1-97f9-8c3831bdd9f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:08.770728 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760d1cd-c738-4be1-97f9-8c3831bdd9f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:08.772174 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760d1cd-c738-4be1-97f9-8c3831bdd9f2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:08.785365 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 548/1070] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:08.791309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021197a4-95f5-480b-b2f2-9757bf445cb4 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:08.885438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:08.892434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021197a4-95f5-480b-b2f2-9757bf445cb4 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:08.928838 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e0d37-f6ba-4d81-870e-6b0940127b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:08.929724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e0d37-f6ba-4d81-870e-6b0940127b70 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:08.930040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e0d37-f6ba-4d81-870e-6b0940127b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:08.930311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e0d37-f6ba-4d81-870e-6b0940127b70 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:08.938226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e0d37-f6ba-4d81-870e-6b0940127b70 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:08.939739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e0d37-f6ba-4d81-870e-6b0940127b70 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-2b6e0d37-f6ba-4d81-870e-6b0940127b70 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:18:08.953618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:08.955065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:08.956062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:08.956062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:08.956062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:18:08.956062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:18:08.956062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:18:08.956062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:18:08.956062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:18:08.956062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:18:08.956062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:18:08.956062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:08.956062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 523/1071] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 08:18:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:08.961003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760d1cd-c738-4be1-97f9-8c3831bdd9f2 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:09.064936 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760d1cd-c738-4be1-97f9-8c3831bdd9f2 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:09.092123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:09.100956 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3bfce-a32d-422e-89c8-868d965e577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:09.101643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3bfce-a32d-422e-89c8-868d965e577f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:09.101938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3bfce-a32d-422e-89c8-868d965e577f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:09.102199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3bfce-a32d-422e-89c8-868d965e577f None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:09.103040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3bfce-a32d-422e-89c8-868d965e577f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:09.103351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3bfce-a32d-422e-89c8-868d965e577f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:09.104906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3bfce-a32d-422e-89c8-868d965e577f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:09.121934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 549/1072] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 08:18:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:09.128037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e0d37-f6ba-4d81-870e-6b0940127b70 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:09.235044 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e0d37-f6ba-4d81-870e-6b0940127b70 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:09.269146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eaffca-b4f0-41d7-b23d-4882802e4e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:09.269944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaffca-b4f0-41d7-b23d-4882802e4e82 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:09.270219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaffca-b4f0-41d7-b23d-4882802e4e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:09.270487 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaffca-b4f0-41d7-b23d-4882802e4e82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:09.281520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eaffca-b4f0-41d7-b23d-4882802e4e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:09.283010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eaffca-b4f0-41d7-b23d-4882802e4e82 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:09.299572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-68eaffca-b4f0-41d7-b23d-4882802e4e82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:09.299572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:09.299572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:09.299572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:09.299572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:09.299572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:09.299572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:09.299572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:09.299572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:09.299572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:09.299572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:09.299572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:09.299572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:18:09.299572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:18:09.299572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:09.300509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:09.301486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:18:09.301486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:18:09.301486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:09.301486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:09.301486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 524/1073] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:09.306669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3bfce-a32d-422e-89c8-868d965e577f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:09.405354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3bfce-a32d-422e-89c8-868d965e577f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:09.440563 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17221bb5-6d0a-44fa-a376-010ab41c885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:09.441225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17221bb5-6d0a-44fa-a376-010ab41c885e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:09.441505 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17221bb5-6d0a-44fa-a376-010ab41c885e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:09.441775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17221bb5-6d0a-44fa-a376-010ab41c885e None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:09.442491 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17221bb5-6d0a-44fa-a376-010ab41c885e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:09.442773 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17221bb5-6d0a-44fa-a376-010ab41c885e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:09.444178 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17221bb5-6d0a-44fa-a376-010ab41c885e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:09.458735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 550/1074] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:09.464580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eaffca-b4f0-41d7-b23d-4882802e4e82 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:09.474669 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:09.566386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eaffca-b4f0-41d7-b23d-4882802e4e82 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:09.598970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be764fbd-3807-4c4a-a239-fa8da0dc2482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:09.599804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be764fbd-3807-4c4a-a239-fa8da0dc2482 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:09.600087 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be764fbd-3807-4c4a-a239-fa8da0dc2482 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:09.600362 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be764fbd-3807-4c4a-a239-fa8da0dc2482 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:09.607024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be764fbd-3807-4c4a-a239-fa8da0dc2482 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:09.608508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be764fbd-3807-4c4a-a239-fa8da0dc2482 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:09.622475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-be764fbd-3807-4c4a-a239-fa8da0dc2482 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:18:09.622475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:09.622475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:09.622475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:09.622475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:09.622475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:09.622475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:09.622475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:09.622475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:09.622475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:09.622475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:09.622475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:09.622475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:18:09.622475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:18:09.622475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:09.623364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:09.624290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:18:09.624290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:18:09.624290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:18:09.624290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:18:09.624290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:18:09.624290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:18:09.624290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:18:09.624290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:09.624290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 525/1075] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:09.630007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17221bb5-6d0a-44fa-a376-010ab41c885e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:09.680453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:09.736093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17221bb5-6d0a-44fa-a376-010ab41c885e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:09.770573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7a9a9-7756-4a09-a6e7-f01ab4cca2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:09.771244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7a9a9-7756-4a09-a6e7-f01ab4cca2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:09.771526 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7a9a9-7756-4a09-a6e7-f01ab4cca2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:09.771829 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7a9a9-7756-4a09-a6e7-f01ab4cca2c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:09.772612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7a9a9-7756-4a09-a6e7-f01ab4cca2c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:09.772918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7a9a9-7756-4a09-a6e7-f01ab4cca2c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:09.774712 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7a9a9-7756-4a09-a6e7-f01ab4cca2c8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:09.786926 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 551/1076] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:18:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:09.793179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be764fbd-3807-4c4a-a239-fa8da0dc2482 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:09.838188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d9e78-bb45-4883-a994-8a5a0e11056d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:09.838479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d9e78-bb45-4883-a994-8a5a0e11056d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:09.838765 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d9e78-bb45-4883-a994-8a5a0e11056d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:09.840209 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 552/1077] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:09.845695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1ccb9-f481-4c5c-a7c0-ccc627f03c59 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:09.845984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1ccb9-f481-4c5c-a7c0-ccc627f03c59 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:09.846264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1ccb9-f481-4c5c-a7c0-ccc627f03c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:09.861228 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:09.863326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0ba1ccb9-f481-4c5c-a7c0-ccc627f03c59 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:09.864583 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0ba1ccb9-f481-4c5c-a7c0-ccc627f03c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:09.894722 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be764fbd-3807-4c4a-a239-fa8da0dc2482 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:09.929584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2017649-96a8-4652-a1ea-92c6b7b4faeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:09.930537 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2017649-96a8-4652-a1ea-92c6b7b4faeb None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:09.930757 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2017649-96a8-4652-a1ea-92c6b7b4faeb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:09.931032 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2017649-96a8-4652-a1ea-92c6b7b4faeb None admin] PATH_INFO: `/v3/projects/784795960efb40e5811f778fff6fceb1/users/131bb5462c8b478783a350d37caa76ae/roles/fc684ab3f3f04ccfbc26506de9e9dc2b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:09.932729 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 553/1078] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:09.933719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2017649-96a8-4652-a1ea-92c6b7b4faeb None admin] RBAC: Authorizing `identity:create_grant(project_id=784795960efb40e5811f778fff6fceb1, user_id=131bb5462c8b478783a350d37caa76ae, role_id=fc684ab3f3f04ccfbc26506de9e9dc2b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:09.935274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2017649-96a8-4652-a1ea-92c6b7b4faeb None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:09.948974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 526/1079] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:18:09 2022] PUT /identity/v3/projects/784795960efb40e5811f778fff6fceb1/users/131bb5462c8b478783a350d37caa76ae/roles/fc684ab3f3f04ccfbc26506de9e9dc2b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:18:09.957162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1ccb9-f481-4c5c-a7c0-ccc627f03c59 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:09.998709 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:10.072377 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1ccb9-f481-4c5c-a7c0-ccc627f03c59 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:10.111249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cced71-e15a-4cdd-8e72-b7d8a9aeec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:10.112105 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cced71-e15a-4cdd-8e72-b7d8a9aeec03 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:10.112395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cced71-e15a-4cdd-8e72-b7d8a9aeec03 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:10.112674 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cced71-e15a-4cdd-8e72-b7d8a9aeec03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:10.124351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cced71-e15a-4cdd-8e72-b7d8a9aeec03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-d1cced71-e15a-4cdd-8e72-b7d8a9aeec03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:10.132605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:10.133573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:10.134395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:10.134395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:10.134395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:10.134395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:10.134395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:10.134395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:10.134395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:10.134395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:10.134395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:10.134395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:10.134395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:10.134395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:10.134395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 554/1080] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:10.139960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2017649-96a8-4652-a1ea-92c6b7b4faeb None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:10.245986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2017649-96a8-4652-a1ea-92c6b7b4faeb None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:10.272556 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:10.287234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa52660-46e6-45d9-8c03-751e1e0de50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:10.287971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa52660-46e6-45d9-8c03-751e1e0de50e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:10.288258 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa52660-46e6-45d9-8c03-751e1e0de50e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:10.288532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa52660-46e6-45d9-8c03-751e1e0de50e None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:10.289330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa52660-46e6-45d9-8c03-751e1e0de50e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:10.289637 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa52660-46e6-45d9-8c03-751e1e0de50e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:10.290996 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa52660-46e6-45d9-8c03-751e1e0de50e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:10.299867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 527/1081] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:10.306140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cced71-e15a-4cdd-8e72-b7d8a9aeec03 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:10.408226 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:10.414623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cced71-e15a-4cdd-8e72-b7d8a9aeec03 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:10.455942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9e261-9bf9-4b13-a3b8-5aede082f776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:10.456855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9e261-9bf9-4b13-a3b8-5aede082f776 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:10.457137 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9e261-9bf9-4b13-a3b8-5aede082f776 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:10.457412 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9e261-9bf9-4b13-a3b8-5aede082f776 None admin] PATH_INFO: `/v3/users/1d93efc41be5464aacbc9ce07c0d7340` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:10.458711 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9e261-9bf9-4b13-a3b8-5aede082f776 None admin] RBAC: Authorizing `identity:get_user(user_id=1d93efc41be5464aacbc9ce07c0d7340)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:10.460225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9e261-9bf9-4b13-a3b8-5aede082f776 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:10.461933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 555/1082] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:10 2022] GET /identity/v3/users/1d93efc41be5464aacbc9ce07c0d7340 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:10.468207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa52660-46e6-45d9-8c03-751e1e0de50e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:10.572020 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa52660-46e6-45d9-8c03-751e1e0de50e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:10.607054 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a9852-c286-45a3-86d9-21a68020545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:10.607952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a9852-c286-45a3-86d9-21a68020545f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:10.608216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a9852-c286-45a3-86d9-21a68020545f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:10.608492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a9852-c286-45a3-86d9-21a68020545f None admin] PATH_INFO: `/v3/projects/fb63731c74cd4ded829ba352c7baea56` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:10.609719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a9852-c286-45a3-86d9-21a68020545f None admin] RBAC: Authorizing `identity:get_project(project_id=fb63731c74cd4ded829ba352c7baea56)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:10.611553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a9852-c286-45a3-86d9-21a68020545f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:10.613332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 528/1083] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:10 2022] GET /identity/v3/projects/fb63731c74cd4ded829ba352c7baea56 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:10.619856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9e261-9bf9-4b13-a3b8-5aede082f776 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:10.721706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9e261-9bf9-4b13-a3b8-5aede082f776 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:10.755864 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af0b7b-bbd7-4354-9fd0-a95065e2a821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:10.756767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af0b7b-bbd7-4354-9fd0-a95065e2a821 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:10.757047 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af0b7b-bbd7-4354-9fd0-a95065e2a821 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:10.757324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af0b7b-bbd7-4354-9fd0-a95065e2a821 None admin] PATH_INFO: `/v3/projects/fb63731c74cd4ded829ba352c7baea56/users/1d93efc41be5464aacbc9ce07c0d7340/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:10.760051 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af0b7b-bbd7-4354-9fd0-a95065e2a821 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb63731c74cd4ded829ba352c7baea56, user_id=1d93efc41be5464aacbc9ce07c0d7340, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:10.761519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af0b7b-bbd7-4354-9fd0-a95065e2a821 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:10.777392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 556/1084] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:18:10 2022] PUT /identity/v3/projects/fb63731c74cd4ded829ba352c7baea56/users/1d93efc41be5464aacbc9ce07c0d7340/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:18:11.956944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c5a83-0758-4856-945e-556b07b84f89 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:11.957499 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c5a83-0758-4856-945e-556b07b84f89 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:11.957499 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c5a83-0758-4856-945e-556b07b84f89 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:11.958891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 529/1085] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:11.964246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3008c4-5584-426d-b77a-3dcab597a40c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:11.964684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3008c4-5584-426d-b77a-3dcab597a40c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:11.964779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3008c4-5584-426d-b77a-3dcab597a40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:11.982580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ba3008c4-5584-426d-b77a-3dcab597a40c None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:11.983861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ba3008c4-5584-426d-b77a-3dcab597a40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:12.001388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:12.058889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 557/1086] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:12.082609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c5a83-0758-4856-945e-556b07b84f89 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:12.140347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:12.191733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c5a83-0758-4856-945e-556b07b84f89 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:12.226066 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155131e-a639-42bf-9b8b-fb3b3b0d8a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:12.226812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155131e-a639-42bf-9b8b-fb3b3b0d8a70 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:12.227096 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155131e-a639-42bf-9b8b-fb3b3b0d8a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:12.227371 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155131e-a639-42bf-9b8b-fb3b3b0d8a70 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:12.238459 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155131e-a639-42bf-9b8b-fb3b3b0d8a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-a155131e-a639-42bf-9b8b-fb3b3b0d8a70 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:12.246594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:12.247532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:12.248622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:12.248622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:12.248622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:12.248622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:12.248622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:12.248622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:12.248622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:12.248622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:12.248622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:12.248622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:12.248622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:18:12.248622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:12.248622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 530/1087] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 21 08:18:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:12.254085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3008c4-5584-426d-b77a-3dcab597a40c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:12.356637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3008c4-5584-426d-b77a-3dcab597a40c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:12.392687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bb272-4d2c-4b3f-ad82-cb4953114589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:12.393364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bb272-4d2c-4b3f-ad82-cb4953114589 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:12.393643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bb272-4d2c-4b3f-ad82-cb4953114589 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:12.393916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bb272-4d2c-4b3f-ad82-cb4953114589 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:12.394663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bb272-4d2c-4b3f-ad82-cb4953114589 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:12.394963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bb272-4d2c-4b3f-ad82-cb4953114589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:12.396371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bb272-4d2c-4b3f-ad82-cb4953114589 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:12.405342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 558/1088] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 21 08:18:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:12.411361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155131e-a639-42bf-9b8b-fb3b3b0d8a70 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:12.517498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155131e-a639-42bf-9b8b-fb3b3b0d8a70 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:12.533989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:12.552045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3e1dc-cf06-4c06-8158-6c92233f26a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:12.552853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3e1dc-cf06-4c06-8158-6c92233f26a7 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:12.553134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3e1dc-cf06-4c06-8158-6c92233f26a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:12.553409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3e1dc-cf06-4c06-8158-6c92233f26a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:12.563487 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3e1dc-cf06-4c06-8158-6c92233f26a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:12.565175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3e1dc-cf06-4c06-8158-6c92233f26a7 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:12.583090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-7cd3e1dc-cf06-4c06-8158-6c92233f26a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:12.583090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:12.583090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:12.583090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:12.583090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:12.583090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:12.583090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:12.583090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:12.583090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:12.583090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:12.583090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:12.583090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:12.583090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:18:12.583090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:18:12.583090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:12.584034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:12.584916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:18:12.584916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:18:12.584916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:12.584916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:12.584916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 531/1089] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:12.590269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bb272-4d2c-4b3f-ad82-cb4953114589 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:12.609638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:12.697558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bb272-4d2c-4b3f-ad82-cb4953114589 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:12.732991 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33296e6-3b86-4403-b875-b99ce74cb23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:12.733684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33296e6-3b86-4403-b875-b99ce74cb23e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:12.733960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33296e6-3b86-4403-b875-b99ce74cb23e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:12.734227 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33296e6-3b86-4403-b875-b99ce74cb23e None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:12.734947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33296e6-3b86-4403-b875-b99ce74cb23e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:12.735298 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33296e6-3b86-4403-b875-b99ce74cb23e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:12.736705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33296e6-3b86-4403-b875-b99ce74cb23e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:12.748636 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 559/1090] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:12.754596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3e1dc-cf06-4c06-8158-6c92233f26a7 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:12.814816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269b57-ca41-4a12-8dd5-5a3292b68b35 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:12.815027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269b57-ca41-4a12-8dd5-5a3292b68b35 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:12.815308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269b57-ca41-4a12-8dd5-5a3292b68b35 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:12.816796 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 560/1091] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:12.821920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb27fdf-8412-43d8-9569-f8c99994c40f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:12.822213 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb27fdf-8412-43d8-9569-f8c99994c40f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:12.822497 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb27fdf-8412-43d8-9569-f8c99994c40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:12.839958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8eb27fdf-8412-43d8-9569-f8c99994c40f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:12.841195 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8eb27fdf-8412-43d8-9569-f8c99994c40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:12.859128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3e1dc-cf06-4c06-8158-6c92233f26a7 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:12.892964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2cb3b-973b-4201-bb1d-b4e6b3f430ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:12.893759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2cb3b-973b-4201-bb1d-b4e6b3f430ce None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:12.894033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2cb3b-973b-4201-bb1d-b4e6b3f430ce None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:12.894299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2cb3b-973b-4201-bb1d-b4e6b3f430ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:12.902203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2cb3b-973b-4201-bb1d-b4e6b3f430ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:12.903689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2cb3b-973b-4201-bb1d-b4e6b3f430ce None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:12.911300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 561/1092] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-2ac2cb3b-973b-4201-bb1d-b4e6b3f430ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:18:12.917676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:12.918830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:12.920098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:12.920098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:12.920098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:18:12.920098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:18:12.920098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:18:12.920098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:18:12.920098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:18:12.920098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:18:12.920098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:18:12.920098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:12.923906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 532/1093] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 08:18:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:12.925028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb27fdf-8412-43d8-9569-f8c99994c40f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:12.933660 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:12.935019 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2cb3b-973b-4201-bb1d-b4e6b3f430ce None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:12.965088 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:13.025710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb27fdf-8412-43d8-9569-f8c99994c40f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:13.038580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2cb3b-973b-4201-bb1d-b4e6b3f430ce None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:13.060259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf518a14-312a-4235-9d88-3d634ea6d9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:13.060940 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518a14-312a-4235-9d88-3d634ea6d9ef None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:13.061222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518a14-312a-4235-9d88-3d634ea6d9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:13.061506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518a14-312a-4235-9d88-3d634ea6d9ef None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:13.062345 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf518a14-312a-4235-9d88-3d634ea6d9ef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:13.062655 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf518a14-312a-4235-9d88-3d634ea6d9ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:13.064608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf518a14-312a-4235-9d88-3d634ea6d9ef None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:13.073368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21980096-dcf9-4fb4-8af0-6998669c1956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:13.074105 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21980096-dcf9-4fb4-8af0-6998669c1956 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:13.074381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21980096-dcf9-4fb4-8af0-6998669c1956 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:13.074647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21980096-dcf9-4fb4-8af0-6998669c1956 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:13.083249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 562/1094] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 08:18:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:13.085191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21980096-dcf9-4fb4-8af0-6998669c1956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:13.089385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf518a14-312a-4235-9d88-3d634ea6d9ef None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-21980096-dcf9-4fb4-8af0-6998669c1956 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:13.092774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:13.093888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:13.095287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:13.095287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:13.095287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:13.095287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:13.095287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:13.095287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:13.095287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:13.095287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:13.095287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:13.095287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:13.095287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:13.095287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:13.095287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 533/1095] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:18:13.100033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21980096-dcf9-4fb4-8af0-6998669c1956 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:13.157210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:13.197303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:13.197963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf518a14-312a-4235-9d88-3d634ea6d9ef None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:13.210676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21980096-dcf9-4fb4-8af0-6998669c1956 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:13.233217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa4d97-2b01-421b-8a02-970f7005caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:13.233877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa4d97-2b01-421b-8a02-970f7005caaf None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:13.234161 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa4d97-2b01-421b-8a02-970f7005caaf None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:13.234433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa4d97-2b01-421b-8a02-970f7005caaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:13.246161 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d1fdb-19b9-464d-b68e-12cce3fa4af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:13.246838 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d1fdb-19b9-464d-b68e-12cce3fa4af8 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:13.247122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d1fdb-19b9-464d-b68e-12cce3fa4af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:13.247397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d1fdb-19b9-464d-b68e-12cce3fa4af8 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:13.248199 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d1fdb-19b9-464d-b68e-12cce3fa4af8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:13.248506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d1fdb-19b9-464d-b68e-12cce3fa4af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:13.249896 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d1fdb-19b9-464d-b68e-12cce3fa4af8 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:13.258062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 534/1096] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:13.263816 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d1fdb-19b9-464d-b68e-12cce3fa4af8 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:13.301340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa4d97-2b01-421b-8a02-970f7005caaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:13.302803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa4d97-2b01-421b-8a02-970f7005caaf None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:13.362251 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:13.363965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d1fdb-19b9-464d-b68e-12cce3fa4af8 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:13.399275 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c185c2-8abf-40fa-8e27-d59cd107264a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:13.400187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c185c2-8abf-40fa-8e27-d59cd107264a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:13.400470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c185c2-8abf-40fa-8e27-d59cd107264a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:13.400729 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c185c2-8abf-40fa-8e27-d59cd107264a None admin] PATH_INFO: `/v3/users/1d93efc41be5464aacbc9ce07c0d7340` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:13.401942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c185c2-8abf-40fa-8e27-d59cd107264a None admin] RBAC: Authorizing `identity:get_user(user_id=1d93efc41be5464aacbc9ce07c0d7340)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:13.403387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c185c2-8abf-40fa-8e27-d59cd107264a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:13.403868 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 563/1097] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 08:18:13.409722 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 535/1098] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:13 2022] GET /identity/v3/users/1d93efc41be5464aacbc9ce07c0d7340 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:13.409860 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa4d97-2b01-421b-8a02-970f7005caaf None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:13.410690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c185c2-8abf-40fa-8e27-d59cd107264a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:13.429471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:13.507324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa4d97-2b01-421b-8a02-970f7005caaf None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:13.516907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c185c2-8abf-40fa-8e27-d59cd107264a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:13.541697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e72541-b3c8-4293-a81b-941f7bc78dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:13.542500 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e72541-b3c8-4293-a81b-941f7bc78dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:13.542772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e72541-b3c8-4293-a81b-941f7bc78dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:13.543049 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e72541-b3c8-4293-a81b-941f7bc78dc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:13.550590 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3a754-70de-4cb2-85e5-7eac5d062e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:13.551235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3a754-70de-4cb2-85e5-7eac5d062e61 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:13.551521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3a754-70de-4cb2-85e5-7eac5d062e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:13.551873 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3a754-70de-4cb2-85e5-7eac5d062e61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:13.553587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e72541-b3c8-4293-a81b-941f7bc78dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:13.555151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e72541-b3c8-4293-a81b-941f7bc78dc7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:13.572689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-38e72541-b3c8-4293-a81b-941f7bc78dc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:13.572689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:13.572689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:13.572689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:13.572689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:13.572689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:13.572689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:13.572689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:13.572689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:13.572689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:13.572689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:13.572689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:13.572689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:18:13.572689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:18:13.572689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:13.573612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:13.574717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:18:13.574717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:18:13.574717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:13.574717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:13.574717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 564/1099] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:18:13.579694 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e72541-b3c8-4293-a81b-941f7bc78dc7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:13.596875 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:13.621465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3a754-70de-4cb2-85e5-7eac5d062e61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:13.622830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3a754-70de-4cb2-85e5-7eac5d062e61 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:13.641029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:13.683350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e72541-b3c8-4293-a81b-941f7bc78dc7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:13.717198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0455684-8729-420f-879f-bc41f23ee717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:13.717871 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0455684-8729-420f-879f-bc41f23ee717 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:13.718153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0455684-8729-420f-879f-bc41f23ee717 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:13.718430 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0455684-8729-420f-879f-bc41f23ee717 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:13.719155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0455684-8729-420f-879f-bc41f23ee717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:13.719507 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0455684-8729-420f-879f-bc41f23ee717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:13.721122 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0455684-8729-420f-879f-bc41f23ee717 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:13.721306 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 536/1100] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:18:13.727216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3a754-70de-4cb2-85e5-7eac5d062e61 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:13.737603 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 565/1101] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:13.738622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0455684-8729-420f-879f-bc41f23ee717 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:13.815859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:13.825326 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3a754-70de-4cb2-85e5-7eac5d062e61 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:13.838641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0455684-8729-420f-879f-bc41f23ee717 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:13.842545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:13.859522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad493493-97af-45bd-ac12-aa900e07bc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:13.860485 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad493493-97af-45bd-ac12-aa900e07bc7c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:13.860786 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad493493-97af-45bd-ac12-aa900e07bc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:13.861059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad493493-97af-45bd-ac12-aa900e07bc7c None admin] PATH_INFO: `/v3/projects/fb63731c74cd4ded829ba352c7baea56` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:13.862234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad493493-97af-45bd-ac12-aa900e07bc7c None admin] RBAC: Authorizing `identity:get_project(project_id=fb63731c74cd4ded829ba352c7baea56)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:13.863704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad493493-97af-45bd-ac12-aa900e07bc7c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:13.865576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 537/1102] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:13 2022] GET /identity/v3/projects/fb63731c74cd4ded829ba352c7baea56 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:13.871416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad493493-97af-45bd-ac12-aa900e07bc7c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:13.872609 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17631768-a663-414e-ace0-e9969eb9531c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:13.873364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17631768-a663-414e-ace0-e9969eb9531c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:13.873646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17631768-a663-414e-ace0-e9969eb9531c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:13.873922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17631768-a663-414e-ace0-e9969eb9531c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:13.881022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17631768-a663-414e-ace0-e9969eb9531c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:13.882505 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17631768-a663-414e-ace0-e9969eb9531c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:13.897886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-17631768-a663-414e-ace0-e9969eb9531c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:18:13.897886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:13.897886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:13.897886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:13.897886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:13.897886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:13.897886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:13.897886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:13.897886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:13.897886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:13.897886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:13.897886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:13.897886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:18:13.897886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:18:13.897886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:13.899116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:13.900469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:18:13.900469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:18:13.900469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:18:13.900469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:18:13.900469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:18:13.900469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:18:13.900469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:18:13.900469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:13.900469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 566/1103] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:18:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:18:13.905153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17631768-a663-414e-ace0-e9969eb9531c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:13.967624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad493493-97af-45bd-ac12-aa900e07bc7c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:14.000967 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018731e-d10b-4ea7-88cc-3b144b6740c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:14.001612 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018731e-d10b-4ea7-88cc-3b144b6740c5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:14.001900 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018731e-d10b-4ea7-88cc-3b144b6740c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:14.002175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018731e-d10b-4ea7-88cc-3b144b6740c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:14.003001 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018731e-d10b-4ea7-88cc-3b144b6740c5 None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=fb63731c74cd4ded829ba352c7baea56, user.id=1d93efc41be5464aacbc9ce07c0d7340) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:14.003315 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018731e-d10b-4ea7-88cc-3b144b6740c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:14.004161 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17631768-a663-414e-ace0-e9969eb9531c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:14.004799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018731e-d10b-4ea7-88cc-3b144b6740c5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:14.019651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 538/1104] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:13 2022] GET /identity/v3/role_assignments?user.id=1d93efc41be5464aacbc9ce07c0d7340&scope.project.id=fb63731c74cd4ded829ba352c7baea56&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:14.040982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb300ab-c7ac-4ede-8292-4443c883c951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:14.041656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb300ab-c7ac-4ede-8292-4443c883c951 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:14.041957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb300ab-c7ac-4ede-8292-4443c883c951 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:14.042231 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb300ab-c7ac-4ede-8292-4443c883c951 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:14.043041 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb300ab-c7ac-4ede-8292-4443c883c951 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:14.043348 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb300ab-c7ac-4ede-8292-4443c883c951 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:14.044870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb300ab-c7ac-4ede-8292-4443c883c951 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:14.047939 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:14.058778 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 567/1105] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:18:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:14.065641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018731e-d10b-4ea7-88cc-3b144b6740c5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:14.124678 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:14.180022 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018731e-d10b-4ea7-88cc-3b144b6740c5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:14.213621 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0878446-5818-4f58-b364-e6c6fbb89f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:14.214278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0878446-5818-4f58-b364-e6c6fbb89f8e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:14.214674 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0878446-5818-4f58-b364-e6c6fbb89f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:14.214938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0878446-5818-4f58-b364-e6c6fbb89f8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:14.215850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0878446-5818-4f58-b364-e6c6fbb89f8e None admin] RBAC: Adding query filter params (role.id=fc684ab3f3f04ccfbc26506de9e9dc2b, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=131bb5462c8b478783a350d37caa76ae) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:14.216160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0878446-5818-4f58-b364-e6c6fbb89f8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:14.217595 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0878446-5818-4f58-b364-e6c6fbb89f8e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:14.223655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 539/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:14 2022] GET /identity/v3/role_assignments?user.id=131bb5462c8b478783a350d37caa76ae&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=fc684ab3f3f04ccfbc26506de9e9dc2b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:16.092139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fe739-de97-4e6e-a453-932f0c2b9a64 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:16.093040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fe739-de97-4e6e-a453-932f0c2b9a64 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:16.093040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fe739-de97-4e6e-a453-932f0c2b9a64 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:16.095104 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 568/1107] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:16.103949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcaedd-8f05-4124-acf0-349655dfb584 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:16.104648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcaedd-8f05-4124-acf0-349655dfb584 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:16.104762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcaedd-8f05-4124-acf0-349655dfb584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:16.129768 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2ebcaedd-8f05-4124-acf0-349655dfb584 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:16.130958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2ebcaedd-8f05-4124-acf0-349655dfb584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:16.201098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 540/1108] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:18:16.227487 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fe739-de97-4e6e-a453-932f0c2b9a64 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:16.339043 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fe739-de97-4e6e-a453-932f0c2b9a64 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:16.374986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac91d9-7810-40bc-ab26-e866b76a9216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:16.375899 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac91d9-7810-40bc-ab26-e866b76a9216 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:16.376296 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac91d9-7810-40bc-ab26-e866b76a9216 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:16.376576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac91d9-7810-40bc-ab26-e866b76a9216 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:16.377878 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac91d9-7810-40bc-ab26-e866b76a9216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:16.379324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac91d9-7810-40bc-ab26-e866b76a9216 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:16.380996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 569/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:16.387174 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcaedd-8f05-4124-acf0-349655dfb584 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:16.440244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:16.498016 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcaedd-8f05-4124-acf0-349655dfb584 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:16.548812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3c4b7-9d3d-4ca4-9f0d-1179aa29e920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:16.549492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3c4b7-9d3d-4ca4-9f0d-1179aa29e920 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:16.549778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3c4b7-9d3d-4ca4-9f0d-1179aa29e920 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:16.550053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3c4b7-9d3d-4ca4-9f0d-1179aa29e920 None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:16.550774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3c4b7-9d3d-4ca4-9f0d-1179aa29e920 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:16.552258 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3c4b7-9d3d-4ca4-9f0d-1179aa29e920 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:16.580724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 541/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:18:16 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:18.617657 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c95f36-fcf5-4644-9fc2-0a428ebe4c72 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:18.618210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c95f36-fcf5-4644-9fc2-0a428ebe4c72 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:18.618210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c95f36-fcf5-4644-9fc2-0a428ebe4c72 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:18.619615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 570/1111] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:18.626193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fe38c-cc8c-418b-bb1b-5b35ba1fc282 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:18.626667 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fe38c-cc8c-418b-bb1b-5b35ba1fc282 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:18.626815 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fe38c-cc8c-418b-bb1b-5b35ba1fc282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:18.654393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-149fe38c-cc8c-418b-bb1b-5b35ba1fc282 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:18.656492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-149fe38c-cc8c-418b-bb1b-5b35ba1fc282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:18.728977 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 542/1112] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:18.755139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c95f36-fcf5-4644-9fc2-0a428ebe4c72 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:18.825471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:18.868633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c95f36-fcf5-4644-9fc2-0a428ebe4c72 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:18.904527 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc65e9-753b-4b9e-86f7-fad7fd75ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:18.905379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc65e9-753b-4b9e-86f7-fad7fd75ee6f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:18.905655 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc65e9-753b-4b9e-86f7-fad7fd75ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:18.905924 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc65e9-753b-4b9e-86f7-fad7fd75ee6f None admin] PATH_INFO: `/v3/roles/18bb65296a9c487faf3b57d2b4246578` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:18.907465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc65e9-753b-4b9e-86f7-fad7fd75ee6f None admin] RBAC: Authorizing `identity:get_role(role_id=18bb65296a9c487faf3b57d2b4246578)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:18.908871 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc65e9-753b-4b9e-86f7-fad7fd75ee6f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:18.910243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 571/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:18 2022] GET /identity/v3/roles/18bb65296a9c487faf3b57d2b4246578 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:18.916933 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fe38c-cc8c-418b-bb1b-5b35ba1fc282 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:18.953081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:19.034925 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fe38c-cc8c-418b-bb1b-5b35ba1fc282 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:19.071200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca934c6-e8c4-417f-98f1-ec4807dd9b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:19.072100 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca934c6-e8c4-417f-98f1-ec4807dd9b65 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:19.072378 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca934c6-e8c4-417f-98f1-ec4807dd9b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:19.072645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca934c6-e8c4-417f-98f1-ec4807dd9b65 None admin] PATH_INFO: `/v3/users/1d41720f3d0840529190178c7bfe5c2a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:19.089802 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca934c6-e8c4-417f-98f1-ec4807dd9b65 None admin] RBAC: Authorizing `identity:get_user(user_id=1d41720f3d0840529190178c7bfe5c2a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:19.091252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca934c6-e8c4-417f-98f1-ec4807dd9b65 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:19.092987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 543/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:18 2022] GET /identity/v3/users/1d41720f3d0840529190178c7bfe5c2a => generated 286 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:19.102819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc65e9-753b-4b9e-86f7-fad7fd75ee6f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:19.232813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc65e9-753b-4b9e-86f7-fad7fd75ee6f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:19.269136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:19.276033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53c105-622c-49fa-9e40-c151927c25b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:19.276696 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53c105-622c-49fa-9e40-c151927c25b5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:19.276979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53c105-622c-49fa-9e40-c151927c25b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:19.277231 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53c105-622c-49fa-9e40-c151927c25b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:19.349126 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53c105-622c-49fa-9e40-c151927c25b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:19.350544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53c105-622c-49fa-9e40-c151927c25b5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:19.471738 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 572/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:18:19.477847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca934c6-e8c4-417f-98f1-ec4807dd9b65 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:19.573983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:19.586670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca934c6-e8c4-417f-98f1-ec4807dd9b65 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:19.625146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6edb87-9edc-42cb-99e7-bb932a684297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:19.625994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6edb87-9edc-42cb-99e7-bb932a684297 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:19.626282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6edb87-9edc-42cb-99e7-bb932a684297 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:19.626869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6edb87-9edc-42cb-99e7-bb932a684297 None admin] PATH_INFO: `/v3/projects/fb63731c74cd4ded829ba352c7baea56` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:19.627938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6edb87-9edc-42cb-99e7-bb932a684297 None admin] RBAC: Authorizing `identity:get_project(project_id=fb63731c74cd4ded829ba352c7baea56)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:19.629387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6edb87-9edc-42cb-99e7-bb932a684297 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:19.631077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 544/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:19 2022] GET /identity/v3/projects/fb63731c74cd4ded829ba352c7baea56 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:19.637555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53c105-622c-49fa-9e40-c151927c25b5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:19.674203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:19.747402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53c105-622c-49fa-9e40-c151927c25b5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:19.782258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fed786-6235-4d62-9375-195906aa1594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:19.782910 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fed786-6235-4d62-9375-195906aa1594 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:19.783189 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fed786-6235-4d62-9375-195906aa1594 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:19.783455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fed786-6235-4d62-9375-195906aa1594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:19.784309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fed786-6235-4d62-9375-195906aa1594 None admin] RBAC: Adding query filter params (role.id=18bb65296a9c487faf3b57d2b4246578, scope.project.id=fb63731c74cd4ded829ba352c7baea56, user.id=1d41720f3d0840529190178c7bfe5c2a) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:19.784615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fed786-6235-4d62-9375-195906aa1594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:19.786048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fed786-6235-4d62-9375-195906aa1594 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:19.791573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 573/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:19 2022] GET /identity/v3/role_assignments?user.id=1d41720f3d0840529190178c7bfe5c2a&scope.project.id=fb63731c74cd4ded829ba352c7baea56&role.id=18bb65296a9c487faf3b57d2b4246578 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:21.800401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46edbc-59c5-4360-883a-3da46a78e597 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:21.801236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46edbc-59c5-4360-883a-3da46a78e597 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:21.801236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46edbc-59c5-4360-883a-3da46a78e597 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:21.803329 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 545/1118] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:21.809703 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a65cfc-88f3-479c-9daa-646e17ecf825 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:21.810433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a65cfc-88f3-479c-9daa-646e17ecf825 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:21.810563 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a65cfc-88f3-479c-9daa-646e17ecf825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:21.834273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-00a65cfc-88f3-479c-9daa-646e17ecf825 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:21.835453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-00a65cfc-88f3-479c-9daa-646e17ecf825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:21.904774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 574/1119] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:21.934866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46edbc-59c5-4360-883a-3da46a78e597 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:22.038646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46edbc-59c5-4360-883a-3da46a78e597 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:22.073097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128305c-b23b-4872-939a-116e93f774ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:22.073872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128305c-b23b-4872-939a-116e93f774ae None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:22.074145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128305c-b23b-4872-939a-116e93f774ae None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:22.074411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128305c-b23b-4872-939a-116e93f774ae None admin] PATH_INFO: `/v3/roles/18bb65296a9c487faf3b57d2b4246578` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:22.075955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128305c-b23b-4872-939a-116e93f774ae None admin] RBAC: Authorizing `identity:get_role(role_id=18bb65296a9c487faf3b57d2b4246578)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:22.077336 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128305c-b23b-4872-939a-116e93f774ae None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:22.078873 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 546/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:21 2022] GET /identity/v3/roles/18bb65296a9c487faf3b57d2b4246578 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:22.088635 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a65cfc-88f3-479c-9daa-646e17ecf825 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:22.119198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:22.199135 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a65cfc-88f3-479c-9daa-646e17ecf825 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:22.236522 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705dd565-982a-416c-928e-6f059b3d3976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:22.237406 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dd565-982a-416c-928e-6f059b3d3976 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:22.237686 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dd565-982a-416c-928e-6f059b3d3976 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:22.237963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dd565-982a-416c-928e-6f059b3d3976 None admin] PATH_INFO: `/v3/users/1d41720f3d0840529190178c7bfe5c2a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:22.239302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705dd565-982a-416c-928e-6f059b3d3976 None admin] RBAC: Authorizing `identity:get_user(user_id=1d41720f3d0840529190178c7bfe5c2a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:22.240801 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705dd565-982a-416c-928e-6f059b3d3976 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:22.242456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 575/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:22 2022] GET /identity/v3/users/1d41720f3d0840529190178c7bfe5c2a => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:22.248882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128305c-b23b-4872-939a-116e93f774ae None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:22.276628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:22.357739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128305c-b23b-4872-939a-116e93f774ae None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:22.396639 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cfa44-851f-4324-abd9-131379418d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:22.397502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cfa44-851f-4324-abd9-131379418d0f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:22.397804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cfa44-851f-4324-abd9-131379418d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:22.398071 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cfa44-851f-4324-abd9-131379418d0f None admin] PATH_INFO: `/v3/projects/fb63731c74cd4ded829ba352c7baea56` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:22.399842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cfa44-851f-4324-abd9-131379418d0f None admin] RBAC: Authorizing `identity:get_project(project_id=fb63731c74cd4ded829ba352c7baea56)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:22.401304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cfa44-851f-4324-abd9-131379418d0f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:22.403025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 547/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:22 2022] GET /identity/v3/projects/fb63731c74cd4ded829ba352c7baea56 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:22.409668 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705dd565-982a-416c-928e-6f059b3d3976 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:22.507289 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:22.515413 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705dd565-982a-416c-928e-6f059b3d3976 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:22.553871 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb094eb4-525e-47c9-9480-bd3b1d6c261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:22.554775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb094eb4-525e-47c9-9480-bd3b1d6c261b None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:22.555053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb094eb4-525e-47c9-9480-bd3b1d6c261b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:22.555480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb094eb4-525e-47c9-9480-bd3b1d6c261b None admin] PATH_INFO: `/v3/projects/fb63731c74cd4ded829ba352c7baea56/users/1d41720f3d0840529190178c7bfe5c2a/roles/18bb65296a9c487faf3b57d2b4246578` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:22.558334 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb094eb4-525e-47c9-9480-bd3b1d6c261b None admin] RBAC: Authorizing `identity:create_grant(project_id=fb63731c74cd4ded829ba352c7baea56, user_id=1d41720f3d0840529190178c7bfe5c2a, role_id=18bb65296a9c487faf3b57d2b4246578)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:22.559818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb094eb4-525e-47c9-9480-bd3b1d6c261b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:22.575650 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 576/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:18:22 2022] PUT /identity/v3/projects/fb63731c74cd4ded829ba352c7baea56/users/1d41720f3d0840529190178c7bfe5c2a/roles/18bb65296a9c487faf3b57d2b4246578 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:18:24.573689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910ae41-03b1-418f-b4b4-9531aa35333a None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:24.574557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910ae41-03b1-418f-b4b4-9531aa35333a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:24.574557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910ae41-03b1-418f-b4b4-9531aa35333a None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:24.576837 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 548/1124] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:24.583315 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705d10b-0d54-46bf-8402-f2d73c23d51d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:24.583786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705d10b-0d54-46bf-8402-f2d73c23d51d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:24.583912 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705d10b-0d54-46bf-8402-f2d73c23d51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:24.605403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4705d10b-0d54-46bf-8402-f2d73c23d51d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:24.606591 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4705d10b-0d54-46bf-8402-f2d73c23d51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:24.675291 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 577/1125] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:24.703854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910ae41-03b1-418f-b4b4-9531aa35333a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:24.815404 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:24.825519 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910ae41-03b1-418f-b4b4-9531aa35333a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:24.858832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48f972-db50-491d-ae27-fde5b9451028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:24.859700 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48f972-db50-491d-ae27-fde5b9451028 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:24.860063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48f972-db50-491d-ae27-fde5b9451028 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:24.860342 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48f972-db50-491d-ae27-fde5b9451028 None admin] PATH_INFO: `/v3/roles/18bb65296a9c487faf3b57d2b4246578` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:24.861789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48f972-db50-491d-ae27-fde5b9451028 None admin] RBAC: Authorizing `identity:get_role(role_id=18bb65296a9c487faf3b57d2b4246578)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:24.863168 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48f972-db50-491d-ae27-fde5b9451028 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:24.864560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 549/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:24 2022] GET /identity/v3/roles/18bb65296a9c487faf3b57d2b4246578 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:24.870706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705d10b-0d54-46bf-8402-f2d73c23d51d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:24.955575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:24.974010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705d10b-0d54-46bf-8402-f2d73c23d51d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:25.009966 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c18a4-6682-4363-8368-69bc52e8f2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:25.010828 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c18a4-6682-4363-8368-69bc52e8f2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:25.011104 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c18a4-6682-4363-8368-69bc52e8f2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:25.011371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c18a4-6682-4363-8368-69bc52e8f2f7 None admin] PATH_INFO: `/v3/users/1d41720f3d0840529190178c7bfe5c2a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:25.012629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c18a4-6682-4363-8368-69bc52e8f2f7 None admin] RBAC: Authorizing `identity:get_user(user_id=1d41720f3d0840529190178c7bfe5c2a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:25.014069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c18a4-6682-4363-8368-69bc52e8f2f7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:25.015708 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 578/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:24 2022] GET /identity/v3/users/1d41720f3d0840529190178c7bfe5c2a => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:25.021885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48f972-db50-491d-ae27-fde5b9451028 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:25.133030 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48f972-db50-491d-ae27-fde5b9451028 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:25.167569 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52842012-09ea-42f4-b201-7cb9b400d6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:25.168230 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52842012-09ea-42f4-b201-7cb9b400d6bd None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:25.168507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52842012-09ea-42f4-b201-7cb9b400d6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:25.168781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52842012-09ea-42f4-b201-7cb9b400d6bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:25.197432 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:25.238110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52842012-09ea-42f4-b201-7cb9b400d6bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:25.239484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52842012-09ea-42f4-b201-7cb9b400d6bd None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:25.350503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 550/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:18:25.357244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c18a4-6682-4363-8368-69bc52e8f2f7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:25.472522 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c18a4-6682-4363-8368-69bc52e8f2f7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:25.508123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f9411-8afc-4d8f-b233-2e0beaa4c10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:25.508919 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f9411-8afc-4d8f-b233-2e0beaa4c10b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:25.509203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f9411-8afc-4d8f-b233-2e0beaa4c10b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:25.509474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f9411-8afc-4d8f-b233-2e0beaa4c10b None admin] PATH_INFO: `/v3/projects/fb63731c74cd4ded829ba352c7baea56` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:25.510780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f9411-8afc-4d8f-b233-2e0beaa4c10b None admin] RBAC: Authorizing `identity:get_project(project_id=fb63731c74cd4ded829ba352c7baea56)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:25.512268 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f9411-8afc-4d8f-b233-2e0beaa4c10b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:25.513977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 579/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:25 2022] GET /identity/v3/projects/fb63731c74cd4ded829ba352c7baea56 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:25.523580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52842012-09ea-42f4-b201-7cb9b400d6bd None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:25.584871 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:25.627762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52842012-09ea-42f4-b201-7cb9b400d6bd None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:25.665134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabe8b8-565a-49bc-8857-50abfc97e602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:25.665776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabe8b8-565a-49bc-8857-50abfc97e602 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:25.666056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabe8b8-565a-49bc-8857-50abfc97e602 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:25.666327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabe8b8-565a-49bc-8857-50abfc97e602 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:25.667164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabe8b8-565a-49bc-8857-50abfc97e602 None admin] RBAC: Adding query filter params (role.id=18bb65296a9c487faf3b57d2b4246578, scope.project.id=fb63731c74cd4ded829ba352c7baea56, user.id=1d41720f3d0840529190178c7bfe5c2a) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:25.667475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabe8b8-565a-49bc-8857-50abfc97e602 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:25.668944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabe8b8-565a-49bc-8857-50abfc97e602 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:25.675253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 551/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:25 2022] GET /identity/v3/role_assignments?user.id=1d41720f3d0840529190178c7bfe5c2a&scope.project.id=fb63731c74cd4ded829ba352c7baea56&role.id=18bb65296a9c487faf3b57d2b4246578 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:27.734956 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1456590-103c-46d0-9296-0b7f3f14e254 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:27.735652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1456590-103c-46d0-9296-0b7f3f14e254 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:27.735652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1456590-103c-46d0-9296-0b7f3f14e254 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:27.736912 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 580/1131] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:27.743329 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8773053-7930-4cbc-8257-37f485abc4fe None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:27.744067 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8773053-7930-4cbc-8257-37f485abc4fe None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:27.744220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8773053-7930-4cbc-8257-37f485abc4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:27.770141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b8773053-7930-4cbc-8257-37f485abc4fe None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:27.771342 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b8773053-7930-4cbc-8257-37f485abc4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:27.852977 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 552/1132] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:27.878990 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1456590-103c-46d0-9296-0b7f3f14e254 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:27.904453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:27.990903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1456590-103c-46d0-9296-0b7f3f14e254 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:28.031164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aa106-b51c-427c-936e-9611a178adff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:28.032049 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa106-b51c-427c-936e-9611a178adff None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:28.032406 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa106-b51c-427c-936e-9611a178adff None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:28.032663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa106-b51c-427c-936e-9611a178adff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:28.033960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aa106-b51c-427c-936e-9611a178adff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:28.035410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aa106-b51c-427c-936e-9611a178adff None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:28.037112 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 581/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:28.043951 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8773053-7930-4cbc-8257-37f485abc4fe None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:28.117113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:28.167265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8773053-7930-4cbc-8257-37f485abc4fe None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:28.201493 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16f67c-9df3-437c-a5ae-e259c6073a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:28.202137 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16f67c-9df3-437c-a5ae-e259c6073a53 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:28.202412 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16f67c-9df3-437c-a5ae-e259c6073a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:28.202681 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16f67c-9df3-437c-a5ae-e259c6073a53 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:28.203571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16f67c-9df3-437c-a5ae-e259c6073a53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:28.205300 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16f67c-9df3-437c-a5ae-e259c6073a53 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:28.239238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 553/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 08:18:28 2022] POST /identity/v3/projects => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:30.313020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb4f1a-fead-4efe-a0b8-9e49c3cebb3e None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.313699 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb4f1a-fead-4efe-a0b8-9e49c3cebb3e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.313699 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb4f1a-fead-4efe-a0b8-9e49c3cebb3e None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.315102 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 582/1135] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:30.320883 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dd95a-2b38-4f5b-9e14-aae6238c3090 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.321345 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dd95a-2b38-4f5b-9e14-aae6238c3090 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.321438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dd95a-2b38-4f5b-9e14-aae6238c3090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.338834 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-4c6dd95a-2b38-4f5b-9e14-aae6238c3090 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:30.340045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4c6dd95a-2b38-4f5b-9e14-aae6238c3090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:30.408802 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 554/1136] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:18:30.433805 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb4f1a-fead-4efe-a0b8-9e49c3cebb3e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:30.538052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:30.553609 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb4f1a-fead-4efe-a0b8-9e49c3cebb3e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:30.592425 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed76187-4e5d-4f87-ab70-65d0a1ad929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:30.593147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed76187-4e5d-4f87-ab70-65d0a1ad929f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.593420 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed76187-4e5d-4f87-ab70-65d0a1ad929f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.593691 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed76187-4e5d-4f87-ab70-65d0a1ad929f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.595135 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed76187-4e5d-4f87-ab70-65d0a1ad929f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:30.596614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed76187-4e5d-4f87-ab70-65d0a1ad929f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:30.598253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 583/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:30.604295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dd95a-2b38-4f5b-9e14-aae6238c3090 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:30.649806 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:30.723574 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dd95a-2b38-4f5b-9e14-aae6238c3090 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:30.757876 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee84e2-f02e-45dc-a61f-88e8c2ce1f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:30.758546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee84e2-f02e-45dc-a61f-88e8c2ce1f2b None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.758825 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee84e2-f02e-45dc-a61f-88e8c2ce1f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.759095 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee84e2-f02e-45dc-a61f-88e8c2ce1f2b None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.759844 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee84e2-f02e-45dc-a61f-88e8c2ce1f2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:30.761283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee84e2-f02e-45dc-a61f-88e8c2ce1f2b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:30.785305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 555/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:18:30 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:32.824442 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d0693-c287-4f09-93c6-7a4bfe436c0e None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:32.824999 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d0693-c287-4f09-93c6-7a4bfe436c0e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:32.824999 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d0693-c287-4f09-93c6-7a4bfe436c0e None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:32.826281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 584/1139] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:32.833176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729b137-a177-4f6a-ace1-37dcd0fe5a23 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:32.833893 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729b137-a177-4f6a-ace1-37dcd0fe5a23 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:32.834015 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729b137-a177-4f6a-ace1-37dcd0fe5a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:32.854790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c729b137-a177-4f6a-ace1-37dcd0fe5a23 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:32.856024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c729b137-a177-4f6a-ace1-37dcd0fe5a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:32.926437 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 556/1140] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:32.950286 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d0693-c287-4f09-93c6-7a4bfe436c0e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:33.078260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d0693-c287-4f09-93c6-7a4bfe436c0e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:33.115039 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3243d65-7e69-4fc8-947a-6dfc29155f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:33.115876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3243d65-7e69-4fc8-947a-6dfc29155f3b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.116157 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3243d65-7e69-4fc8-947a-6dfc29155f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.116433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3243d65-7e69-4fc8-947a-6dfc29155f3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.127449 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3243d65-7e69-4fc8-947a-6dfc29155f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b3243d65-7e69-4fc8-947a-6dfc29155f3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:33.135103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:33.136283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:33.137628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:33.137628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:33.137628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:33.137628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:33.137628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:33.137628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:33.137628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:33.137628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:33.137628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:33.137628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:33.137628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:33.137628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:33.137628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 585/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:33.144983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729b137-a177-4f6a-ace1-37dcd0fe5a23 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:33.179358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:33.258608 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729b137-a177-4f6a-ace1-37dcd0fe5a23 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:33.294327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba272c-deab-4072-b833-579f9b3df615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:33.294991 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba272c-deab-4072-b833-579f9b3df615 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.295270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba272c-deab-4072-b833-579f9b3df615 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.295544 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba272c-deab-4072-b833-579f9b3df615 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.296325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba272c-deab-4072-b833-579f9b3df615 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:33.296632 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba272c-deab-4072-b833-579f9b3df615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:33.298358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba272c-deab-4072-b833-579f9b3df615 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:33.311392 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 557/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:33.319493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3243d65-7e69-4fc8-947a-6dfc29155f3b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:33.350188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:33.444289 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3243d65-7e69-4fc8-947a-6dfc29155f3b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:33.489220 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f5db5-4346-4f14-8ac3-cb887c1b3976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:33.490105 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f5db5-4346-4f14-8ac3-cb887c1b3976 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.490384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f5db5-4346-4f14-8ac3-cb887c1b3976 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.490659 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f5db5-4346-4f14-8ac3-cb887c1b3976 None admin] PATH_INFO: `/v3/users/de0f08f5219a486fa14480343476dffc` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.506968 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f5db5-4346-4f14-8ac3-cb887c1b3976 None admin] RBAC: Authorizing `identity:get_user(user_id=de0f08f5219a486fa14480343476dffc)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:33.509324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f5db5-4346-4f14-8ac3-cb887c1b3976 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:33.511966 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 586/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:33 2022] GET /identity/v3/users/de0f08f5219a486fa14480343476dffc => generated 286 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:33.521231 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba272c-deab-4072-b833-579f9b3df615 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:33.613100 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:33.629130 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba272c-deab-4072-b833-579f9b3df615 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:33.670473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f307b3-b544-4d33-9947-a07fbb69de23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:33.671429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f307b3-b544-4d33-9947-a07fbb69de23 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.671824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f307b3-b544-4d33-9947-a07fbb69de23 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.672211 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f307b3-b544-4d33-9947-a07fbb69de23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.741162 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f307b3-b544-4d33-9947-a07fbb69de23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:33.742618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f307b3-b544-4d33-9947-a07fbb69de23 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:33.826625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:33.843837 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 558/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:18:33.850266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f5db5-4346-4f14-8ac3-cb887c1b3976 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:33.930716 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:33.958917 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f5db5-4346-4f14-8ac3-cb887c1b3976 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:33.997088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d3fc9-4359-4408-be55-1d4e8bd62060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:33.997956 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d3fc9-4359-4408-be55-1d4e8bd62060 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.998236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d3fc9-4359-4408-be55-1d4e8bd62060 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.998517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d3fc9-4359-4408-be55-1d4e8bd62060 None admin] PATH_INFO: `/v3/projects/57c15c47fc2c4da49ebca26c3c7558e2` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.999848 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d3fc9-4359-4408-be55-1d4e8bd62060 None admin] RBAC: Authorizing `identity:get_project(project_id=57c15c47fc2c4da49ebca26c3c7558e2)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:34.001522 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d3fc9-4359-4408-be55-1d4e8bd62060 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:34.003236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 587/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:33 2022] GET /identity/v3/projects/57c15c47fc2c4da49ebca26c3c7558e2 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:34.009754 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f307b3-b544-4d33-9947-a07fbb69de23 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:34.109030 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f307b3-b544-4d33-9947-a07fbb69de23 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:34.148485 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ad0f7-4b2a-45b7-bf72-c50d5a2b3c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:34.149130 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ad0f7-4b2a-45b7-bf72-c50d5a2b3c8f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:34.149405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ad0f7-4b2a-45b7-bf72-c50d5a2b3c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:34.149677 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ad0f7-4b2a-45b7-bf72-c50d5a2b3c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:34.150505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ad0f7-4b2a-45b7-bf72-c50d5a2b3c8f None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=57c15c47fc2c4da49ebca26c3c7558e2, user.id=de0f08f5219a486fa14480343476dffc) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:34.150813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ad0f7-4b2a-45b7-bf72-c50d5a2b3c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:34.152279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ad0f7-4b2a-45b7-bf72-c50d5a2b3c8f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:34.158368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 559/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:34 2022] GET /identity/v3/role_assignments?user.id=de0f08f5219a486fa14480343476dffc&scope.project.id=57c15c47fc2c4da49ebca26c3c7558e2&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:36.158892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acd0c9-72d5-40ae-ab9c-16dd9ad6bb84 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:36.159459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acd0c9-72d5-40ae-ab9c-16dd9ad6bb84 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:36.159812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acd0c9-72d5-40ae-ab9c-16dd9ad6bb84 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:36.161229 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 588/1147] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:36.167558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886867c4-f9f5-4bf3-9d07-ffe546507469 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:36.168301 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886867c4-f9f5-4bf3-9d07-ffe546507469 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:36.168478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886867c4-f9f5-4bf3-9d07-ffe546507469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:36.189733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-886867c4-f9f5-4bf3-9d07-ffe546507469 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:36.190932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-886867c4-f9f5-4bf3-9d07-ffe546507469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:36.239488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:36.264560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 560/1148] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:36.288640 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acd0c9-72d5-40ae-ab9c-16dd9ad6bb84 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:36.401607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acd0c9-72d5-40ae-ab9c-16dd9ad6bb84 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:36.435885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98c3b2-e3ae-4b76-aa28-818e160f90c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:36.436609 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98c3b2-e3ae-4b76-aa28-818e160f90c0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:36.436884 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98c3b2-e3ae-4b76-aa28-818e160f90c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:36.437159 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98c3b2-e3ae-4b76-aa28-818e160f90c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:36.448221 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98c3b2-e3ae-4b76-aa28-818e160f90c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-2a98c3b2-e3ae-4b76-aa28-818e160f90c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:36.456015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:36.457065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:36.458143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:36.458143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:36.458143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:36.458143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:36.458143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:36.458143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:36.458143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:36.458143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:36.458143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:36.458143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:36.458143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:36.458143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:36.458143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 589/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:36.463586 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886867c4-f9f5-4bf3-9d07-ffe546507469 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:36.585474 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886867c4-f9f5-4bf3-9d07-ffe546507469 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:36.631949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e414e9-ed32-4d4a-b31a-119fd3f6ae6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:36.632623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e414e9-ed32-4d4a-b31a-119fd3f6ae6b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:36.632905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e414e9-ed32-4d4a-b31a-119fd3f6ae6b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:36.633175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e414e9-ed32-4d4a-b31a-119fd3f6ae6b None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:36.633929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e414e9-ed32-4d4a-b31a-119fd3f6ae6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:36.634238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e414e9-ed32-4d4a-b31a-119fd3f6ae6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:36.635646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e414e9-ed32-4d4a-b31a-119fd3f6ae6b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:36.644636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 561/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:36.651364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98c3b2-e3ae-4b76-aa28-818e160f90c0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:36.654712 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:36.756878 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98c3b2-e3ae-4b76-aa28-818e160f90c0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:36.793705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b44b6-3817-4aa9-b0a2-91159339cb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:36.794578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b44b6-3817-4aa9-b0a2-91159339cb5b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:36.794855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b44b6-3817-4aa9-b0a2-91159339cb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:36.795129 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b44b6-3817-4aa9-b0a2-91159339cb5b None admin] PATH_INFO: `/v3/users/de0f08f5219a486fa14480343476dffc` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:36.796578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b44b6-3817-4aa9-b0a2-91159339cb5b None admin] RBAC: Authorizing `identity:get_user(user_id=de0f08f5219a486fa14480343476dffc)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:36.798165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b44b6-3817-4aa9-b0a2-91159339cb5b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:36.799887 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 590/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:36 2022] GET /identity/v3/users/de0f08f5219a486fa14480343476dffc => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:36.807082 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e414e9-ed32-4d4a-b31a-119fd3f6ae6b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:36.863788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:36.939797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e414e9-ed32-4d4a-b31a-119fd3f6ae6b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:36.976757 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad03a8-4936-484f-b984-24234b028239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:36.977614 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad03a8-4936-484f-b984-24234b028239 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:36.977895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad03a8-4936-484f-b984-24234b028239 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:36.978171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad03a8-4936-484f-b984-24234b028239 None admin] PATH_INFO: `/v3/projects/57c15c47fc2c4da49ebca26c3c7558e2` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:36.979492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad03a8-4936-484f-b984-24234b028239 None admin] RBAC: Authorizing `identity:get_project(project_id=57c15c47fc2c4da49ebca26c3c7558e2)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:36.980988 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad03a8-4936-484f-b984-24234b028239 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:36.982695 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 562/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:36 2022] GET /identity/v3/projects/57c15c47fc2c4da49ebca26c3c7558e2 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:36.990239 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b44b6-3817-4aa9-b0a2-91159339cb5b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:37.064228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:37.100444 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b44b6-3817-4aa9-b0a2-91159339cb5b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:37.135620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005aa82-8b5e-4ad0-b211-f536ad2f8259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:37.136515 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005aa82-8b5e-4ad0-b211-f536ad2f8259 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:37.136796 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005aa82-8b5e-4ad0-b211-f536ad2f8259 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:37.137074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005aa82-8b5e-4ad0-b211-f536ad2f8259 None admin] PATH_INFO: `/v3/projects/57c15c47fc2c4da49ebca26c3c7558e2/users/de0f08f5219a486fa14480343476dffc/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:37.139322 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005aa82-8b5e-4ad0-b211-f536ad2f8259 None admin] RBAC: Authorizing `identity:create_grant(project_id=57c15c47fc2c4da49ebca26c3c7558e2, user_id=de0f08f5219a486fa14480343476dffc, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:37.140812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005aa82-8b5e-4ad0-b211-f536ad2f8259 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:37.160585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 591/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:18:36 2022] PUT /identity/v3/projects/57c15c47fc2c4da49ebca26c3c7558e2/users/de0f08f5219a486fa14480343476dffc/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:18:39.157215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698768d-70f6-4a66-bdf6-37f80c6c8f3b None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:39.158108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698768d-70f6-4a66-bdf6-37f80c6c8f3b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:39.158108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698768d-70f6-4a66-bdf6-37f80c6c8f3b None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:39.160440 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 563/1154] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:39.169402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd18f71-92f9-47a5-a6e9-da77f9fa8e63 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:39.170106 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd18f71-92f9-47a5-a6e9-da77f9fa8e63 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:39.170292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd18f71-92f9-47a5-a6e9-da77f9fa8e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:39.189575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ecd18f71-92f9-47a5-a6e9-da77f9fa8e63 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:39.190781 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ecd18f71-92f9-47a5-a6e9-da77f9fa8e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:39.261597 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 592/1155] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:39.299992 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698768d-70f6-4a66-bdf6-37f80c6c8f3b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:39.421865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698768d-70f6-4a66-bdf6-37f80c6c8f3b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:39.431781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:39.458418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf833f-4ddc-439c-b6a7-6cc2b9ce1537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:39.459228 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf833f-4ddc-439c-b6a7-6cc2b9ce1537 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:39.459513 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf833f-4ddc-439c-b6a7-6cc2b9ce1537 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:39.459812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf833f-4ddc-439c-b6a7-6cc2b9ce1537 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:39.471860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf833f-4ddc-439c-b6a7-6cc2b9ce1537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-addf833f-4ddc-439c-b6a7-6cc2b9ce1537 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:39.481221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:39.482289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:39.483253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:39.483253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:39.483253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:39.483253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:39.483253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:39.483253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:39.483253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:39.483253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:39.483253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:39.483253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:39.483253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:39.483253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:39.483253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 564/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:39.492385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd18f71-92f9-47a5-a6e9-da77f9fa8e63 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:39.552874 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:39.602509 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd18f71-92f9-47a5-a6e9-da77f9fa8e63 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:39.638675 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24c47c-c11f-460d-aba0-acd4c8602363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:39.639337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24c47c-c11f-460d-aba0-acd4c8602363 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:39.639641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24c47c-c11f-460d-aba0-acd4c8602363 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:39.639927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24c47c-c11f-460d-aba0-acd4c8602363 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:39.640683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24c47c-c11f-460d-aba0-acd4c8602363 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:39.641119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24c47c-c11f-460d-aba0-acd4c8602363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:39.642839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24c47c-c11f-460d-aba0-acd4c8602363 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:39.652622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 593/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:39.659023 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf833f-4ddc-439c-b6a7-6cc2b9ce1537 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:39.773676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf833f-4ddc-439c-b6a7-6cc2b9ce1537 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:39.811110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d020d-48ce-46c8-b232-31ed90e9c3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:39.811996 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d020d-48ce-46c8-b232-31ed90e9c3df None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:39.812269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d020d-48ce-46c8-b232-31ed90e9c3df None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:39.812541 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d020d-48ce-46c8-b232-31ed90e9c3df None admin] PATH_INFO: `/v3/users/de0f08f5219a486fa14480343476dffc` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:39.813895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d020d-48ce-46c8-b232-31ed90e9c3df None admin] RBAC: Authorizing `identity:get_user(user_id=de0f08f5219a486fa14480343476dffc)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:39.815327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d020d-48ce-46c8-b232-31ed90e9c3df None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:39.816980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 565/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:39 2022] GET /identity/v3/users/de0f08f5219a486fa14480343476dffc => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:39.823440 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24c47c-c11f-460d-aba0-acd4c8602363 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:39.944259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24c47c-c11f-460d-aba0-acd4c8602363 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:39.966634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:39.981138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a19528-0559-4ffb-86c5-56ec18604024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:39.981797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a19528-0559-4ffb-86c5-56ec18604024 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:39.982080 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a19528-0559-4ffb-86c5-56ec18604024 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:39.982357 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a19528-0559-4ffb-86c5-56ec18604024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.055033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a19528-0559-4ffb-86c5-56ec18604024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:40.056438 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a19528-0559-4ffb-86c5-56ec18604024 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:40.165886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 594/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:18:40.172481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d020d-48ce-46c8-b232-31ed90e9c3df None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:40.222181 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:40.292143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d020d-48ce-46c8-b232-31ed90e9c3df None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:40.329885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053d41b-7807-4cc4-ad24-4f511aa68e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:40.330671 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053d41b-7807-4cc4-ad24-4f511aa68e83 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.330952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053d41b-7807-4cc4-ad24-4f511aa68e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.331229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053d41b-7807-4cc4-ad24-4f511aa68e83 None admin] PATH_INFO: `/v3/projects/57c15c47fc2c4da49ebca26c3c7558e2` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.332504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053d41b-7807-4cc4-ad24-4f511aa68e83 None admin] RBAC: Authorizing `identity:get_project(project_id=57c15c47fc2c4da49ebca26c3c7558e2)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:40.333953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053d41b-7807-4cc4-ad24-4f511aa68e83 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:40.335632 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 566/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:40 2022] GET /identity/v3/projects/57c15c47fc2c4da49ebca26c3c7558e2 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:40.342211 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a19528-0559-4ffb-86c5-56ec18604024 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:40.370738 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:40.456405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a19528-0559-4ffb-86c5-56ec18604024 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:40.492088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e371ed6-7356-4d50-bc0c-19e9c8a748ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:40.492739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e371ed6-7356-4d50-bc0c-19e9c8a748ee None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.493032 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e371ed6-7356-4d50-bc0c-19e9c8a748ee None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.493303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e371ed6-7356-4d50-bc0c-19e9c8a748ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.494139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e371ed6-7356-4d50-bc0c-19e9c8a748ee None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=57c15c47fc2c4da49ebca26c3c7558e2, user.id=de0f08f5219a486fa14480343476dffc) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:40.494450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e371ed6-7356-4d50-bc0c-19e9c8a748ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:40.495918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e371ed6-7356-4d50-bc0c-19e9c8a748ee None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:40.502373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 595/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:40 2022] GET /identity/v3/role_assignments?user.id=de0f08f5219a486fa14480343476dffc&scope.project.id=57c15c47fc2c4da49ebca26c3c7558e2&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:42.552526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb2316-8b85-4e4a-964e-e89f2c29e728 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:42.553407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb2316-8b85-4e4a-964e-e89f2c29e728 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:42.553407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb2316-8b85-4e4a-964e-e89f2c29e728 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:42.555639 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 567/1162] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:42.563958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8b877-07d0-492f-89aa-4b3730a6d32e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:42.564393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8b877-07d0-492f-89aa-4b3730a6d32e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:42.564482 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8b877-07d0-492f-89aa-4b3730a6d32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:42.583381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-89d8b877-07d0-492f-89aa-4b3730a6d32e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:42.584633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-89d8b877-07d0-492f-89aa-4b3730a6d32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:42.659323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 596/1163] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:18:42.687514 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb2316-8b85-4e4a-964e-e89f2c29e728 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:42.798186 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb2316-8b85-4e4a-964e-e89f2c29e728 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:42.800576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:42.834801 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbce5ff-f7db-477a-8c20-9501503bcb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:42.835448 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbce5ff-f7db-477a-8c20-9501503bcb76 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:42.835766 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbce5ff-f7db-477a-8c20-9501503bcb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:42.836045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbce5ff-f7db-477a-8c20-9501503bcb76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:42.909960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbce5ff-f7db-477a-8c20-9501503bcb76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:42.911418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbce5ff-f7db-477a-8c20-9501503bcb76 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:43.012445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 568/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:18:43.020173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8b877-07d0-492f-89aa-4b3730a6d32e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:43.038477 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:43.125233 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8b877-07d0-492f-89aa-4b3730a6d32e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:43.160777 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb21c3-0e4c-4dcb-bfe4-eda7aa8a8340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:43.161585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb21c3-0e4c-4dcb-bfe4-eda7aa8a8340 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:43.161872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb21c3-0e4c-4dcb-bfe4-eda7aa8a8340 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:43.162147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb21c3-0e4c-4dcb-bfe4-eda7aa8a8340 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:43.169103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb21c3-0e4c-4dcb-bfe4-eda7aa8a8340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:43.170576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb21c3-0e4c-4dcb-bfe4-eda7aa8a8340 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-b6bb21c3-0e4c-4dcb-bfe4-eda7aa8a8340 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:43.184953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:43.186165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:43.187282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:43.187282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:43.187282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:43.187282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:43.187282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:43.187282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:43.187282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:43.187282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:43.187282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:43.187282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:43.187282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 08:18:43.187282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:18:43.187282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 08:18:43.187282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:43.187282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 597/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 08:18:43 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:43.193545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbce5ff-f7db-477a-8c20-9501503bcb76 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:43.198313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:43.312526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbce5ff-f7db-477a-8c20-9501503bcb76 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:43.361675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054d8a5-303b-442e-90b2-800758ebf051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:43.362354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054d8a5-303b-442e-90b2-800758ebf051 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:43.362640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054d8a5-303b-442e-90b2-800758ebf051 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:43.362916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054d8a5-303b-442e-90b2-800758ebf051 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:43.363643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054d8a5-303b-442e-90b2-800758ebf051 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:43.363981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054d8a5-303b-442e-90b2-800758ebf051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:43.365363 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054d8a5-303b-442e-90b2-800758ebf051 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:43.373027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 569/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 21 08:18:43 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:45.393288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7ebba-1fc6-4aec-8362-47c0a1bceefa None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:45.393957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7ebba-1fc6-4aec-8362-47c0a1bceefa None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:45.393957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7ebba-1fc6-4aec-8362-47c0a1bceefa None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:45.395246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 598/1167] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:18:45.401081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53c8ca-7872-4ba5-aa65-6ed7df647840 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:45.401522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53c8ca-7872-4ba5-aa65-6ed7df647840 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:45.401619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53c8ca-7872-4ba5-aa65-6ed7df647840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:45.424486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3d53c8ca-7872-4ba5-aa65-6ed7df647840 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:45.426582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3d53c8ca-7872-4ba5-aa65-6ed7df647840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:45.495185 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:45.501797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 570/1168] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:45.525317 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7ebba-1fc6-4aec-8362-47c0a1bceefa None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:45.616270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:45.641637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7ebba-1fc6-4aec-8362-47c0a1bceefa None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:45.680543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b116d-ede0-457a-934a-fb71e8de03e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:45.681213 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b116d-ede0-457a-934a-fb71e8de03e6 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:45.681490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b116d-ede0-457a-934a-fb71e8de03e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:45.681748 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b116d-ede0-457a-934a-fb71e8de03e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:45.682488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b116d-ede0-457a-934a-fb71e8de03e6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:45.683906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b116d-ede0-457a-934a-fb71e8de03e6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:45.706870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 599/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Thu Jul 21 08:18:45 2022] POST /identity/v3/domains => generated 267 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:47.741855 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed4f66-d253-4e52-9dcc-ef8864b9decb None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:47.742696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed4f66-d253-4e52-9dcc-ef8864b9decb None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:47.742696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed4f66-d253-4e52-9dcc-ef8864b9decb None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:47.744849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 571/1170] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:47.751532 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210af34-1e0c-4a77-98a1-79aacc76f769 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:47.752018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210af34-1e0c-4a77-98a1-79aacc76f769 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:47.752160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210af34-1e0c-4a77-98a1-79aacc76f769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:47.779688 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3210af34-1e0c-4a77-98a1-79aacc76f769 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:47.781606 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3210af34-1e0c-4a77-98a1-79aacc76f769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:47.865237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 600/1171] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:47.889891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed4f66-d253-4e52-9dcc-ef8864b9decb None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:48.007186 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed4f66-d253-4e52-9dcc-ef8864b9decb None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:48.042051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc2ab8-78e5-41e5-950d-135beae69ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:48.042908 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc2ab8-78e5-41e5-950d-135beae69ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:48.043187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc2ab8-78e5-41e5-950d-135beae69ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:48.043465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc2ab8-78e5-41e5-950d-135beae69ee6 None admin] PATH_INFO: `/v3/domains/5a2c7822ad384fc880f5641005618aa1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:48.054553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc2ab8-78e5-41e5-950d-135beae69ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5a2c7822ad384fc880f5641005618aa1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:48.056042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc2ab8-78e5-41e5-950d-135beae69ee6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:48.057669 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 572/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Thu Jul 21 08:18:47 2022] GET /identity/v3/domains/5a2c7822ad384fc880f5641005618aa1 => generated 267 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:48.067324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210af34-1e0c-4a77-98a1-79aacc76f769 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:48.135557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:48.185649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210af34-1e0c-4a77-98a1-79aacc76f769 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:48.233025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56091c0b-8c98-44b0-b9b3-b540198bb740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:48.233717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56091c0b-8c98-44b0-b9b3-b540198bb740 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:48.233976 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56091c0b-8c98-44b0-b9b3-b540198bb740 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:48.234272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56091c0b-8c98-44b0-b9b3-b540198bb740 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:48.235178 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56091c0b-8c98-44b0-b9b3-b540198bb740 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:48.236700 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56091c0b-8c98-44b0-b9b3-b540198bb740 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:48.269106 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 601/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 08:18:48 2022] POST /identity/v3/projects => generated 361 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:50.546645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2441268-6ca4-47c1-bc8f-033c0ae159f2 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:50.547225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2441268-6ca4-47c1-bc8f-033c0ae159f2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:50.547326 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2441268-6ca4-47c1-bc8f-033c0ae159f2 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:50.549001 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 573/1174] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:50.555680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ec0ca-403e-441f-93c4-dffa796b4d35 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:50.556137 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ec0ca-403e-441f-93c4-dffa796b4d35 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:50.556400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ec0ca-403e-441f-93c4-dffa796b4d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:50.576709 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-180ec0ca-403e-441f-93c4-dffa796b4d35 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:50.577899 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-180ec0ca-403e-441f-93c4-dffa796b4d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:50.649923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 602/1175] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:50.675561 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2441268-6ca4-47c1-bc8f-033c0ae159f2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:50.741439 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:50.786089 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2441268-6ca4-47c1-bc8f-033c0ae159f2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:50.820791 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840ddde-df0e-4a62-b82d-5adc9c8c0af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:50.821650 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840ddde-df0e-4a62-b82d-5adc9c8c0af4 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:50.821929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840ddde-df0e-4a62-b82d-5adc9c8c0af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:50.822197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840ddde-df0e-4a62-b82d-5adc9c8c0af4 None admin] PATH_INFO: `/v3/domains/5a2c7822ad384fc880f5641005618aa1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:50.823498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840ddde-df0e-4a62-b82d-5adc9c8c0af4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5a2c7822ad384fc880f5641005618aa1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:50.824970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840ddde-df0e-4a62-b82d-5adc9c8c0af4 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:50.826597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 574/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Thu Jul 21 08:18:50 2022] GET /identity/v3/domains/5a2c7822ad384fc880f5641005618aa1 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:50.832960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ec0ca-403e-441f-93c4-dffa796b4d35 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:50.886748 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:50.951316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ec0ca-403e-441f-93c4-dffa796b4d35 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:50.987042 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcfcc2-cffa-43dd-9386-4294465f36ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:50.987715 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcfcc2-cffa-43dd-9386-4294465f36ae None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:50.988029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcfcc2-cffa-43dd-9386-4294465f36ae None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:50.988378 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcfcc2-cffa-43dd-9386-4294465f36ae None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:50.989103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcfcc2-cffa-43dd-9386-4294465f36ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:50.990550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcfcc2-cffa-43dd-9386-4294465f36ae None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:51.012414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 603/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:18:50 2022] POST /identity/v3/users => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:53.094990 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68d6f9-2e24-44aa-91eb-285b4d889ef3 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.095641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68d6f9-2e24-44aa-91eb-285b4d889ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.095641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68d6f9-2e24-44aa-91eb-285b4d889ef3 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.097808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 575/1178] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:53.106727 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca34f1-488f-42ee-959d-c2c6725fb7fc None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.107443 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca34f1-488f-42ee-959d-c2c6725fb7fc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.107664 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca34f1-488f-42ee-959d-c2c6725fb7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.132360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e5ca34f1-488f-42ee-959d-c2c6725fb7fc None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:53.133538 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e5ca34f1-488f-42ee-959d-c2c6725fb7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:53.206961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 604/1179] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:53.231055 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68d6f9-2e24-44aa-91eb-285b4d889ef3 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:53.339846 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68d6f9-2e24-44aa-91eb-285b4d889ef3 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:53.364990 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:53.380214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9b262-bbf6-4e24-87c6-4259fd20ce37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:53.381442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9b262-bbf6-4e24-87c6-4259fd20ce37 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.381830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9b262-bbf6-4e24-87c6-4259fd20ce37 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.382256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9b262-bbf6-4e24-87c6-4259fd20ce37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.397805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9b262-bbf6-4e24-87c6-4259fd20ce37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-e7f9b262-bbf6-4e24-87c6-4259fd20ce37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:53.405354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:53.406589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:53.407532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:53.407532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:53.407532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:53.407532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:53.407532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:53.407532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:53.407532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:53.407532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:53.407532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:53.407532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:53.407532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:53.407532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:53.407532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 576/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:53.412717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca34f1-488f-42ee-959d-c2c6725fb7fc None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:53.446622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:53.533387 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca34f1-488f-42ee-959d-c2c6725fb7fc None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:53.571327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14163a61-d46b-4a00-b407-9104c3ea4e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:53.572121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14163a61-d46b-4a00-b407-9104c3ea4e9a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.572448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14163a61-d46b-4a00-b407-9104c3ea4e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.572650 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14163a61-d46b-4a00-b407-9104c3ea4e9a None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.573377 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14163a61-d46b-4a00-b407-9104c3ea4e9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:53.573678 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14163a61-d46b-4a00-b407-9104c3ea4e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:53.575056 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14163a61-d46b-4a00-b407-9104c3ea4e9a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:53.583240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 605/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:53.589498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9b262-bbf6-4e24-87c6-4259fd20ce37 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:53.701922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9b262-bbf6-4e24-87c6-4259fd20ce37 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:53.744569 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e926b35-e0c6-4881-aced-5a71d0d72266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:53.745435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e926b35-e0c6-4881-aced-5a71d0d72266 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.745716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e926b35-e0c6-4881-aced-5a71d0d72266 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.745990 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e926b35-e0c6-4881-aced-5a71d0d72266 None admin] PATH_INFO: `/v3/users/f3034ea0197d4b599b985ff5ab2e1a31` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.759848 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e926b35-e0c6-4881-aced-5a71d0d72266 None admin] RBAC: Authorizing `identity:get_user(user_id=f3034ea0197d4b599b985ff5ab2e1a31)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:53.761312 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e926b35-e0c6-4881-aced-5a71d0d72266 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:53.762972 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 577/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:53 2022] GET /identity/v3/users/f3034ea0197d4b599b985ff5ab2e1a31 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:53.769856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14163a61-d46b-4a00-b407-9104c3ea4e9a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:53.879185 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:53.886828 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14163a61-d46b-4a00-b407-9104c3ea4e9a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:53.925470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda2d7c-d9b7-410e-9c9b-c82078774417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:53.926110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda2d7c-d9b7-410e-9c9b-c82078774417 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.926394 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda2d7c-d9b7-410e-9c9b-c82078774417 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.926672 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda2d7c-d9b7-410e-9c9b-c82078774417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.995858 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda2d7c-d9b7-410e-9c9b-c82078774417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:53.997240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda2d7c-d9b7-410e-9c9b-c82078774417 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:54.107217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:54.115157 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 606/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:18:54.121618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e926b35-e0c6-4881-aced-5a71d0d72266 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:54.172539 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:54.240920 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e926b35-e0c6-4881-aced-5a71d0d72266 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:54.283679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965de928-5ab1-4a21-98d8-057309cba381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:54.284485 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965de928-5ab1-4a21-98d8-057309cba381 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.284764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965de928-5ab1-4a21-98d8-057309cba381 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.285034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965de928-5ab1-4a21-98d8-057309cba381 None admin] PATH_INFO: `/v3/projects/ea38f980b73c4e32af4507c875fb8b62` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.286373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965de928-5ab1-4a21-98d8-057309cba381 None admin] RBAC: Authorizing `identity:get_project(project_id=ea38f980b73c4e32af4507c875fb8b62)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:54.287862 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965de928-5ab1-4a21-98d8-057309cba381 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:54.289619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 578/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:54 2022] GET /identity/v3/projects/ea38f980b73c4e32af4507c875fb8b62 => generated 361 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:54.299842 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda2d7c-d9b7-410e-9c9b-c82078774417 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:54.416363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda2d7c-d9b7-410e-9c9b-c82078774417 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:54.451565 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6f268-8338-4e8e-9aca-98096dfa7d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:54.452262 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6f268-8338-4e8e-9aca-98096dfa7d63 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.452543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6f268-8338-4e8e-9aca-98096dfa7d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.452816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6f268-8338-4e8e-9aca-98096dfa7d63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.453649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6f268-8338-4e8e-9aca-98096dfa7d63 None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=ea38f980b73c4e32af4507c875fb8b62, user.id=f3034ea0197d4b599b985ff5ab2e1a31) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:54.453960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6f268-8338-4e8e-9aca-98096dfa7d63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:54.455416 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6f268-8338-4e8e-9aca-98096dfa7d63 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:54.461156 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 607/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:54 2022] GET /identity/v3/role_assignments?user.id=f3034ea0197d4b599b985ff5ab2e1a31&scope.project.id=ea38f980b73c4e32af4507c875fb8b62&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:56.440938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66413bad-d6bd-42a6-add6-8b846ad04321 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:56.441819 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66413bad-d6bd-42a6-add6-8b846ad04321 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:56.441819 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66413bad-d6bd-42a6-add6-8b846ad04321 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:56.444649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 579/1186] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:56.451791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad9d8b-48bc-473f-8838-6053a44b7d7b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:56.452784 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad9d8b-48bc-473f-8838-6053a44b7d7b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:56.452784 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad9d8b-48bc-473f-8838-6053a44b7d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:56.470769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d6ad9d8b-48bc-473f-8838-6053a44b7d7b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:56.472017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d6ad9d8b-48bc-473f-8838-6053a44b7d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:56.536465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:56.550617 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 608/1187] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:56.578381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66413bad-d6bd-42a6-add6-8b846ad04321 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:56.699158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66413bad-d6bd-42a6-add6-8b846ad04321 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:56.712438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:56.737794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7700dfa-fb43-4502-8c5b-5070230c4a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:56.738588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7700dfa-fb43-4502-8c5b-5070230c4a29 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:56.738863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7700dfa-fb43-4502-8c5b-5070230c4a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:56.739130 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7700dfa-fb43-4502-8c5b-5070230c4a29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:56.749788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7700dfa-fb43-4502-8c5b-5070230c4a29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-c7700dfa-fb43-4502-8c5b-5070230c4a29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:56.757526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:56.758571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:56.759508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:56.759508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:56.759508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:56.759508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:56.759508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:56.759508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:56.759508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:56.759508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:56.759508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:56.759508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:56.759508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:56.759508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:18:56.759508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 580/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:56.766769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad9d8b-48bc-473f-8838-6053a44b7d7b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:56.887777 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad9d8b-48bc-473f-8838-6053a44b7d7b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:56.925470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44bb68-91f8-4531-a2f1-6616856e205d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:56.926142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44bb68-91f8-4531-a2f1-6616856e205d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:56.926420 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44bb68-91f8-4531-a2f1-6616856e205d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:56.926691 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44bb68-91f8-4531-a2f1-6616856e205d None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:56.927451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44bb68-91f8-4531-a2f1-6616856e205d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:56.927806 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44bb68-91f8-4531-a2f1-6616856e205d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:56.929181 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44bb68-91f8-4531-a2f1-6616856e205d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:56.937377 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 609/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:56.946421 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7700dfa-fb43-4502-8c5b-5070230c4a29 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:57.050555 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7700dfa-fb43-4502-8c5b-5070230c4a29 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:57.084855 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b811-e715-4f90-b0a8-a8adbc9d10d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:57.085720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b811-e715-4f90-b0a8-a8adbc9d10d0 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:57.086001 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b811-e715-4f90-b0a8-a8adbc9d10d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:57.086273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b811-e715-4f90-b0a8-a8adbc9d10d0 None admin] PATH_INFO: `/v3/users/f3034ea0197d4b599b985ff5ab2e1a31` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:57.087585 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5b811-e715-4f90-b0a8-a8adbc9d10d0 None admin] RBAC: Authorizing `identity:get_user(user_id=f3034ea0197d4b599b985ff5ab2e1a31)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:57.089058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5b811-e715-4f90-b0a8-a8adbc9d10d0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:57.090683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 581/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:56 2022] GET /identity/v3/users/f3034ea0197d4b599b985ff5ab2e1a31 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:57.097383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44bb68-91f8-4531-a2f1-6616856e205d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:57.160282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:57.212942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44bb68-91f8-4531-a2f1-6616856e205d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:57.259664 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad2a4a-8f49-49f0-92be-50c64cae0b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:57.260977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2a4a-8f49-49f0-92be-50c64cae0b92 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:57.261407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2a4a-8f49-49f0-92be-50c64cae0b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:57.261842 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2a4a-8f49-49f0-92be-50c64cae0b92 None admin] PATH_INFO: `/v3/projects/ea38f980b73c4e32af4507c875fb8b62` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:57.263842 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad2a4a-8f49-49f0-92be-50c64cae0b92 None admin] RBAC: Authorizing `identity:get_project(project_id=ea38f980b73c4e32af4507c875fb8b62)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:57.266306 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad2a4a-8f49-49f0-92be-50c64cae0b92 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:57.268152 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 610/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:57 2022] GET /identity/v3/projects/ea38f980b73c4e32af4507c875fb8b62 => generated 361 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:57.277838 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b811-e715-4f90-b0a8-a8adbc9d10d0 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:57.321674 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:57.389214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b811-e715-4f90-b0a8-a8adbc9d10d0 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:57.425030 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876438e-e423-42cb-b5e7-da6ab912b675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:57.425905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876438e-e423-42cb-b5e7-da6ab912b675 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:57.426181 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876438e-e423-42cb-b5e7-da6ab912b675 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:57.426449 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876438e-e423-42cb-b5e7-da6ab912b675 None admin] PATH_INFO: `/v3/projects/ea38f980b73c4e32af4507c875fb8b62/users/f3034ea0197d4b599b985ff5ab2e1a31/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:57.428675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876438e-e423-42cb-b5e7-da6ab912b675 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea38f980b73c4e32af4507c875fb8b62, user_id=f3034ea0197d4b599b985ff5ab2e1a31, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:57.430107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876438e-e423-42cb-b5e7-da6ab912b675 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:57.448148 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 582/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:18:57 2022] PUT /identity/v3/projects/ea38f980b73c4e32af4507c875fb8b62/users/f3034ea0197d4b599b985ff5ab2e1a31/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:18:59.433839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a231e7b-364e-4519-89c6-4cd3cfe437eb None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:59.434403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a231e7b-364e-4519-89c6-4cd3cfe437eb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:59.434403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a231e7b-364e-4519-89c6-4cd3cfe437eb None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:59.435790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 611/1193] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:59.442395 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a013f-b76d-41d4-8525-11c10cdddbd9 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:59.443121 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a013f-b76d-41d4-8525-11c10cdddbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:59.443274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a013f-b76d-41d4-8525-11c10cdddbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:59.466759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8f5a013f-b76d-41d4-8525-11c10cdddbd9 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:59.467990 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8f5a013f-b76d-41d4-8525-11c10cdddbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:59.541578 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 583/1194] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:18:59.574256 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a231e7b-364e-4519-89c6-4cd3cfe437eb None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:59.688965 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a231e7b-364e-4519-89c6-4cd3cfe437eb None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:59.714961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:59.729535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb7d17-84ce-480e-b800-ba2ab7c86b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:59.730338 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb7d17-84ce-480e-b800-ba2ab7c86b4e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:59.730620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb7d17-84ce-480e-b800-ba2ab7c86b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:59.730895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb7d17-84ce-480e-b800-ba2ab7c86b4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:59.741497 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb7d17-84ce-480e-b800-ba2ab7c86b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-fcbb7d17-84ce-480e-b800-ba2ab7c86b4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:59.749153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:59.750287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:59.751408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:59.751408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:59.751408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:59.751408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:59.751408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:59.751408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:59.751408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:59.751408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:59.751408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:59.751408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:59.751408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:59.751408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:18:59.751408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 612/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:59.756706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a013f-b76d-41d4-8525-11c10cdddbd9 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:59.788715 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:59.861880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a013f-b76d-41d4-8525-11c10cdddbd9 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:59.898980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae6195-c23d-4790-8e7f-3649951e0d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:59.899645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae6195-c23d-4790-8e7f-3649951e0d87 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:59.899952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae6195-c23d-4790-8e7f-3649951e0d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:59.900232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae6195-c23d-4790-8e7f-3649951e0d87 None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:59.900991 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae6195-c23d-4790-8e7f-3649951e0d87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:59.901297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae6195-c23d-4790-8e7f-3649951e0d87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:59.902690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae6195-c23d-4790-8e7f-3649951e0d87 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:59.911162 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 584/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:59.920935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb7d17-84ce-480e-b800-ba2ab7c86b4e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:00.035003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb7d17-84ce-480e-b800-ba2ab7c86b4e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:00.070606 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bb10b-e88b-4c4e-b23f-44e8b17e82d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:00.071476 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bb10b-e88b-4c4e-b23f-44e8b17e82d0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:00.071799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bb10b-e88b-4c4e-b23f-44e8b17e82d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:00.072067 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bb10b-e88b-4c4e-b23f-44e8b17e82d0 None admin] PATH_INFO: `/v3/users/f3034ea0197d4b599b985ff5ab2e1a31` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:00.073293 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bb10b-e88b-4c4e-b23f-44e8b17e82d0 None admin] RBAC: Authorizing `identity:get_user(user_id=f3034ea0197d4b599b985ff5ab2e1a31)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:00.074772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bb10b-e88b-4c4e-b23f-44e8b17e82d0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:00.076462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 613/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:59 2022] GET /identity/v3/users/f3034ea0197d4b599b985ff5ab2e1a31 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:00.083430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae6195-c23d-4790-8e7f-3649951e0d87 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:00.209483 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:00.218436 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae6195-c23d-4790-8e7f-3649951e0d87 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:00.251292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25653372-5784-4475-8581-fb8f1023b279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:00.251960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25653372-5784-4475-8581-fb8f1023b279 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:00.252239 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25653372-5784-4475-8581-fb8f1023b279 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:00.252508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25653372-5784-4475-8581-fb8f1023b279 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:00.333530 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25653372-5784-4475-8581-fb8f1023b279 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:00.334899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25653372-5784-4475-8581-fb8f1023b279 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:00.449851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:00.466161 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 585/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:19:00.473776 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bb10b-e88b-4c4e-b23f-44e8b17e82d0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:00.525766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:00.579410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bb10b-e88b-4c4e-b23f-44e8b17e82d0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:00.615442 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2ed25-5882-4bba-ada7-931b3d202de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:00.616278 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2ed25-5882-4bba-ada7-931b3d202de9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:00.616567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2ed25-5882-4bba-ada7-931b3d202de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:00.616843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2ed25-5882-4bba-ada7-931b3d202de9 None admin] PATH_INFO: `/v3/projects/ea38f980b73c4e32af4507c875fb8b62` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:00.618062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2ed25-5882-4bba-ada7-931b3d202de9 None admin] RBAC: Authorizing `identity:get_project(project_id=ea38f980b73c4e32af4507c875fb8b62)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:00.619526 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2ed25-5882-4bba-ada7-931b3d202de9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:00.621279 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 614/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:00 2022] GET /identity/v3/projects/ea38f980b73c4e32af4507c875fb8b62 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:00.627880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25653372-5784-4475-8581-fb8f1023b279 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:00.736406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25653372-5784-4475-8581-fb8f1023b279 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:00.772331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31ec68-3397-4a8e-9679-9154543ffe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:00.772977 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31ec68-3397-4a8e-9679-9154543ffe1c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:00.773259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31ec68-3397-4a8e-9679-9154543ffe1c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:00.773538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31ec68-3397-4a8e-9679-9154543ffe1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:00.774374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31ec68-3397-4a8e-9679-9154543ffe1c None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=ea38f980b73c4e32af4507c875fb8b62, user.id=f3034ea0197d4b599b985ff5ab2e1a31) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:00.774689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31ec68-3397-4a8e-9679-9154543ffe1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:00.776156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31ec68-3397-4a8e-9679-9154543ffe1c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:00.782863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 586/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:00 2022] GET /identity/v3/role_assignments?user.id=f3034ea0197d4b599b985ff5ab2e1a31&scope.project.id=ea38f980b73c4e32af4507c875fb8b62&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:10.610250 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=42 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:10.779428 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=72 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:56.540811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675c590-db69-4f85-978d-f771c133b98f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:56.541460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675c590-db69-4f85-978d-f771c133b98f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:56.541460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675c590-db69-4f85-978d-f771c133b98f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:56.542983 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 615/1201] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:19:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:56.548989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756bc45-2bf0-436a-99e5-e04ec32dd28d None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:56.549466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756bc45-2bf0-436a-99e5-e04ec32dd28d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:56.549560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756bc45-2bf0-436a-99e5-e04ec32dd28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:56.567888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2756bc45-2bf0-436a-99e5-e04ec32dd28d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:56.569228 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2756bc45-2bf0-436a-99e5-e04ec32dd28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:56.663640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 587/1202] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:19:56.682994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675c590-db69-4f85-978d-f771c133b98f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:56.819822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675c590-db69-4f85-978d-f771c133b98f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:56.860431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f7eff-fd5e-4f35-ad35-78ef5b722735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:56.861254 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f7eff-fd5e-4f35-ad35-78ef5b722735 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:56.861574 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f7eff-fd5e-4f35-ad35-78ef5b722735 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:56.861854 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f7eff-fd5e-4f35-ad35-78ef5b722735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:56.878927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f7eff-fd5e-4f35-ad35-78ef5b722735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:56.880490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f7eff-fd5e-4f35-ad35-78ef5b722735 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:56.902490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-435f7eff-fd5e-4f35-ad35-78ef5b722735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:56.902490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:56.902490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:56.902490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:56.902490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:56.902490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:56.902490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:56.902490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:56.902490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:56.902490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:56.902490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:56.902490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:56.902490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:56.902490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:56.902490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:56.903622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:56.904762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:56.904762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:56.904762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:56.904762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:19:56.907464 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 616/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:56.914306 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756bc45-2bf0-436a-99e5-e04ec32dd28d None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:57.035567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756bc45-2bf0-436a-99e5-e04ec32dd28d None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:57.070508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:57.080008 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad324b9-a65e-47bf-b643-b0fee5bbbbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:57.081158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad324b9-a65e-47bf-b643-b0fee5bbbbcb None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:57.081850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad324b9-a65e-47bf-b643-b0fee5bbbbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:57.082204 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad324b9-a65e-47bf-b643-b0fee5bbbbcb None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:57.083229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad324b9-a65e-47bf-b643-b0fee5bbbbcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:57.083651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad324b9-a65e-47bf-b643-b0fee5bbbbcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:57.085534 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad324b9-a65e-47bf-b643-b0fee5bbbbcb None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:57.099065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 588/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:57.105285 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f7eff-fd5e-4f35-ad35-78ef5b722735 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:57.175692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:57.236243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f7eff-fd5e-4f35-ad35-78ef5b722735 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:57.274166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe415a8-78e3-4d5e-8b46-60b0e35ad3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:57.274838 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe415a8-78e3-4d5e-8b46-60b0e35ad3a7 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:57.275143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe415a8-78e3-4d5e-8b46-60b0e35ad3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:57.275385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe415a8-78e3-4d5e-8b46-60b0e35ad3a7 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:57.276130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe415a8-78e3-4d5e-8b46-60b0e35ad3a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:57.277603 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe415a8-78e3-4d5e-8b46-60b0e35ad3a7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:57.308042 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 617/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 08:19:57 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:19:59.541322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3918de1-62e9-4536-8634-637dcd62b82a None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:59.541998 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3918de1-62e9-4536-8634-637dcd62b82a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:59.541998 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3918de1-62e9-4536-8634-637dcd62b82a None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:59.543230 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 589/1206] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:19:59.549237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e00b2-3105-4456-aea8-ddc02b39e384 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:59.549745 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e00b2-3105-4456-aea8-ddc02b39e384 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:59.549839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e00b2-3105-4456-aea8-ddc02b39e384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:59.567511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-852e00b2-3105-4456-aea8-ddc02b39e384 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:59.569011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-852e00b2-3105-4456-aea8-ddc02b39e384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:59.659696 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 618/1207] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:19:59.681693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3918de1-62e9-4536-8634-637dcd62b82a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:59.807868 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3918de1-62e9-4536-8634-637dcd62b82a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:59.844276 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa75068-9242-45e6-b1d5-247aa61a154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:59.845180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa75068-9242-45e6-b1d5-247aa61a154c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:59.845458 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa75068-9242-45e6-b1d5-247aa61a154c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:59.845759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa75068-9242-45e6-b1d5-247aa61a154c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:59.857536 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa75068-9242-45e6-b1d5-247aa61a154c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-aaa75068-9242-45e6-b1d5-247aa61a154c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:59.865779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:59.867850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:59.868922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:59.868922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:59.868922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:59.868922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:59.868922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:59.868922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:59.868922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:59.868922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:59.868922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:59.868922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:59.868922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:59.868922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:19:59.868922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 590/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:59.876741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e00b2-3105-4456-aea8-ddc02b39e384 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:59.927521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:59.995649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e00b2-3105-4456-aea8-ddc02b39e384 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:00.035058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe17a6-4455-4a9f-bdb3-23484a9c8d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:00.035832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe17a6-4455-4a9f-bdb3-23484a9c8d89 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:00.036165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe17a6-4455-4a9f-bdb3-23484a9c8d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:00.036466 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe17a6-4455-4a9f-bdb3-23484a9c8d89 None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:00.037324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe17a6-4455-4a9f-bdb3-23484a9c8d89 None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:00.037640 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe17a6-4455-4a9f-bdb3-23484a9c8d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:00.039231 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe17a6-4455-4a9f-bdb3-23484a9c8d89 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:00.049034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 619/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:00.055482 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa75068-9242-45e6-b1d5-247aa61a154c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:00.116785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:00.176179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa75068-9242-45e6-b1d5-247aa61a154c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:00.212613 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6a6e9-7b36-4ece-b6d6-ebf2aa3b1881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:00.213418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a6e9-7b36-4ece-b6d6-ebf2aa3b1881 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:00.213685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a6e9-7b36-4ece-b6d6-ebf2aa3b1881 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:00.213954 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a6e9-7b36-4ece-b6d6-ebf2aa3b1881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:00.226146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6a6e9-7b36-4ece-b6d6-ebf2aa3b1881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:00.227781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6a6e9-7b36-4ece-b6d6-ebf2aa3b1881 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:00.246299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-23f6a6e9-7b36-4ece-b6d6-ebf2aa3b1881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:00.246299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:00.246299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:00.246299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:00.246299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:00.246299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:00.246299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:00.246299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:00.246299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:00.246299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:00.246299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:00.246299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:00.246299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:00.246299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:00.246299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:00.247548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:00.255828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:00.255828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:00.255828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:00.255828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:00.255828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 591/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:00.256584 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe17a6-4455-4a9f-bdb3-23484a9c8d89 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:00.368456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:00.372114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe17a6-4455-4a9f-bdb3-23484a9c8d89 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:00.418984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c804b-53e2-40c5-bd86-10924384e109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:00.420350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c804b-53e2-40c5-bd86-10924384e109 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:00.420350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c804b-53e2-40c5-bd86-10924384e109 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:00.420555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c804b-53e2-40c5-bd86-10924384e109 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:00.421304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c804b-53e2-40c5-bd86-10924384e109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:00.421655 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c804b-53e2-40c5-bd86-10924384e109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:00.423220 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c804b-53e2-40c5-bd86-10924384e109 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:00.439631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 620/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:00.443961 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6a6e9-7b36-4ece-b6d6-ebf2aa3b1881 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:00.568907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6a6e9-7b36-4ece-b6d6-ebf2aa3b1881 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:00.572598 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:00.608245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11b299-a2d5-40a2-ac22-35cd80869cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:00.609771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11b299-a2d5-40a2-ac22-35cd80869cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:00.609771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11b299-a2d5-40a2-ac22-35cd80869cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:00.609964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11b299-a2d5-40a2-ac22-35cd80869cc0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:00.619379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11b299-a2d5-40a2-ac22-35cd80869cc0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:00.620936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11b299-a2d5-40a2-ac22-35cd80869cc0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-8b11b299-a2d5-40a2-ac22-35cd80869cc0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:00.636661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:00.638971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:00.640203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:00.640203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:00.640203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:00.640203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:00.640203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:00.640203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:00.640203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:00.640203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:00.640203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:20:00.640203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:00.640203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 592/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:00.645459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c804b-53e2-40c5-bd86-10924384e109 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:00.767208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c804b-53e2-40c5-bd86-10924384e109 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:00.813076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb5d3f-d627-4e58-a068-54f550b9837e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:00.814107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb5d3f-d627-4e58-a068-54f550b9837e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:00.814384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb5d3f-d627-4e58-a068-54f550b9837e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:00.814706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb5d3f-d627-4e58-a068-54f550b9837e None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:00.815540 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb5d3f-d627-4e58-a068-54f550b9837e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:00.815967 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb5d3f-d627-4e58-a068-54f550b9837e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:00.817466 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb5d3f-d627-4e58-a068-54f550b9837e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:00.837829 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 621/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 21 08:20:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:00.844048 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11b299-a2d5-40a2-ac22-35cd80869cc0 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:00.971002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11b299-a2d5-40a2-ac22-35cd80869cc0 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:01.023735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793d8d9-ad54-4430-a67b-3ce3017804e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:01.025138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d8d9-ad54-4430-a67b-3ce3017804e1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:01.025138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d8d9-ad54-4430-a67b-3ce3017804e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:01.025332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d8d9-ad54-4430-a67b-3ce3017804e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:01.063560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:01.115737 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793d8d9-ad54-4430-a67b-3ce3017804e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:01.117429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793d8d9-ad54-4430-a67b-3ce3017804e1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:01.252114 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 593/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:20:01.258450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb5d3f-d627-4e58-a068-54f550b9837e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:01.283189 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:01.376852 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb5d3f-d627-4e58-a068-54f550b9837e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:01.421799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc1c0c-cd93-4607-b383-c80b46081919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:01.422817 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc1c0c-cd93-4607-b383-c80b46081919 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:01.423186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc1c0c-cd93-4607-b383-c80b46081919 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:01.423633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc1c0c-cd93-4607-b383-c80b46081919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:01.439995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc1c0c-cd93-4607-b383-c80b46081919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:01.441495 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc1c0c-cd93-4607-b383-c80b46081919 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:01.467373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-cddc1c0c-cd93-4607-b383-c80b46081919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:01.467373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:01.467373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:01.467373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:01.467373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:01.467373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:01.467373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:01.467373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:01.467373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:01.467373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:01.467373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:01.467373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:01.467373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:01.467373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:01.467373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:01.474569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:01.475466 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:01.475466 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:01.475466 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:01.475466 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:20:01.475466 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 622/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:01.475794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793d8d9-ad54-4430-a67b-3ce3017804e1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:01.549581 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:01.591756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793d8d9-ad54-4430-a67b-3ce3017804e1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:01.626349 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bedeb3-07be-4286-a746-ce6ff7e43ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:01.627016 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bedeb3-07be-4286-a746-ce6ff7e43ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:01.627294 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bedeb3-07be-4286-a746-ce6ff7e43ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:01.627566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bedeb3-07be-4286-a746-ce6ff7e43ee6 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:01.628320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bedeb3-07be-4286-a746-ce6ff7e43ee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:01.628626 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bedeb3-07be-4286-a746-ce6ff7e43ee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:01.630083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bedeb3-07be-4286-a746-ce6ff7e43ee6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:01.642251 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 594/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:01.648544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc1c0c-cd93-4607-b383-c80b46081919 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:01.735074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:01.772525 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc1c0c-cd93-4607-b383-c80b46081919 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:01.815075 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf687b-01f6-493f-9aea-27488212ed4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:01.815973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf687b-01f6-493f-9aea-27488212ed4b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:01.816254 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf687b-01f6-493f-9aea-27488212ed4b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:01.816541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf687b-01f6-493f-9aea-27488212ed4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:01.823885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf687b-01f6-493f-9aea-27488212ed4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:01.826574 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf687b-01f6-493f-9aea-27488212ed4b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:01.841608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-abaf687b-01f6-493f-9aea-27488212ed4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:01.841608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:01.841608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:01.841608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:01.841608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:01.841608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:01.841608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:01.841608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:01.841608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:01.841608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:01.841608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:01.841608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:01.841608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:01.841608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:01.841608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:01.843758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:01.844815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:01.844815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:01.844815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:01.844815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:01.844815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:01.844815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:01.844815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:01.844815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:20:01.849585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 623/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:01.849767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bedeb3-07be-4286-a746-ce6ff7e43ee6 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:01.957198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bedeb3-07be-4286-a746-ce6ff7e43ee6 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:01.980655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:01.994518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746767a-0f19-4956-883d-738c0e985ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:01.995287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746767a-0f19-4956-883d-738c0e985ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:01.995575 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746767a-0f19-4956-883d-738c0e985ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:01.995882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746767a-0f19-4956-883d-738c0e985ab0 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:01.996765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746767a-0f19-4956-883d-738c0e985ab0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:01.997159 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746767a-0f19-4956-883d-738c0e985ab0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:01.999061 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746767a-0f19-4956-883d-738c0e985ab0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:02.013010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 595/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:02.019272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf687b-01f6-493f-9aea-27488212ed4b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:02.150844 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf687b-01f6-493f-9aea-27488212ed4b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:02.187521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:02.199649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718c165-931f-42bd-ab0c-def40f25225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:02.199649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718c165-931f-42bd-ab0c-def40f25225a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:02.199649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718c165-931f-42bd-ab0c-def40f25225a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:02.199649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718c165-931f-42bd-ab0c-def40f25225a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:02.200143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718c165-931f-42bd-ab0c-def40f25225a None admin] RBAC: Adding query filter params (role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=b1146aa09d30458f9ab3b3bec8f94233) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:02.200143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718c165-931f-42bd-ab0c-def40f25225a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:02.201204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718c165-931f-42bd-ab0c-def40f25225a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:02.208533 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 624/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:02 2022] GET /identity/v3/role_assignments?user.id=b1146aa09d30458f9ab3b3bec8f94233&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:04.377237 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ae7d0-5292-4199-8faa-5cf8989288da None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:04.377795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ae7d0-5292-4199-8faa-5cf8989288da None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:04.377894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ae7d0-5292-4199-8faa-5cf8989288da None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:04.379278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 596/1220] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:20:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:04.385122 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a444c93-508f-405d-9f2b-eb9eb67e676a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:04.385659 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a444c93-508f-405d-9f2b-eb9eb67e676a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:04.385768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a444c93-508f-405d-9f2b-eb9eb67e676a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:04.403959 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6a444c93-508f-405d-9f2b-eb9eb67e676a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:04.405369 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6a444c93-508f-405d-9f2b-eb9eb67e676a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:04.479448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 625/1221] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:04.505723 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ae7d0-5292-4199-8faa-5cf8989288da None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:04.620560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ae7d0-5292-4199-8faa-5cf8989288da None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:04.659246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb15d93-bb36-4511-8e15-a81b2fca0e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:04.660079 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb15d93-bb36-4511-8e15-a81b2fca0e87 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:04.660362 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb15d93-bb36-4511-8e15-a81b2fca0e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:04.660636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb15d93-bb36-4511-8e15-a81b2fca0e87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:04.671501 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb15d93-bb36-4511-8e15-a81b2fca0e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-9cb15d93-bb36-4511-8e15-a81b2fca0e87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:04.679236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:04.680358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:04.681713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:04.681713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:04.681713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:04.681713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:04.681713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:04.681713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:04.681713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:04.681713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:04.681713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:04.681713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:04.681713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:20:04.681713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:04.681713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 597/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:20:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:04.687855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a444c93-508f-405d-9f2b-eb9eb67e676a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:04.792983 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a444c93-508f-405d-9f2b-eb9eb67e676a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:04.820070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:04.832619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a482568-296d-4668-9ca4-c5b58bc2251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:04.833290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a482568-296d-4668-9ca4-c5b58bc2251b None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:04.833573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a482568-296d-4668-9ca4-c5b58bc2251b None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:04.833851 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a482568-296d-4668-9ca4-c5b58bc2251b None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:04.834647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a482568-296d-4668-9ca4-c5b58bc2251b None admin] RBAC: Adding query filter params (name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:04.834965 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a482568-296d-4668-9ca4-c5b58bc2251b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:04.836408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a482568-296d-4668-9ca4-c5b58bc2251b None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:04.844751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 626/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:20:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:04.851202 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb15d93-bb36-4511-8e15-a81b2fca0e87 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:04.906409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:04.971891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb15d93-bb36-4511-8e15-a81b2fca0e87 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.006322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466ac61-520f-4949-ba3a-4bdbd7fe88f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.007244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466ac61-520f-4949-ba3a-4bdbd7fe88f5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.007562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466ac61-520f-4949-ba3a-4bdbd7fe88f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.007937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466ac61-520f-4949-ba3a-4bdbd7fe88f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.019506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466ac61-520f-4949-ba3a-4bdbd7fe88f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.021010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466ac61-520f-4949-ba3a-4bdbd7fe88f5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.038445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-7466ac61-520f-4949-ba3a-4bdbd7fe88f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:05.038445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:05.038445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:05.038445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:05.038445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:05.038445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:05.038445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:05.038445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:05.038445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:05.038445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:05.038445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:05.038445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:05.038445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:05.038445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:05.038445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:05.039532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:05.040512 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:05.040512 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:05.040512 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:05.040512 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:05.040512 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 598/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:05.048091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a482568-296d-4668-9ca4-c5b58bc2251b None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:05.160762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a482568-296d-4668-9ca4-c5b58bc2251b None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.210276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca98ae-5024-4f58-ad94-4a7e514673b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.211261 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca98ae-5024-4f58-ad94-4a7e514673b6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.211590 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca98ae-5024-4f58-ad94-4a7e514673b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.211900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca98ae-5024-4f58-ad94-4a7e514673b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.212626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca98ae-5024-4f58-ad94-4a7e514673b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:05.212935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca98ae-5024-4f58-ad94-4a7e514673b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.214352 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca98ae-5024-4f58-ad94-4a7e514673b6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.230790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 627/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:05.237529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466ac61-520f-4949-ba3a-4bdbd7fe88f5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:05.343774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:05.351379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466ac61-520f-4949-ba3a-4bdbd7fe88f5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.388249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f50a1-6c54-4805-859c-0e4c299ab7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.389440 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f50a1-6c54-4805-859c-0e4c299ab7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.389729 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f50a1-6c54-4805-859c-0e4c299ab7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.390010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f50a1-6c54-4805-859c-0e4c299ab7a6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.398745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f50a1-6c54-4805-859c-0e4c299ab7a6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.400281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f50a1-6c54-4805-859c-0e4c299ab7a6 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-8f3f50a1-6c54-4805-859c-0e4c299ab7a6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:05.415701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:05.416960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:05.418322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:05.418322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:05.418322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:05.418322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:05.418322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:05.418322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:05.418322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:05.418322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:05.418322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:20:05.418322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:05.418322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 599/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:05.423297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca98ae-5024-4f58-ad94-4a7e514673b6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:05.477339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:05.540486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca98ae-5024-4f58-ad94-4a7e514673b6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.582897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a3a8b-1732-4448-8279-d9184aaf655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.583640 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3a8b-1732-4448-8279-d9184aaf655d None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.583929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3a8b-1732-4448-8279-d9184aaf655d None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.584206 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3a8b-1732-4448-8279-d9184aaf655d None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.585087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a3a8b-1732-4448-8279-d9184aaf655d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:05.585403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a3a8b-1732-4448-8279-d9184aaf655d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.586898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a3a8b-1732-4448-8279-d9184aaf655d None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.605962 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 628/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:05.613997 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f50a1-6c54-4805-859c-0e4c299ab7a6 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:05.723226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f50a1-6c54-4805-859c-0e4c299ab7a6 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.759509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6c7a2-3e8c-4c3c-9beb-3ffbf33f563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.760366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6c7a2-3e8c-4c3c-9beb-3ffbf33f563c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.760658 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6c7a2-3e8c-4c3c-9beb-3ffbf33f563c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.760939 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6c7a2-3e8c-4c3c-9beb-3ffbf33f563c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.774051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6c7a2-3e8c-4c3c-9beb-3ffbf33f563c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.775815 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6c7a2-3e8c-4c3c-9beb-3ffbf33f563c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.795046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-04d6c7a2-3e8c-4c3c-9beb-3ffbf33f563c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:05.795046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:05.795046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:05.795046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:05.795046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:05.795046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:05.795046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:05.795046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:05.795046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:05.795046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:05.795046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:05.795046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:05.795046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:05.795046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:05.795046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:05.796200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:05.797255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:05.797255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:05.797255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:05.797255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:05.797255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 600/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:05.802580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a3a8b-1732-4448-8279-d9184aaf655d None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:05.931168 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a3a8b-1732-4448-8279-d9184aaf655d None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.934041 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:05.969793 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f8fd9-9e9b-4fa7-bda6-20d1df7b0954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.970464 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f8fd9-9e9b-4fa7-bda6-20d1df7b0954 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.970742 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f8fd9-9e9b-4fa7-bda6-20d1df7b0954 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.971014 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f8fd9-9e9b-4fa7-bda6-20d1df7b0954 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.971797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f8fd9-9e9b-4fa7-bda6-20d1df7b0954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:05.972098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f8fd9-9e9b-4fa7-bda6-20d1df7b0954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.973482 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f8fd9-9e9b-4fa7-bda6-20d1df7b0954 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.986271 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 629/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:05.992354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6c7a2-3e8c-4c3c-9beb-3ffbf33f563c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:06.003315 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:06.104760 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6c7a2-3e8c-4c3c-9beb-3ffbf33f563c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:06.146876 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc402f-cef7-41fa-b250-663a474884a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:06.147741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc402f-cef7-41fa-b250-663a474884a1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.148027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc402f-cef7-41fa-b250-663a474884a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.148298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc402f-cef7-41fa-b250-663a474884a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.156643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc402f-cef7-41fa-b250-663a474884a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:06.158310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc402f-cef7-41fa-b250-663a474884a1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:06.175905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-7afc402f-cef7-41fa-b250-663a474884a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:06.175905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:06.175905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:06.175905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:06.175905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:06.175905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:06.175905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:06.175905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:06.175905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:06.175905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:06.175905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:06.175905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:06.175905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:06.175905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:06.175905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:06.177430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:06.178610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:06.178610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:06.178610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:06.178610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:06.178610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:06.178610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:06.178610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:06.178610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:06.178610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 601/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:06.185460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f8fd9-9e9b-4fa7-bda6-20d1df7b0954 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:06.305399 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f8fd9-9e9b-4fa7-bda6-20d1df7b0954 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:06.342795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c3e9f-2156-4dbb-ab14-a2f61935fe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:06.343465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c3e9f-2156-4dbb-ab14-a2f61935fe26 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.343767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c3e9f-2156-4dbb-ab14-a2f61935fe26 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.344047 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c3e9f-2156-4dbb-ab14-a2f61935fe26 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.344837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c3e9f-2156-4dbb-ab14-a2f61935fe26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:06.345147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c3e9f-2156-4dbb-ab14-a2f61935fe26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:06.346577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c3e9f-2156-4dbb-ab14-a2f61935fe26 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:06.359151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 630/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:06.365162 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc402f-cef7-41fa-b250-663a474884a1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:06.435683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:06.472682 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc402f-cef7-41fa-b250-663a474884a1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:06.510433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76456e0d-04ad-454a-8f55-5aa966085787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:06.511343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76456e0d-04ad-454a-8f55-5aa966085787 None admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.511644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76456e0d-04ad-454a-8f55-5aa966085787 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.511927 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76456e0d-04ad-454a-8f55-5aa966085787 None admin] PATH_INFO: `/v3/projects/784795960efb40e5811f778fff6fceb1/users/b1146aa09d30458f9ab3b3bec8f94233/roles/d6d1bb4d1d4d43f6985c2b90e85ca6a6` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.527913 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76456e0d-04ad-454a-8f55-5aa966085787 None admin] RBAC: Authorizing `identity:create_grant(project_id=784795960efb40e5811f778fff6fceb1, user_id=b1146aa09d30458f9ab3b3bec8f94233, role_id=d6d1bb4d1d4d43f6985c2b90e85ca6a6)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:06.529628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76456e0d-04ad-454a-8f55-5aa966085787 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:06.543459 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 602/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:20:06 2022] PUT /identity/v3/projects/784795960efb40e5811f778fff6fceb1/users/b1146aa09d30458f9ab3b3bec8f94233/roles/d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:20:08.600670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2e8c4-d763-4fd3-9abd-2309aca67be0 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:08.601235 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2e8c4-d763-4fd3-9abd-2309aca67be0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:08.601235 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2e8c4-d763-4fd3-9abd-2309aca67be0 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:08.602694 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 631/1233] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:08.609355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c4802-b131-4756-9ff4-00fb1cdd84f0 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:08.609818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c4802-b131-4756-9ff4-00fb1cdd84f0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:08.609954 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c4802-b131-4756-9ff4-00fb1cdd84f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:08.627779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-777c4802-b131-4756-9ff4-00fb1cdd84f0 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:08.628987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-777c4802-b131-4756-9ff4-00fb1cdd84f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:08.707741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 603/1234] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:08.732859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2e8c4-d763-4fd3-9abd-2309aca67be0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:08.765078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:08.859772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2e8c4-d763-4fd3-9abd-2309aca67be0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:08.900005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b4e42-eed9-4015-9cbe-2831df31b9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:08.900820 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b4e42-eed9-4015-9cbe-2831df31b9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:08.901107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b4e42-eed9-4015-9cbe-2831df31b9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:08.901389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b4e42-eed9-4015-9cbe-2831df31b9f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:08.911657 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b4e42-eed9-4015-9cbe-2831df31b9f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-607b4e42-eed9-4015-9cbe-2831df31b9f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:08.919730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:08.921028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:08.921894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:08.921894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:08.921894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:08.921894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:08.921894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:08.921894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:08.921894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:08.921894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:08.921894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:08.921894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:08.921894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:20:08.921894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:20:08.921894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 632/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 08:20:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:08.928677 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c4802-b131-4756-9ff4-00fb1cdd84f0 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:08.978298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:09.040254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c4802-b131-4756-9ff4-00fb1cdd84f0 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:09.077274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4199466-3fe5-4ea6-82a3-8b1309b6fc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.077952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4199466-3fe5-4ea6-82a3-8b1309b6fc8e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.078236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4199466-3fe5-4ea6-82a3-8b1309b6fc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.078513 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4199466-3fe5-4ea6-82a3-8b1309b6fc8e None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.079267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4199466-3fe5-4ea6-82a3-8b1309b6fc8e None admin] RBAC: Adding query filter params (name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:09.079573 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4199466-3fe5-4ea6-82a3-8b1309b6fc8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:09.080987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4199466-3fe5-4ea6-82a3-8b1309b6fc8e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:09.089881 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 604/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 08:20:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:09.096398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b4e42-eed9-4015-9cbe-2831df31b9f1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:09.190717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:09.210839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b4e42-eed9-4015-9cbe-2831df31b9f1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:09.251498 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32d27c-1716-4b98-8c66-009a70962924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.252324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32d27c-1716-4b98-8c66-009a70962924 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.252576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32d27c-1716-4b98-8c66-009a70962924 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.252962 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32d27c-1716-4b98-8c66-009a70962924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.264257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32d27c-1716-4b98-8c66-009a70962924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:09.265897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32d27c-1716-4b98-8c66-009a70962924 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:09.286692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4c32d27c-1716-4b98-8c66-009a70962924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:09.286692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:09.286692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:09.286692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:09.286692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:09.286692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:09.286692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:09.286692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:09.286692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:09.286692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:09.286692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:09.286692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:09.286692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:09.286692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:09.286692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:09.287847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:09.288746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:09.288746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:09.288746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:09.288746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:20:09.288746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 633/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:09.296375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4199466-3fe5-4ea6-82a3-8b1309b6fc8e None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:09.416558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4199466-3fe5-4ea6-82a3-8b1309b6fc8e None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:09.426902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:09.455168 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00ccff-abc7-4a80-9dc3-8ec706c70869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.455939 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00ccff-abc7-4a80-9dc3-8ec706c70869 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.456229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00ccff-abc7-4a80-9dc3-8ec706c70869 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.456510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00ccff-abc7-4a80-9dc3-8ec706c70869 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.457252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00ccff-abc7-4a80-9dc3-8ec706c70869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:09.457571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00ccff-abc7-4a80-9dc3-8ec706c70869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:09.458984 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00ccff-abc7-4a80-9dc3-8ec706c70869 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:09.471618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 605/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:09.477451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32d27c-1716-4b98-8c66-009a70962924 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:09.583229 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32d27c-1716-4b98-8c66-009a70962924 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:09.619704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed9f4d-5cd3-47e3-b361-c04564e582a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.620521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed9f4d-5cd3-47e3-b361-c04564e582a7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.620799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed9f4d-5cd3-47e3-b361-c04564e582a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.621069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed9f4d-5cd3-47e3-b361-c04564e582a7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.624355 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:09.630434 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed9f4d-5cd3-47e3-b361-c04564e582a7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:09.632432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed9f4d-5cd3-47e3-b361-c04564e582a7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a1ed9f4d-5cd3-47e3-b361-c04564e582a7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:09.648585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:09.649733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:09.650677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:09.650677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:09.650677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:09.650677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:09.650677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:09.650677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:09.650677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:09.650677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:09.650677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:20:09.650677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:20:09.650677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 634/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:09.656469 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00ccff-abc7-4a80-9dc3-8ec706c70869 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:09.767624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00ccff-abc7-4a80-9dc3-8ec706c70869 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:09.805553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4c8c6-1344-44c8-9fc9-611ee6a5995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.806234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4c8c6-1344-44c8-9fc9-611ee6a5995a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.806513 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4c8c6-1344-44c8-9fc9-611ee6a5995a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.806786 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4c8c6-1344-44c8-9fc9-611ee6a5995a None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.807681 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4c8c6-1344-44c8-9fc9-611ee6a5995a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:09.807992 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4c8c6-1344-44c8-9fc9-611ee6a5995a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:09.809672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4c8c6-1344-44c8-9fc9-611ee6a5995a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:09.829777 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 606/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:09.835800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed9f4d-5cd3-47e3-b361-c04564e582a7 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:09.948897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed9f4d-5cd3-47e3-b361-c04564e582a7 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:09.985432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4bdc1-0cab-4b78-972d-885f4db1152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.986113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4bdc1-0cab-4b78-972d-885f4db1152e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.986441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4bdc1-0cab-4b78-972d-885f4db1152e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.986718 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4bdc1-0cab-4b78-972d-885f4db1152e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:10.056440 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:10.068012 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4bdc1-0cab-4b78-972d-885f4db1152e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:10.070861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4bdc1-0cab-4b78-972d-885f4db1152e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:10.201388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 635/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:20:10.204245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4c8c6-1344-44c8-9fc9-611ee6a5995a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:10.238197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:10.323520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4c8c6-1344-44c8-9fc9-611ee6a5995a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:10.360731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8403d5-b558-4b09-b561-d599400a3968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:10.361768 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8403d5-b558-4b09-b561-d599400a3968 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:10.361970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8403d5-b558-4b09-b561-d599400a3968 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:10.362306 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8403d5-b558-4b09-b561-d599400a3968 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:10.376622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8403d5-b558-4b09-b561-d599400a3968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:10.376622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8403d5-b558-4b09-b561-d599400a3968 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:10.394405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ca8403d5-b558-4b09-b561-d599400a3968 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:10.394405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:10.394405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:10.394405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:10.394405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:10.394405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:10.394405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:10.394405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:10.394405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:10.394405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:10.394405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:10.394405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:10.394405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:10.394405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:10.394405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:10.395686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:10.396780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:10.396780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:10.396780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:10.396780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:10.396780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 607/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:10.401969 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4bdc1-0cab-4b78-972d-885f4db1152e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:10.506562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:10.512851 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4bdc1-0cab-4b78-972d-885f4db1152e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:10.550921 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50536b-56ad-401a-aa84-ec10e671969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:10.551692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50536b-56ad-401a-aa84-ec10e671969f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:10.551999 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50536b-56ad-401a-aa84-ec10e671969f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:10.552276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50536b-56ad-401a-aa84-ec10e671969f None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:10.553040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50536b-56ad-401a-aa84-ec10e671969f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:10.553382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50536b-56ad-401a-aa84-ec10e671969f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:10.554932 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50536b-56ad-401a-aa84-ec10e671969f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:10.567374 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 636/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:10.573351 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8403d5-b558-4b09-b561-d599400a3968 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:10.661271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:10.686319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8403d5-b558-4b09-b561-d599400a3968 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:10.724240 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e57ef-9168-40c7-9230-e2b014edb2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:10.725049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e57ef-9168-40c7-9230-e2b014edb2dc None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:10.725326 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e57ef-9168-40c7-9230-e2b014edb2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:10.725599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e57ef-9168-40c7-9230-e2b014edb2dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:10.732794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e57ef-9168-40c7-9230-e2b014edb2dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:10.734298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e57ef-9168-40c7-9230-e2b014edb2dc None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:10.748889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-2f6e57ef-9168-40c7-9230-e2b014edb2dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:10.748889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:10.748889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:10.748889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:10.748889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:10.748889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:10.748889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:10.748889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:10.748889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:10.748889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:10.748889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:10.748889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:10.748889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:10.748889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:10.748889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:10.750007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:10.750929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:10.750929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:10.750929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:10.750929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:10.750929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:10.750929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:10.750929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:10.750929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:10.750929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 608/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:10.756621 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50536b-56ad-401a-aa84-ec10e671969f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:10.878693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50536b-56ad-401a-aa84-ec10e671969f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:10.925196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb871c4-42d9-4cb3-a386-14de9c5887a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:10.926467 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb871c4-42d9-4cb3-a386-14de9c5887a9 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:10.926914 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb871c4-42d9-4cb3-a386-14de9c5887a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:10.927185 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb871c4-42d9-4cb3-a386-14de9c5887a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:10.928174 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb871c4-42d9-4cb3-a386-14de9c5887a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:10.928508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb871c4-42d9-4cb3-a386-14de9c5887a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:10.930062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb871c4-42d9-4cb3-a386-14de9c5887a9 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:10.943016 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 637/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:10.949016 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e57ef-9168-40c7-9230-e2b014edb2dc None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:11.057871 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e57ef-9168-40c7-9230-e2b014edb2dc None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:11.101528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910db32-0932-43c3-8e68-b863270be4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:11.102257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910db32-0932-43c3-8e68-b863270be4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:11.102542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910db32-0932-43c3-8e68-b863270be4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:11.102925 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910db32-0932-43c3-8e68-b863270be4b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:11.103838 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910db32-0932-43c3-8e68-b863270be4b1 None admin] RBAC: Adding query filter params (role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=b1146aa09d30458f9ab3b3bec8f94233) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:11.104174 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910db32-0932-43c3-8e68-b863270be4b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:11.105622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910db32-0932-43c3-8e68-b863270be4b1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:11.112242 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 609/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:10 2022] GET /identity/v3/role_assignments?user.id=b1146aa09d30458f9ab3b3bec8f94233&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=d6d1bb4d1d4d43f6985c2b90e85ca6a6 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:13.424711 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a9f9e-7d70-44a5-841f-b1d33d8d83ee None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:13.425248 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a9f9e-7d70-44a5-841f-b1d33d8d83ee None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:13.425248 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a9f9e-7d70-44a5-841f-b1d33d8d83ee None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:13.426645 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 638/1247] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:13.432886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c24db-3ad3-4bff-a577-74fae750a9b1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:13.433353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c24db-3ad3-4bff-a577-74fae750a9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:13.433545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c24db-3ad3-4bff-a577-74fae750a9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:13.439078 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:13.455582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6f5c24db-3ad3-4bff-a577-74fae750a9b1 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:13.456922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6f5c24db-3ad3-4bff-a577-74fae750a9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:13.533345 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 610/1248] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:13.557720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a9f9e-7d70-44a5-841f-b1d33d8d83ee None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:13.579808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:13.675427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a9f9e-7d70-44a5-841f-b1d33d8d83ee None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:13.713249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b74578-cb4d-437f-8780-9d1a083526a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:13.714249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b74578-cb4d-437f-8780-9d1a083526a1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:13.714546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b74578-cb4d-437f-8780-9d1a083526a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:13.714926 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b74578-cb4d-437f-8780-9d1a083526a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:13.730361 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b74578-cb4d-437f-8780-9d1a083526a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-10b74578-cb4d-437f-8780-9d1a083526a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:13.739385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:13.740637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:13.741749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:13.741749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:13.741749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:13.741749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:13.741749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:13.741749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:13.741749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:13.741749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:13.741749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:13.741749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:13.741749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:13.741749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:20:13.741749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 639/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:20:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:13.747163 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c24db-3ad3-4bff-a577-74fae750a9b1 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:13.869873 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c24db-3ad3-4bff-a577-74fae750a9b1 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:13.908461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:13.914764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c56e-06e1-40c4-8177-a256d514340a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:13.915520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c56e-06e1-40c4-8177-a256d514340a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:13.915900 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c56e-06e1-40c4-8177-a256d514340a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:13.916182 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c56e-06e1-40c4-8177-a256d514340a None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:13.917171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6c56e-06e1-40c4-8177-a256d514340a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:13.917560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6c56e-06e1-40c4-8177-a256d514340a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:13.919140 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6c56e-06e1-40c4-8177-a256d514340a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:13.929886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 611/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:20:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:13.936961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b74578-cb4d-437f-8780-9d1a083526a1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:14.031715 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:14.057927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b74578-cb4d-437f-8780-9d1a083526a1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:14.097407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333864a-0b7a-4820-9ecd-f7953229d8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:14.098335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333864a-0b7a-4820-9ecd-f7953229d8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.098619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333864a-0b7a-4820-9ecd-f7953229d8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.098889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333864a-0b7a-4820-9ecd-f7953229d8f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.110600 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333864a-0b7a-4820-9ecd-f7953229d8f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:14.112216 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333864a-0b7a-4820-9ecd-f7953229d8f0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:14.130608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-a333864a-0b7a-4820-9ecd-f7953229d8f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:14.130608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:14.130608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:14.130608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:14.130608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:14.130608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:14.130608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:14.130608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:14.130608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:14.130608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:14.130608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:14.130608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:14.130608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:14.130608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:14.130608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:14.131623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:14.137996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:14.137996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:14.137996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:14.137996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:20:14.137996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 640/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:14.138396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c56e-06e1-40c4-8177-a256d514340a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:14.268219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c56e-06e1-40c4-8177-a256d514340a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:14.311302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2fccd-f166-4cee-8cd3-88468912f3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:14.312136 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2fccd-f166-4cee-8cd3-88468912f3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.312432 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2fccd-f166-4cee-8cd3-88468912f3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.312712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2fccd-f166-4cee-8cd3-88468912f3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.313579 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2fccd-f166-4cee-8cd3-88468912f3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:14.313892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2fccd-f166-4cee-8cd3-88468912f3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:14.315438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2fccd-f166-4cee-8cd3-88468912f3c3 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:14.329024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 612/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:14.335212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333864a-0b7a-4820-9ecd-f7953229d8f0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:14.455449 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333864a-0b7a-4820-9ecd-f7953229d8f0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:14.485249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:14.495125 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7e6c2-93b1-4920-af88-744f2544e39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:14.496068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7e6c2-93b1-4920-af88-744f2544e39f None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.496350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7e6c2-93b1-4920-af88-744f2544e39f None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.496671 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7e6c2-93b1-4920-af88-744f2544e39f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.506261 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7e6c2-93b1-4920-af88-744f2544e39f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:14.507811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7e6c2-93b1-4920-af88-744f2544e39f None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-74a7e6c2-93b1-4920-af88-744f2544e39f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:14.524038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:14.525083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:14.526059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:14.526059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:14.526059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:14.526059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:14.526059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:14.526059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:14.526059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:14.526059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:14.526059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:20:14.526059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:20:14.526059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 641/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:14.531646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2fccd-f166-4cee-8cd3-88468912f3c3 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:14.597010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:14.649604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2fccd-f166-4cee-8cd3-88468912f3c3 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:14.688728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc519921-436f-48b4-aa38-4e8ac9f1d91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:14.689444 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc519921-436f-48b4-aa38-4e8ac9f1d91c None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.689775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc519921-436f-48b4-aa38-4e8ac9f1d91c None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.690104 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc519921-436f-48b4-aa38-4e8ac9f1d91c None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.690961 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc519921-436f-48b4-aa38-4e8ac9f1d91c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:14.691267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc519921-436f-48b4-aa38-4e8ac9f1d91c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:14.692757 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc519921-436f-48b4-aa38-4e8ac9f1d91c None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:14.712340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 613/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 21 08:20:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:14.718339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7e6c2-93b1-4920-af88-744f2544e39f None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:14.852171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7e6c2-93b1-4920-af88-744f2544e39f None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:14.889059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d785ef7-0ed1-41c6-b2e1-00c2a4b25af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:14.889717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d785ef7-0ed1-41c6-b2e1-00c2a4b25af8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.889999 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d785ef7-0ed1-41c6-b2e1-00c2a4b25af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.890273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d785ef7-0ed1-41c6-b2e1-00c2a4b25af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.950444 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:14.965436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d785ef7-0ed1-41c6-b2e1-00c2a4b25af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:14.967288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d785ef7-0ed1-41c6-b2e1-00c2a4b25af8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.078825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 642/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 08:20:15.085231 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc519921-436f-48b4-aa38-4e8ac9f1d91c None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:15.197458 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc519921-436f-48b4-aa38-4e8ac9f1d91c None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.216290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:15.244384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde3f7d-426e-483b-9a30-fae302cb6d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.245336 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde3f7d-426e-483b-9a30-fae302cb6d4b None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.247793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde3f7d-426e-483b-9a30-fae302cb6d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.248167 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde3f7d-426e-483b-9a30-fae302cb6d4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.262991 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde3f7d-426e-483b-9a30-fae302cb6d4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.264552 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde3f7d-426e-483b-9a30-fae302cb6d4b None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.285488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ebde3f7d-426e-483b-9a30-fae302cb6d4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:15.285488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:15.285488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:15.285488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:15.285488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:15.285488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:15.285488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:15.285488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:15.285488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:15.285488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:15.285488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:15.285488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:15.285488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:15.285488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:15.285488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:15.286719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:15.287965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:15.287965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:15.287965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:15.287965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:15.287965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 614/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:15.293445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d785ef7-0ed1-41c6-b2e1-00c2a4b25af8 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:15.400862 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:15.415012 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d785ef7-0ed1-41c6-b2e1-00c2a4b25af8 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.454126 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c945d6-5c2c-4df6-bdfa-5f63c61ad6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.454914 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c945d6-5c2c-4df6-bdfa-5f63c61ad6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.455240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c945d6-5c2c-4df6-bdfa-5f63c61ad6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.455558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c945d6-5c2c-4df6-bdfa-5f63c61ad6e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.456356 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c945d6-5c2c-4df6-bdfa-5f63c61ad6e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:15.456718 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c945d6-5c2c-4df6-bdfa-5f63c61ad6e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.458246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c945d6-5c2c-4df6-bdfa-5f63c61ad6e1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.470558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 643/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:15.476831 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde3f7d-426e-483b-9a30-fae302cb6d4b None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:15.591958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde3f7d-426e-483b-9a30-fae302cb6d4b None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.632720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e27f5-2f61-472f-9fa4-230234026967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.633655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e27f5-2f61-472f-9fa4-230234026967 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.633995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e27f5-2f61-472f-9fa4-230234026967 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.634370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e27f5-2f61-472f-9fa4-230234026967 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.642430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e27f5-2f61-472f-9fa4-230234026967 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.644246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e27f5-2f61-472f-9fa4-230234026967 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.660004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-996e27f5-2f61-472f-9fa4-230234026967 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:15.660004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:15.660004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:15.660004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:15.660004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:15.660004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:15.660004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:15.660004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:15.660004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:15.660004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:15.660004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:15.660004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:15.660004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:15.660004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:15.660004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:15.661099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:15.662289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:15.662289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:15.662289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:15.662289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:15.662289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:15.662289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:15.662289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:15.662289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:15.662289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 615/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:15.667776 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c945d6-5c2c-4df6-bdfa-5f63c61ad6e1 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:15.772213 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c945d6-5c2c-4df6-bdfa-5f63c61ad6e1 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.817580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a00c65-4318-4355-b67b-ea0b9791c8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.818274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a00c65-4318-4355-b67b-ea0b9791c8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.818552 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a00c65-4318-4355-b67b-ea0b9791c8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.818828 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a00c65-4318-4355-b67b-ea0b9791c8f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.819742 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a00c65-4318-4355-b67b-ea0b9791c8f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:15.820055 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a00c65-4318-4355-b67b-ea0b9791c8f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.821562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a00c65-4318-4355-b67b-ea0b9791c8f7 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.845383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 644/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:15.846720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e27f5-2f61-472f-9fa4-230234026967 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:15.876895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:15.959336 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e27f5-2f61-472f-9fa4-230234026967 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.993674 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262312b1-3ec5-4996-a82e-926b9272236e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.994337 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262312b1-3ec5-4996-a82e-926b9272236e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.994636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262312b1-3ec5-4996-a82e-926b9272236e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.994896 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262312b1-3ec5-4996-a82e-926b9272236e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.995772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262312b1-3ec5-4996-a82e-926b9272236e None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=b1146aa09d30458f9ab3b3bec8f94233) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:15.996085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262312b1-3ec5-4996-a82e-926b9272236e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.997657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262312b1-3ec5-4996-a82e-926b9272236e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:16.003963 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 616/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:15 2022] GET /identity/v3/role_assignments?user.id=b1146aa09d30458f9ab3b3bec8f94233&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:18.061618 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff8367-ad01-4fb5-a23e-9ff94373b537 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.062236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff8367-ad01-4fb5-a23e-9ff94373b537 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.062236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff8367-ad01-4fb5-a23e-9ff94373b537 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.063581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 645/1261] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:20:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:18.069994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a475f-c24e-4400-92e3-76eebb20e4a7 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.070765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a475f-c24e-4400-92e3-76eebb20e4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.070915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a475f-c24e-4400-92e3-76eebb20e4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.092967 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f93a475f-c24e-4400-92e3-76eebb20e4a7 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:18.094165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f93a475f-c24e-4400-92e3-76eebb20e4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:18.169864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 617/1262] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:18.193155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff8367-ad01-4fb5-a23e-9ff94373b537 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:18.206038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:18.305692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff8367-ad01-4fb5-a23e-9ff94373b537 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:18.342030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d6c48-0438-458e-9837-35b34a428716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:18.342668 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d6c48-0438-458e-9837-35b34a428716 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.342958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d6c48-0438-458e-9837-35b34a428716 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.343226 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d6c48-0438-458e-9837-35b34a428716 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.354438 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d6c48-0438-458e-9837-35b34a428716 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-576d6c48-0438-458e-9837-35b34a428716 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:18.362493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:18.363569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:18.364555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:18.364555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:18.364555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:18.364555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:18.364555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:18.364555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:18.364555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:18.364555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:18.364555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:18.364555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:18.364555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:18.364555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:20:18.364555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 646/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:20:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:18.370203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a475f-c24e-4400-92e3-76eebb20e4a7 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:18.391633 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:18.477381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a475f-c24e-4400-92e3-76eebb20e4a7 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:18.519301 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04428ad1-08da-4036-8679-bfeec60bd94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:18.520397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04428ad1-08da-4036-8679-bfeec60bd94f None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.520859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04428ad1-08da-4036-8679-bfeec60bd94f None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.521301 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04428ad1-08da-4036-8679-bfeec60bd94f None admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.522532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04428ad1-08da-4036-8679-bfeec60bd94f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:18.523029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04428ad1-08da-4036-8679-bfeec60bd94f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:18.525288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04428ad1-08da-4036-8679-bfeec60bd94f None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:18.535465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 618/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:20:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:18.541652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d6c48-0438-458e-9837-35b34a428716 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:18.610410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:18.656908 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d6c48-0438-458e-9837-35b34a428716 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:18.698565 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4761e6-7143-4abc-9d0d-c423a87278ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:18.699362 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4761e6-7143-4abc-9d0d-c423a87278ab None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.699649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4761e6-7143-4abc-9d0d-c423a87278ab None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.699960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4761e6-7143-4abc-9d0d-c423a87278ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.712148 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4761e6-7143-4abc-9d0d-c423a87278ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:18.714438 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4761e6-7143-4abc-9d0d-c423a87278ab None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:18.733819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-be4761e6-7143-4abc-9d0d-c423a87278ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:18.733819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:18.733819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:18.733819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:18.733819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:18.733819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:18.733819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:18.733819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:18.733819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:18.733819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:18.733819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:18.733819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:18.733819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:18.733819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:18.733819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:18.734872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:18.741430 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:18.741430 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:18.741430 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:18.741430 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:20:18.741430 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 647/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:18.742270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04428ad1-08da-4036-8679-bfeec60bd94f None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:18.836457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:18.855736 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04428ad1-08da-4036-8679-bfeec60bd94f None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:18.889466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fef45-7e26-4edd-a9a4-a9f772dcf010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:18.890041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fef45-7e26-4edd-a9a4-a9f772dcf010 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.890322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fef45-7e26-4edd-a9a4-a9f772dcf010 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.890582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fef45-7e26-4edd-a9a4-a9f772dcf010 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.891308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fef45-7e26-4edd-a9a4-a9f772dcf010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:18.891633 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fef45-7e26-4edd-a9a4-a9f772dcf010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:18.893044 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fef45-7e26-4edd-a9a4-a9f772dcf010 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:18.904782 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 619/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:18.911426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4761e6-7143-4abc-9d0d-c423a87278ab None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:19.019981 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4761e6-7143-4abc-9d0d-c423a87278ab None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:19.039908 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:19.061823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38e0b1-e2a0-4ee3-acfd-325fde924607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:19.062622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38e0b1-e2a0-4ee3-acfd-325fde924607 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.062907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38e0b1-e2a0-4ee3-acfd-325fde924607 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.063179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38e0b1-e2a0-4ee3-acfd-325fde924607 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.071089 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38e0b1-e2a0-4ee3-acfd-325fde924607 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:19.072584 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38e0b1-e2a0-4ee3-acfd-325fde924607 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-4b38e0b1-e2a0-4ee3-acfd-325fde924607 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:19.087641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:19.088757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:19.089761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:19.089761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:19.089761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:19.089761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:19.089761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:19.089761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:19.089761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:19.089761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:19.089761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:20:19.089761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:20:19.089761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 648/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:19.097222 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fef45-7e26-4edd-a9a4-a9f772dcf010 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:19.214615 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fef45-7e26-4edd-a9a4-a9f772dcf010 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:19.250137 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648af610-caf9-405e-b9aa-cc6645d5bfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:19.250798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648af610-caf9-405e-b9aa-cc6645d5bfae None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.251077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648af610-caf9-405e-b9aa-cc6645d5bfae None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.251357 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648af610-caf9-405e-b9aa-cc6645d5bfae None admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.252240 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648af610-caf9-405e-b9aa-cc6645d5bfae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:19.252554 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648af610-caf9-405e-b9aa-cc6645d5bfae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:19.254005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648af610-caf9-405e-b9aa-cc6645d5bfae None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:19.262706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:19.277133 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 620/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 21 08:20:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:19.283591 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38e0b1-e2a0-4ee3-acfd-325fde924607 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:19.388886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38e0b1-e2a0-4ee3-acfd-325fde924607 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:19.426052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1c0fa-3d28-47c3-b1d9-158dd7733cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:19.426845 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1c0fa-3d28-47c3-b1d9-158dd7733cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.427130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1c0fa-3d28-47c3-b1d9-158dd7733cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.427404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1c0fa-3d28-47c3-b1d9-158dd7733cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.438949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1c0fa-3d28-47c3-b1d9-158dd7733cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:19.440133 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1c0fa-3d28-47c3-b1d9-158dd7733cb5 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:19.458210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-d2f1c0fa-3d28-47c3-b1d9-158dd7733cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:19.458210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:19.458210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:19.458210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:19.458210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:19.458210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:19.458210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:19.458210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:19.458210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:19.458210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:19.458210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:19.458210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:19.458210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:19.458210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:19.458210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:19.459222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:19.460398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:19.460398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:19.460398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:19.460398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:20:19.460398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 649/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:19.465398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648af610-caf9-405e-b9aa-cc6645d5bfae None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:19.585691 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648af610-caf9-405e-b9aa-cc6645d5bfae None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:19.631523 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8bb7f-b2b1-4460-95b1-b6d525f67fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:19.632225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8bb7f-b2b1-4460-95b1-b6d525f67fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.632511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8bb7f-b2b1-4460-95b1-b6d525f67fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.632786 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8bb7f-b2b1-4460-95b1-b6d525f67fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.633520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8bb7f-b2b1-4460-95b1-b6d525f67fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:19.633830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8bb7f-b2b1-4460-95b1-b6d525f67fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:19.635219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8bb7f-b2b1-4460-95b1-b6d525f67fc2 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:19.647270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 621/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:19.653711 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1c0fa-3d28-47c3-b1d9-158dd7733cb5 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:19.693410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:19.764979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1c0fa-3d28-47c3-b1d9-158dd7733cb5 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:19.800522 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3fbc1-ea3b-4599-a389-f27e274f408e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:19.801324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3fbc1-ea3b-4599-a389-f27e274f408e None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.801605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3fbc1-ea3b-4599-a389-f27e274f408e None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.801880 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3fbc1-ea3b-4599-a389-f27e274f408e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.808626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3fbc1-ea3b-4599-a389-f27e274f408e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:19.810242 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3fbc1-ea3b-4599-a389-f27e274f408e None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:19.825217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-f1c3fbc1-ea3b-4599-a389-f27e274f408e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:19.825217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:19.825217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:19.825217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:19.825217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:19.825217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:19.825217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:19.825217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:19.825217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:19.825217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:19.825217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:19.825217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:19.825217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:19.825217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:19.825217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:19.826632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:19.827818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:19.827818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:19.827818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:19.827818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:19.827818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:19.827818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:19.827818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:19.827818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:20:19.827818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 650/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:19.832692 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8bb7f-b2b1-4460-95b1-b6d525f67fc2 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:19.898895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:19.941646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8bb7f-b2b1-4460-95b1-b6d525f67fc2 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:19.985280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453132e-d6db-4195-8581-7c9ba7026f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:19.986237 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453132e-d6db-4195-8581-7c9ba7026f8e None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.986655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453132e-d6db-4195-8581-7c9ba7026f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.987080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453132e-d6db-4195-8581-7c9ba7026f8e None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.988401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453132e-d6db-4195-8581-7c9ba7026f8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:19.988888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453132e-d6db-4195-8581-7c9ba7026f8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:19.991173 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453132e-d6db-4195-8581-7c9ba7026f8e None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:20.006265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 622/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:20.012595 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3fbc1-ea3b-4599-a389-f27e274f408e None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:20.116009 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:20.130081 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3fbc1-ea3b-4599-a389-f27e274f408e None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:20.178938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082684b3-95a1-4ec6-88e2-032a908da297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:20.179883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082684b3-95a1-4ec6-88e2-032a908da297 None admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:20.180199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082684b3-95a1-4ec6-88e2-032a908da297 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:20.180508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082684b3-95a1-4ec6-88e2-032a908da297 None admin] PATH_INFO: `/v3/projects/784795960efb40e5811f778fff6fceb1/users/b1146aa09d30458f9ab3b3bec8f94233/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:20.182734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082684b3-95a1-4ec6-88e2-032a908da297 None admin] RBAC: Authorizing `identity:create_grant(project_id=784795960efb40e5811f778fff6fceb1, user_id=b1146aa09d30458f9ab3b3bec8f94233, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:20.184789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082684b3-95a1-4ec6-88e2-032a908da297 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:20.202603 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 651/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 08:20:20 2022] PUT /identity/v3/projects/784795960efb40e5811f778fff6fceb1/users/b1146aa09d30458f9ab3b3bec8f94233/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:20:22.204901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a58f29-313c-4bec-833a-55da414c845a None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:22.205477 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a58f29-313c-4bec-833a-55da414c845a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:22.205477 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a58f29-313c-4bec-833a-55da414c845a None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:22.207051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 623/1274] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:22.213479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4c31-c4ad-45dc-a556-55134f0e0269 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:22.214063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4c31-c4ad-45dc-a556-55134f0e0269 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:22.214216 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4c31-c4ad-45dc-a556-55134f0e0269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:22.233799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1c0d4c31-c4ad-45dc-a556-55134f0e0269 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:22.235022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1c0d4c31-c4ad-45dc-a556-55134f0e0269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:22.317877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 652/1275] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:22.342226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a58f29-313c-4bec-833a-55da414c845a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:22.469413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a58f29-313c-4bec-833a-55da414c845a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:22.486393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:22.504225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370276a-446c-4b26-8620-cb9c5e2587db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:22.505025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370276a-446c-4b26-8620-cb9c5e2587db None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:22.505311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370276a-446c-4b26-8620-cb9c5e2587db None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:22.505580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370276a-446c-4b26-8620-cb9c5e2587db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:22.515960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370276a-446c-4b26-8620-cb9c5e2587db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-7370276a-446c-4b26-8620-cb9c5e2587db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:22.523902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:22.524983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:22.525843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:22.525843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:22.525843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:22.525843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:22.525843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:22.525843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:22.525843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:22.525843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:22.525843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:22.525843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:22.525843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:22.525843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:22.525843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 624/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 08:20:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:22.531495 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4c31-c4ad-45dc-a556-55134f0e0269 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:22.609728 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:22.632088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4c31-c4ad-45dc-a556-55134f0e0269 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:22.667227 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406dd28-a8ae-4ea1-aede-53fa08afdd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:22.667921 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406dd28-a8ae-4ea1-aede-53fa08afdd3c None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:22.668201 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406dd28-a8ae-4ea1-aede-53fa08afdd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:22.668475 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406dd28-a8ae-4ea1-aede-53fa08afdd3c None admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:22.669242 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406dd28-a8ae-4ea1-aede-53fa08afdd3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:22.669563 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406dd28-a8ae-4ea1-aede-53fa08afdd3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:22.671091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406dd28-a8ae-4ea1-aede-53fa08afdd3c None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:22.678948 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 653/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 08:20:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:22.684877 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370276a-446c-4b26-8620-cb9c5e2587db None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:22.793689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370276a-446c-4b26-8620-cb9c5e2587db None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:22.827995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e80af2-7970-4414-9062-70e946c4675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:22.828782 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e80af2-7970-4414-9062-70e946c4675a None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:22.829061 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e80af2-7970-4414-9062-70e946c4675a None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:22.829333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e80af2-7970-4414-9062-70e946c4675a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:22.840174 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e80af2-7970-4414-9062-70e946c4675a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:22.841713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e80af2-7970-4414-9062-70e946c4675a None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:22.858882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-48e80af2-7970-4414-9062-70e946c4675a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:22.858882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:22.858882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:22.858882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:22.858882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:22.858882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:22.858882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:22.858882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:22.858882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:22.858882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:22.858882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:22.858882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:22.858882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:22.858882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:22.858882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:22.859916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:22.860963 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:22.860963 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:22.860963 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:22.860963 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:22.860963 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 625/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:22.866646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406dd28-a8ae-4ea1-aede-53fa08afdd3c None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:22.973149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406dd28-a8ae-4ea1-aede-53fa08afdd3c None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:23.007979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9b500-4ef4-47b6-905b-4e2767ba7efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:23.008634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9b500-4ef4-47b6-905b-4e2767ba7efb None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:23.008920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9b500-4ef4-47b6-905b-4e2767ba7efb None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:23.009196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9b500-4ef4-47b6-905b-4e2767ba7efb None admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:23.009919 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9b500-4ef4-47b6-905b-4e2767ba7efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:23.010229 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9b500-4ef4-47b6-905b-4e2767ba7efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:23.011908 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9b500-4ef4-47b6-905b-4e2767ba7efb None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:23.025210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 654/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:23.034475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e80af2-7970-4414-9062-70e946c4675a None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:23.077369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:23.157841 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e80af2-7970-4414-9062-70e946c4675a None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:23.192666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ba550-33a5-4872-8431-bc4517635186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:23.193438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ba550-33a5-4872-8431-bc4517635186 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:23.193735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ba550-33a5-4872-8431-bc4517635186 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:23.194001 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ba550-33a5-4872-8431-bc4517635186 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:23.202010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ba550-33a5-4872-8431-bc4517635186 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:23.203464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ba550-33a5-4872-8431-bc4517635186 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-b80ba550-33a5-4872-8431-bc4517635186 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:23.217795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:23.219296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:23.220443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:23.220443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:23.220443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:23.220443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:23.220443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:23.220443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:23.220443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:23.220443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:23.220443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:20:23.220443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:23.220443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 626/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:23.225088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9b500-4ef4-47b6-905b-4e2767ba7efb None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:23.229038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:23.330630 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9b500-4ef4-47b6-905b-4e2767ba7efb None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:23.367651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c2adc-14d8-40b3-a19c-c51cae41b8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:23.368339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c2adc-14d8-40b3-a19c-c51cae41b8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:23.368625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c2adc-14d8-40b3-a19c-c51cae41b8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:23.368902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c2adc-14d8-40b3-a19c-c51cae41b8c6 None admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:23.369740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c2adc-14d8-40b3-a19c-c51cae41b8c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:23.370049 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c2adc-14d8-40b3-a19c-c51cae41b8c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:23.371498 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c2adc-14d8-40b3-a19c-c51cae41b8c6 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:23.390023 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 655/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 21 08:20:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:23.400264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ba550-33a5-4872-8431-bc4517635186 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:23.501849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:23.512661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ba550-33a5-4872-8431-bc4517635186 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:23.554904 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4e14c-c85b-41aa-8dcb-44f5c92f3fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:23.555534 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4e14c-c85b-41aa-8dcb-44f5c92f3fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:23.555836 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4e14c-c85b-41aa-8dcb-44f5c92f3fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:23.556103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4e14c-c85b-41aa-8dcb-44f5c92f3fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:23.623908 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4e14c-c85b-41aa-8dcb-44f5c92f3fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:23.625286 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4e14c-c85b-41aa-8dcb-44f5c92f3fb5 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:23.718662 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:23.729649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 627/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:20:23.735936 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c2adc-14d8-40b3-a19c-c51cae41b8c6 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:23.798107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:23.837589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c2adc-14d8-40b3-a19c-c51cae41b8c6 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:23.872418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b3eed-47b7-4f9f-98a8-11d1f27fb114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:23.873390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b3eed-47b7-4f9f-98a8-11d1f27fb114 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:23.873673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b3eed-47b7-4f9f-98a8-11d1f27fb114 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:23.874004 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b3eed-47b7-4f9f-98a8-11d1f27fb114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:23.885207 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b3eed-47b7-4f9f-98a8-11d1f27fb114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:23.886651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b3eed-47b7-4f9f-98a8-11d1f27fb114 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:23.904836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-9a3b3eed-47b7-4f9f-98a8-11d1f27fb114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:23.904836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:23.904836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:23.904836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:23.904836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:23.904836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:23.904836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:23.904836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:23.904836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:23.904836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:23.904836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:23.904836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:23.904836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:23.904836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:23.904836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:23.905749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:23.906638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:23.906638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:23.906638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:23.906638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:20:23.906638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 656/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:23.912032 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4e14c-c85b-41aa-8dcb-44f5c92f3fb5 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:24.027147 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4e14c-c85b-41aa-8dcb-44f5c92f3fb5 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:24.062514 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fb1f3-e0e3-4d47-b736-4908354849a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:24.063162 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fb1f3-e0e3-4d47-b736-4908354849a0 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.063443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fb1f3-e0e3-4d47-b736-4908354849a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.063737 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fb1f3-e0e3-4d47-b736-4908354849a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.064457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fb1f3-e0e3-4d47-b736-4908354849a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:24.064761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fb1f3-e0e3-4d47-b736-4908354849a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:24.066131 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fb1f3-e0e3-4d47-b736-4908354849a0 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:24.077369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 628/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:24.083521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b3eed-47b7-4f9f-98a8-11d1f27fb114 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:24.192234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b3eed-47b7-4f9f-98a8-11d1f27fb114 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:24.208445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:24.227400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e12718-2ff1-4928-88e0-5a1c8348632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:24.228226 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e12718-2ff1-4928-88e0-5a1c8348632a None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.228505 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e12718-2ff1-4928-88e0-5a1c8348632a None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.228773 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e12718-2ff1-4928-88e0-5a1c8348632a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.235165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e12718-2ff1-4928-88e0-5a1c8348632a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:24.236719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e12718-2ff1-4928-88e0-5a1c8348632a None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:24.249995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application [None req-72e12718-2ff1-4928-88e0-5a1c8348632a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:24.249995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:24.249995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:24.249995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:24.249995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:24.249995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:24.249995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:24.249995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:24.249995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:24.249995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:24.249995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:24.249995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:24.249995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:24.249995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:24.249995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:24.251091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:24.252263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:24.252263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:24.252263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:24.252263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:24.252263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:24.252263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:24.252263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:24.252263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: ERROR keystone.server.flask.application Jul 21 08:20:24.252263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 657/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:24.257315 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fb1f3-e0e3-4d47-b736-4908354849a0 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:24.312375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:24.366833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fb1f3-e0e3-4d47-b736-4908354849a0 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:24.401780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd875fb-3967-4968-926d-b86a2b338406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:24.402427 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd875fb-3967-4968-926d-b86a2b338406 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.402700 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd875fb-3967-4968-926d-b86a2b338406 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.402975 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd875fb-3967-4968-926d-b86a2b338406 None admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.403957 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd875fb-3967-4968-926d-b86a2b338406 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:24.404260 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd875fb-3967-4968-926d-b86a2b338406 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:24.405696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd875fb-3967-4968-926d-b86a2b338406 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:24.418291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 629/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:24.425493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e12718-2ff1-4928-88e0-5a1c8348632a None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:24.538804 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e12718-2ff1-4928-88e0-5a1c8348632a None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:24.575589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f69ee8-1c4d-4d92-96c9-c1b291869cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:24.576263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69ee8-1c4d-4d92-96c9-c1b291869cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.576554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69ee8-1c4d-4d92-96c9-c1b291869cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.576825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69ee8-1c4d-4d92-96c9-c1b291869cf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.577659 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f69ee8-1c4d-4d92-96c9-c1b291869cf2 None admin] RBAC: Adding query filter params (role.id=b3e17a05bffe488aac679e4a234d09eb, scope.project.id=784795960efb40e5811f778fff6fceb1, user.id=b1146aa09d30458f9ab3b3bec8f94233) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:24.577965 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f69ee8-1c4d-4d92-96c9-c1b291869cf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:24.579418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f69ee8-1c4d-4d92-96c9-c1b291869cf2 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:24.585972 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 658/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:24 2022] GET /identity/v3/role_assignments?user.id=b1146aa09d30458f9ab3b3bec8f94233&scope.project.id=784795960efb40e5811f778fff6fceb1&role.id=b3e17a05bffe488aac679e4a234d09eb => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:26.636486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287ea1-0dc9-4a9b-87a8-7e4b8c9901b4 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:26.637077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287ea1-0dc9-4a9b-87a8-7e4b8c9901b4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:26.637077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287ea1-0dc9-4a9b-87a8-7e4b8c9901b4 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:26.638617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 630/1288] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:26.645351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaf0d3-1ac8-49a6-ace5-c6216ffded64 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:26.646108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaf0d3-1ac8-49a6-ace5-c6216ffded64 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:26.646229 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaf0d3-1ac8-49a6-ace5-c6216ffded64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:26.666461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-58aaf0d3-1ac8-49a6-ace5-c6216ffded64 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:26.667792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-58aaf0d3-1ac8-49a6-ace5-c6216ffded64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:26.698963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:26.741298 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 659/1289] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:26.764077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287ea1-0dc9-4a9b-87a8-7e4b8c9901b4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:26.889843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287ea1-0dc9-4a9b-87a8-7e4b8c9901b4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:26.902867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:26.930433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4aa1b-5a7b-496f-97ce-323c84581366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:26.931249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4aa1b-5a7b-496f-97ce-323c84581366 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:26.931528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4aa1b-5a7b-496f-97ce-323c84581366 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:26.931839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4aa1b-5a7b-496f-97ce-323c84581366 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:26.932497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4aa1b-5a7b-496f-97ce-323c84581366 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:26.933883 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4aa1b-5a7b-496f-97ce-323c84581366 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-ecc4aa1b-5a7b-496f-97ce-323c84581366 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:26.946600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:26.947741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:26.948859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:26.948859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:26.948859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:26.948859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:26.948859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:26.948859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:26.948859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:26.948859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:26.948859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:26.948859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:26.948859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:26.948859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:26.948859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:20:26.948859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:26.948859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 631/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 08:20:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:26.954748 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaf0d3-1ac8-49a6-ace5-c6216ffded64 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:27.058771 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaf0d3-1ac8-49a6-ace5-c6216ffded64 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:27.095025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326e2c6-e7a9-4e22-af37-e71a329160f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:27.095704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326e2c6-e7a9-4e22-af37-e71a329160f8 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:27.095990 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326e2c6-e7a9-4e22-af37-e71a329160f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:27.096262 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326e2c6-e7a9-4e22-af37-e71a329160f8 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:27.096979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326e2c6-e7a9-4e22-af37-e71a329160f8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:27.097286 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326e2c6-e7a9-4e22-af37-e71a329160f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:27.098691 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326e2c6-e7a9-4e22-af37-e71a329160f8 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:27.103747 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 660/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 21 08:20:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:27.110631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4aa1b-5a7b-496f-97ce-323c84581366 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:27.233197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4aa1b-5a7b-496f-97ce-323c84581366 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:27.269987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e891e30-d212-481a-a920-f997f5ea6215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:27.270649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891e30-d212-481a-a920-f997f5ea6215 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:27.270925 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891e30-d212-481a-a920-f997f5ea6215 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:27.271202 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891e30-d212-481a-a920-f997f5ea6215 None admin] PATH_INFO: `/v3/services` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:27.271925 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e891e30-d212-481a-a920-f997f5ea6215 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:27.272229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e891e30-d212-481a-a920-f997f5ea6215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:27.273606 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e891e30-d212-481a-a920-f997f5ea6215 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:27.278251 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 632/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 21 08:20:27 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:29.277909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e935c7-aef1-4dd2-a489-0363a026e2a3 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:29.278718 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e935c7-aef1-4dd2-a489-0363a026e2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:29.278718 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e935c7-aef1-4dd2-a489-0363a026e2a3 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:29.279957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 661/1293] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:29.286355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6971e04-daeb-45c6-a699-92c19ee601fe None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:29.287089 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6971e04-daeb-45c6-a699-92c19ee601fe None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:29.287240 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6971e04-daeb-45c6-a699-92c19ee601fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:29.308720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e6971e04-daeb-45c6-a699-92c19ee601fe None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:29.309939 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e6971e04-daeb-45c6-a699-92c19ee601fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:29.343272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:29.389390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 633/1294] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:29.413452 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e935c7-aef1-4dd2-a489-0363a026e2a3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:29.447854 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:29.523314 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e935c7-aef1-4dd2-a489-0363a026e2a3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:29.558693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9667f-b381-4e3d-949e-d0cb7ab50321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:29.559365 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9667f-b381-4e3d-949e-d0cb7ab50321 None admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:29.559684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9667f-b381-4e3d-949e-d0cb7ab50321 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:29.559992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9667f-b381-4e3d-949e-d0cb7ab50321 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:29.560720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9667f-b381-4e3d-949e-d0cb7ab50321 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:29.562103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9667f-b381-4e3d-949e-d0cb7ab50321 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:29.581905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 662/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 08:20:29 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:20:31.609299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c00fa-16ef-4b8d-ae10-968f7400674f None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:31.610141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c00fa-16ef-4b8d-ae10-968f7400674f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:31.610141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c00fa-16ef-4b8d-ae10-968f7400674f None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:31.611817 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 634/1296] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:20:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:31.619807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f99f7c-9c28-4c7d-b7a3-91bb6e10f1df None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:31.620523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f99f7c-9c28-4c7d-b7a3-91bb6e10f1df None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:31.620670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f99f7c-9c28-4c7d-b7a3-91bb6e10f1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:31.645291 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-58f99f7c-9c28-4c7d-b7a3-91bb6e10f1df None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:31.646492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-58f99f7c-9c28-4c7d-b7a3-91bb6e10f1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:31.726267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 663/1297] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:31 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:31.749637 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c00fa-16ef-4b8d-ae10-968f7400674f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:31.867589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c00fa-16ef-4b8d-ae10-968f7400674f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:31.905319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e7c9a-8904-4c5d-8881-fc23f06ced40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:31.906115 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e7c9a-8904-4c5d-8881-fc23f06ced40 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:31.906398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e7c9a-8904-4c5d-8881-fc23f06ced40 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:31.906672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e7c9a-8904-4c5d-8881-fc23f06ced40 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:31.907328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e7c9a-8904-4c5d-8881-fc23f06ced40 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:31.908738 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e7c9a-8904-4c5d-8881-fc23f06ced40 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-a01e7c9a-8904-4c5d-8881-fc23f06ced40 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:31.921770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:31.922892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:31.924158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:31.924158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:31.924158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:31.924158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:31.924158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:31.924158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:31.924158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:31.924158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:31.924158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:31.924158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:31.924158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:31.924158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:31.924158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:20:31.924158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:31.924158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 635/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 08:20:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:31.929597 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f99f7c-9c28-4c7d-b7a3-91bb6e10f1df None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:31.955772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:32.052770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f99f7c-9c28-4c7d-b7a3-91bb6e10f1df None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:32.087391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80920ac7-cb55-4200-96cc-57ed894a3af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:32.088070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80920ac7-cb55-4200-96cc-57ed894a3af0 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:32.088345 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80920ac7-cb55-4200-96cc-57ed894a3af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:32.088616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80920ac7-cb55-4200-96cc-57ed894a3af0 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:32.089320 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80920ac7-cb55-4200-96cc-57ed894a3af0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:32.089622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80920ac7-cb55-4200-96cc-57ed894a3af0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:32.091042 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80920ac7-cb55-4200-96cc-57ed894a3af0 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:32.096425 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 664/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 21 08:20:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:32.102897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e7c9a-8904-4c5d-8881-fc23f06ced40 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:32.135578 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:32.224400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e7c9a-8904-4c5d-8881-fc23f06ced40 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:32.264991 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be47ee5-c1fc-4915-8be3-231e09e4e198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:32.265650 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be47ee5-c1fc-4915-8be3-231e09e4e198 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:32.265933 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be47ee5-c1fc-4915-8be3-231e09e4e198 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:32.266209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be47ee5-c1fc-4915-8be3-231e09e4e198 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:32.267034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be47ee5-c1fc-4915-8be3-231e09e4e198 None admin] RBAC: Adding query filter params (interface=public, service_id=a6d23f1379a1452598a4f8e8a154dd7f, region_id=RegionOne) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:32.267351 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be47ee5-c1fc-4915-8be3-231e09e4e198 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:32.269102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be47ee5-c1fc-4915-8be3-231e09e4e198 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:32.274379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 636/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 08:20:32 2022] GET /identity/v3/endpoints?service_id=a6d23f1379a1452598a4f8e8a154dd7f&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:32.280360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80920ac7-cb55-4200-96cc-57ed894a3af0 None admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:32.373127 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:32.396434 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80920ac7-cb55-4200-96cc-57ed894a3af0 None admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:32.446719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1920e71-c6fc-486f-9523-43f19864f9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:32.447401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1920e71-c6fc-486f-9523-43f19864f9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:32.447716 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1920e71-c6fc-486f-9523-43f19864f9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:32.447990 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1920e71-c6fc-486f-9523-43f19864f9c1 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:32.448708 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1920e71-c6fc-486f-9523-43f19864f9c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:32.450085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1920e71-c6fc-486f-9523-43f19864f9c1 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:32.461626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 665/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 08:20:32 2022] GET /identity/v3/services => generated 2191 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:20:34.458620 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4e220-4927-49a1-99e2-094abfa669f3 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:34.459071 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4e220-4927-49a1-99e2-094abfa669f3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:34.459190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4e220-4927-49a1-99e2-094abfa669f3 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:34.461323 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 637/1302] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:20:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:34.466996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b4f19-4e65-4479-a2bc-dabda4d3234f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:34.467410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b4f19-4e65-4479-a2bc-dabda4d3234f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:34.467544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b4f19-4e65-4479-a2bc-dabda4d3234f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:34.487000 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e18b4f19-4e65-4479-a2bc-dabda4d3234f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:34.488226 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e18b4f19-4e65-4479-a2bc-dabda4d3234f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:34.565069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 666/1303] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:34.588567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4e220-4927-49a1-99e2-094abfa669f3 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:34.692818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:34.700509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4e220-4927-49a1-99e2-094abfa669f3 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:34.736005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373fc46-b6b4-4079-abb4-aceb97e5ceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:34.736738 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373fc46-b6b4-4079-abb4-aceb97e5ceb1 None admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:34.737013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373fc46-b6b4-4079-abb4-aceb97e5ceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:34.737278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373fc46-b6b4-4079-abb4-aceb97e5ceb1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:34.737929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373fc46-b6b4-4079-abb4-aceb97e5ceb1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:34.739288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373fc46-b6b4-4079-abb4-aceb97e5ceb1 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application [None req-9373fc46-b6b4-4079-abb4-aceb97e5ceb1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:34.751373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:34.752564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:34.753418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:34.753418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:34.753418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:34.753418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:34.753418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:34.753418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:34.753418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:34.753418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:34.753418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:34.753418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:34.753418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:34.753418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:34.753418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:20:34.753418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: ERROR keystone.server.flask.application Jul 21 08:20:34.753418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 638/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 08:20:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:34.761287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b4f19-4e65-4479-a2bc-dabda4d3234f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:34.858365 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:34.885748 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b4f19-4e65-4479-a2bc-dabda4d3234f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:34.921002 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833ae6f-0f82-4f05-b8fe-67bf773fc204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:34.921662 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833ae6f-0f82-4f05-b8fe-67bf773fc204 None admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:34.921946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833ae6f-0f82-4f05-b8fe-67bf773fc204 None admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:34.922217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833ae6f-0f82-4f05-b8fe-67bf773fc204 None admin] PATH_INFO: `/v3/services` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:34.922922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833ae6f-0f82-4f05-b8fe-67bf773fc204 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:34.923229 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833ae6f-0f82-4f05-b8fe-67bf773fc204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:34.924636 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833ae6f-0f82-4f05-b8fe-67bf773fc204 None admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:34.929979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 667/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 21 08:20:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:34.936286 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373fc46-b6b4-4079-abb4-aceb97e5ceb1 None admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:35.041651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373fc46-b6b4-4079-abb4-aceb97e5ceb1 None admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:35.080394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce4544-e38e-4742-b554-c663120c7094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:35.081041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce4544-e38e-4742-b554-c663120c7094 None admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:35.081318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce4544-e38e-4742-b554-c663120c7094 None admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:35.081591 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce4544-e38e-4742-b554-c663120c7094 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:35.082349 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce4544-e38e-4742-b554-c663120c7094 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:35.083750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce4544-e38e-4742-b554-c663120c7094 None admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:35.106383 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 639/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 08:20:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:20:44.926792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=30 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:45.101728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:39.251494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f906ac0-23ab-466b-963f-cd66431c3385 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:39.252615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f906ac0-23ab-466b-963f-cd66431c3385 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:39.253104 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f906ac0-23ab-466b-963f-cd66431c3385 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:39.260133 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e43739-6181-4e73-ae51-23bf997ca851 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:39.261049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e43739-6181-4e73-ae51-23bf997ca851 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:39.261572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e43739-6181-4e73-ae51-23bf997ca851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:39.265662 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 668/1307] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:21:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:39.350597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-10e43739-6181-4e73-ae51-23bf997ca851 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:39.352326 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-10e43739-6181-4e73-ae51-23bf997ca851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:39.554264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 640/1308] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:21:39.610289 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f84ed-0a7c-4970-a61a-02c91dd4a6c5 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:39.610676 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f84ed-0a7c-4970-a61a-02c91dd4a6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:39.611117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f84ed-0a7c-4970-a61a-02c91dd4a6c5 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:39.613253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 669/1309] 10.222.0.64 () {54 vars in 965 bytes} [Thu Jul 21 08:21:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:39.620940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c85a56-d509-43d1-8ccc-3546525b9133 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:39.621368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c85a56-d509-43d1-8ccc-3546525b9133 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:39.621810 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c85a56-d509-43d1-8ccc-3546525b9133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:39.734747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-29c85a56-d509-43d1-8ccc-3546525b9133 None None] MFA Rules not processed for user `1d737a8a33da490db5d59ffed92bee60`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:39.736024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-29c85a56-d509-43d1-8ccc-3546525b9133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:39.758473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:39.819100 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 641/1310] 10.222.0.64 () {58 vars in 1062 bytes} [Thu Jul 21 08:21:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:21:39.828571 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f84ed-0a7c-4970-a61a-02c91dd4a6c5 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:39.830569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c59f84ed-0a7c-4970-a61a-02c91dd4a6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:39.938508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f84ed-0a7c-4970-a61a-02c91dd4a6c5 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:40.018696 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbc7e7-5adf-48d8-b566-c92f8e444ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:40.019276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbc7e7-5adf-48d8-b566-c92f8e444ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:40.019558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbc7e7-5adf-48d8-b566-c92f8e444ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:40.019864 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbc7e7-5adf-48d8-b566-c92f8e444ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:40.021510 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3fbbc7e7-5adf-48d8-b566-c92f8e444ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:40.079266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:40.136942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbc7e7-5adf-48d8-b566-c92f8e444ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:40.138630 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbc7e7-5adf-48d8-b566-c92f8e444ca7 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:40.158889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 670/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:21:42.474369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bd6e0-9b74-4bc2-85af-f1b44ecc3c40 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:42.474897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bd6e0-9b74-4bc2-85af-f1b44ecc3c40 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:42.475097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bd6e0-9b74-4bc2-85af-f1b44ecc3c40 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:42.476673 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 642/1312] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:42.482274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59e136-38d0-4bef-b3bc-8f024dd3ecfb None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:42.482815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59e136-38d0-4bef-b3bc-8f024dd3ecfb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:42.482815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59e136-38d0-4bef-b3bc-8f024dd3ecfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:42.562546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ce59e136-38d0-4bef-b3bc-8f024dd3ecfb None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:42.564050 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ce59e136-38d0-4bef-b3bc-8f024dd3ecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:42.683665 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 671/1313] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:21:42.722619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bd6e0-9b74-4bc2-85af-f1b44ecc3c40 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:42.724234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-571bd6e0-9b74-4bc2-85af-f1b44ecc3c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:42.837986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bd6e0-9b74-4bc2-85af-f1b44ecc3c40 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:42.918657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:42.921385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0c67c-4532-40ae-9251-325ec1ddbea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:42.922396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0c67c-4532-40ae-9251-325ec1ddbea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:42.922757 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0c67c-4532-40ae-9251-325ec1ddbea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:42.923315 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0c67c-4532-40ae-9251-325ec1ddbea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:42.925471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7bf0c67c-4532-40ae-9251-325ec1ddbea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:43.045027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0c67c-4532-40ae-9251-325ec1ddbea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:43.046482 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0c67c-4532-40ae-9251-325ec1ddbea5 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:43.066680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 643/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:21:45.435199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64ac01-82f8-4f4c-b8ac-130151451d1d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:45.435932 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64ac01-82f8-4f4c-b8ac-130151451d1d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:45.435932 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64ac01-82f8-4f4c-b8ac-130151451d1d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:45.437219 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 672/1315] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:45.443730 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc64f6-5099-4800-ade3-67924e0893f7 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:45.444466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc64f6-5099-4800-ade3-67924e0893f7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:45.444673 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc64f6-5099-4800-ade3-67924e0893f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:45.523221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-05cc64f6-5099-4800-ade3-67924e0893f7 None None] MFA Rules not processed for user `13747340af1f46a1822347a891a6c5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:45.524492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-05cc64f6-5099-4800-ade3-67924e0893f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:45.578742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:45.626793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 644/1316] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:21:45.681661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad96a3-b991-4ecf-b017-ba677ced8f17 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:45.681956 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad96a3-b991-4ecf-b017-ba677ced8f17 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:45.682243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad96a3-b991-4ecf-b017-ba677ced8f17 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:45.683740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 673/1317] 10.222.0.64 () {54 vars in 965 bytes} [Thu Jul 21 08:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:45.690790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba10960-8bdf-41c8-ae07-7578eeef89db None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:45.691111 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba10960-8bdf-41c8-ae07-7578eeef89db None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:45.691521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba10960-8bdf-41c8-ae07-7578eeef89db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:45.775566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3ba10960-8bdf-41c8-ae07-7578eeef89db None None] MFA Rules not processed for user `1d737a8a33da490db5d59ffed92bee60`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:45.776816 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3ba10960-8bdf-41c8-ae07-7578eeef89db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:45.871581 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 645/1318] 10.222.0.64 () {58 vars in 1062 bytes} [Thu Jul 21 08:21:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:21:45.881296 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad96a3-b991-4ecf-b017-ba677ced8f17 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:45.883928 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9dad96a3-b991-4ecf-b017-ba677ced8f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:45.896111 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:46.008350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad96a3-b991-4ecf-b017-ba677ced8f17 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:46.089878 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400848b9-8723-4473-b1ee-f6bd2cc99c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:46.090535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400848b9-8723-4473-b1ee-f6bd2cc99c25 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:46.090808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400848b9-8723-4473-b1ee-f6bd2cc99c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:46.091080 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400848b9-8723-4473-b1ee-f6bd2cc99c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:46.092774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-400848b9-8723-4473-b1ee-f6bd2cc99c25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:46.160593 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:46.210904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400848b9-8723-4473-b1ee-f6bd2cc99c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:46.212395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400848b9-8723-4473-b1ee-f6bd2cc99c25 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:46.232569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 674/1319] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:21:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:21:49.234894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57acaeb-2fd8-492a-9d07-0242b25f1885 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:49.235518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57acaeb-2fd8-492a-9d07-0242b25f1885 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:49.235518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57acaeb-2fd8-492a-9d07-0242b25f1885 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:49.236786 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 646/1320] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:49.243090 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a689d6-416a-42cc-93c8-7c840292bc4f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:49.243554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a689d6-416a-42cc-93c8-7c840292bc4f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:49.243746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a689d6-416a-42cc-93c8-7c840292bc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:49.323560 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-29a689d6-416a-42cc-93c8-7c840292bc4f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:49.324924 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-29a689d6-416a-42cc-93c8-7c840292bc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:49.440471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 675/1321] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:21:49.482132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57acaeb-2fd8-492a-9d07-0242b25f1885 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:49.483730 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c57acaeb-2fd8-492a-9d07-0242b25f1885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:49.541975 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:49.597869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57acaeb-2fd8-492a-9d07-0242b25f1885 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:49.670855 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a716599-6621-4993-94d2-a3bdfcee9453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:49.671835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a716599-6621-4993-94d2-a3bdfcee9453 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:49.672134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a716599-6621-4993-94d2-a3bdfcee9453 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:49.672386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a716599-6621-4993-94d2-a3bdfcee9453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:49.674031 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8a716599-6621-4993-94d2-a3bdfcee9453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:49.773476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:49.788355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a716599-6621-4993-94d2-a3bdfcee9453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:49.789833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a716599-6621-4993-94d2-a3bdfcee9453 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:49.809942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 647/1322] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:21:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:21:52.778861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd46f-968d-4a77-b9bd-7f604b65d1f5 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:52.779447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd46f-968d-4a77-b9bd-7f604b65d1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:52.779447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd46f-968d-4a77-b9bd-7f604b65d1f5 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:52.780859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 676/1323] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:21:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:52.786390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aee0e4-4833-4c95-b9b8-0f80090659da None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:52.786834 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aee0e4-4833-4c95-b9b8-0f80090659da None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:52.786946 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aee0e4-4833-4c95-b9b8-0f80090659da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:52.852332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-23aee0e4-4833-4c95-b9b8-0f80090659da None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:52.853576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-23aee0e4-4833-4c95-b9b8-0f80090659da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:52.961970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 648/1324] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:21:52.999651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dd46f-968d-4a77-b9bd-7f604b65d1f5 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:53.001231 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e64dd46f-968d-4a77-b9bd-7f604b65d1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:53.022599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:53.116186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dd46f-968d-4a77-b9bd-7f604b65d1f5 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:53.196292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38098f-13be-4e51-b925-511b22e47ada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:53.196949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38098f-13be-4e51-b925-511b22e47ada service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:53.197229 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38098f-13be-4e51-b925-511b22e47ada service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:53.197539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38098f-13be-4e51-b925-511b22e47ada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:53.199454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-af38098f-13be-4e51-b925-511b22e47ada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:53.271175 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:53.312748 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38098f-13be-4e51-b925-511b22e47ada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:53.314205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38098f-13be-4e51-b925-511b22e47ada service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:53.332407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 677/1325] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:21:55.433244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30e9b1-d64c-4a30-bf6b-dd8d97c56d25 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:55.433818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30e9b1-d64c-4a30-bf6b-dd8d97c56d25 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:55.433818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30e9b1-d64c-4a30-bf6b-dd8d97c56d25 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:55.435336 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 649/1326] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:55.441013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4ed10-da8b-4c0b-8c09-834af8eb8de6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:55.441528 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4ed10-da8b-4c0b-8c09-834af8eb8de6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:55.441528 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4ed10-da8b-4c0b-8c09-834af8eb8de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:55.509920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8dc4ed10-da8b-4c0b-8c09-834af8eb8de6 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:55.511243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8dc4ed10-da8b-4c0b-8c09-834af8eb8de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:55.618832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 678/1327] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:21:55.655669 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30e9b1-d64c-4a30-bf6b-dd8d97c56d25 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:55.657292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cc30e9b1-d64c-4a30-bf6b-dd8d97c56d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:55.725266 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:55.772209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30e9b1-d64c-4a30-bf6b-dd8d97c56d25 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:55.854880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1740c-19fe-4caf-9621-0521c6fc81c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:55.855528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1740c-19fe-4caf-9621-0521c6fc81c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:55.855838 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1740c-19fe-4caf-9621-0521c6fc81c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:55.856084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1740c-19fe-4caf-9621-0521c6fc81c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:55.857758 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-83d1740c-19fe-4caf-9621-0521c6fc81c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:55.972519 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:55.975267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1740c-19fe-4caf-9621-0521c6fc81c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:55.976865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1740c-19fe-4caf-9621-0521c6fc81c5 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:55.997264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 650/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:21:58.100206 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af3f05-ff24-4723-b1c0-e859dc60771a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:58.100741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af3f05-ff24-4723-b1c0-e859dc60771a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:58.100741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af3f05-ff24-4723-b1c0-e859dc60771a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:58.102099 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 679/1329] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:58.108040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86912c-cf34-459b-bb3f-3b164a6219a5 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:58.108529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86912c-cf34-459b-bb3f-3b164a6219a5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:58.108622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86912c-cf34-459b-bb3f-3b164a6219a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:58.183009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ae86912c-cf34-459b-bb3f-3b164a6219a5 None None] MFA Rules not processed for user `13747340af1f46a1822347a891a6c5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:58.184347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ae86912c-cf34-459b-bb3f-3b164a6219a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:58.288372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 651/1330] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:21:58.325632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af3f05-ff24-4723-b1c0-e859dc60771a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:58.327356 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-63af3f05-ff24-4723-b1c0-e859dc60771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:58.359586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:58.441185 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af3f05-ff24-4723-b1c0-e859dc60771a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:58.517296 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcde946-ad62-4389-a338-c0ccd12c32eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:58.517951 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcde946-ad62-4389-a338-c0ccd12c32eb service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:58.518232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcde946-ad62-4389-a338-c0ccd12c32eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:58.518503 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcde946-ad62-4389-a338-c0ccd12c32eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:58.520189 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-afcde946-ad62-4389-a338-c0ccd12c32eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:58.616950 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:58.653182 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcde946-ad62-4389-a338-c0ccd12c32eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:58.654651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcde946-ad62-4389-a338-c0ccd12c32eb service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:58.674450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 680/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:21:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:22:01.062272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660672-ddf1-434f-b23a-14b60116086b None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:01.062817 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660672-ddf1-434f-b23a-14b60116086b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:01.062817 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660672-ddf1-434f-b23a-14b60116086b None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:01.064248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 652/1332] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:01.069814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a5fd5-2b65-4f42-a712-a6d654d41c75 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:01.070261 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a5fd5-2b65-4f42-a712-a6d654d41c75 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:01.070833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a5fd5-2b65-4f42-a712-a6d654d41c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:01.136676 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-606a5fd5-2b65-4f42-a712-a6d654d41c75 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:01.137894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-606a5fd5-2b65-4f42-a712-a6d654d41c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:01.252259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 681/1333] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:22:01.303085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b660672-ddf1-434f-b23a-14b60116086b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:01.304688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2b660672-ddf1-434f-b23a-14b60116086b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:01.381697 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:01.421273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b660672-ddf1-434f-b23a-14b60116086b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:01.498835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73184c0-a327-4008-a523-f963d4a599c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:01.499481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73184c0-a327-4008-a523-f963d4a599c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:01.499791 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73184c0-a327-4008-a523-f963d4a599c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:01.500065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73184c0-a327-4008-a523-f963d4a599c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:01.501699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c73184c0-a327-4008-a523-f963d4a599c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:01.634426 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73184c0-a327-4008-a523-f963d4a599c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:01.635836 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73184c0-a327-4008-a523-f963d4a599c9 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:01.646808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:01.655967 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 653/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:22:03.736601 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11178b6-cc42-43f3-8046-6dea20cc7acf None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:03.737128 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11178b6-cc42-43f3-8046-6dea20cc7acf None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:03.737128 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11178b6-cc42-43f3-8046-6dea20cc7acf None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:03.738442 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 682/1335] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:03.743893 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229afc4d-e422-4bea-a3f2-52b90e3f8740 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:03.744318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229afc4d-e422-4bea-a3f2-52b90e3f8740 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:03.744411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229afc4d-e422-4bea-a3f2-52b90e3f8740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:03.814687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-229afc4d-e422-4bea-a3f2-52b90e3f8740 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:03.815913 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-229afc4d-e422-4bea-a3f2-52b90e3f8740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:03.934293 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 654/1336] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:03.977493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11178b6-cc42-43f3-8046-6dea20cc7acf None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:03.979012 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a11178b6-cc42-43f3-8046-6dea20cc7acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:04.022730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:04.090084 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11178b6-cc42-43f3-8046-6dea20cc7acf None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:04.179933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc2fef-48b2-4fab-ba79-958e1cce86d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:04.180582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc2fef-48b2-4fab-ba79-958e1cce86d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:04.180844 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc2fef-48b2-4fab-ba79-958e1cce86d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:04.181113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc2fef-48b2-4fab-ba79-958e1cce86d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:04.182824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-83cc2fef-48b2-4fab-ba79-958e1cce86d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:04.283672 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:04.311101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc2fef-48b2-4fab-ba79-958e1cce86d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:04.312590 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc2fef-48b2-4fab-ba79-958e1cce86d8 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:04.331343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 683/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:22:06.795134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde5354-ef2f-47a9-9b28-09b0a6ca8191 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:06.796113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde5354-ef2f-47a9-9b28-09b0a6ca8191 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:06.796113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde5354-ef2f-47a9-9b28-09b0a6ca8191 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:06.798279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 655/1338] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:06.807180 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18935782-f2be-4844-b0d9-883f8eb4a10e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:06.808018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18935782-f2be-4844-b0d9-883f8eb4a10e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:06.808018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18935782-f2be-4844-b0d9-883f8eb4a10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:06.895160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-18935782-f2be-4844-b0d9-883f8eb4a10e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:06.896454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-18935782-f2be-4844-b0d9-883f8eb4a10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:07.000130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 684/1339] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:07.051120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde5354-ef2f-47a9-9b28-09b0a6ca8191 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:07.053538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-abde5354-ef2f-47a9-9b28-09b0a6ca8191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:07.140249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:07.184074 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde5354-ef2f-47a9-9b28-09b0a6ca8191 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:07.273993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224486c-bea8-4493-a7c9-d385944f7079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:07.274648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224486c-bea8-4493-a7c9-d385944f7079 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:07.274957 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224486c-bea8-4493-a7c9-d385944f7079 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:07.275230 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224486c-bea8-4493-a7c9-d385944f7079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:07.277504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c224486c-bea8-4493-a7c9-d385944f7079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:07.404684 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224486c-bea8-4493-a7c9-d385944f7079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:07.406961 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224486c-bea8-4493-a7c9-d385944f7079 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:07.431221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 656/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:22:11.541191 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167ac47-78e7-4ae4-b996-295fd58b201b None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:11.541729 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167ac47-78e7-4ae4-b996-295fd58b201b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:11.541729 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167ac47-78e7-4ae4-b996-295fd58b201b None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:11.543200 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 685/1341] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:11.548689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2189e-311d-4ee7-a672-dbb77d023922 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:11.549116 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2189e-311d-4ee7-a672-dbb77d023922 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:11.549248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2189e-311d-4ee7-a672-dbb77d023922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:11.553797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:11.618199 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-29b2189e-311d-4ee7-a672-dbb77d023922 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:11.619439 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-29b2189e-311d-4ee7-a672-dbb77d023922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:11.716869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 657/1342] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:11.756515 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167ac47-78e7-4ae4-b996-295fd58b201b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:11.758084 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d167ac47-78e7-4ae4-b996-295fd58b201b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:11.811867 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:11.873007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167ac47-78e7-4ae4-b996-295fd58b201b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:11.954201 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041aeb43-f970-4348-8a1c-77ab4db1b2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:11.954866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041aeb43-f970-4348-8a1c-77ab4db1b2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:11.955155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041aeb43-f970-4348-8a1c-77ab4db1b2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:11.955432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041aeb43-f970-4348-8a1c-77ab4db1b2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:11.957139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-041aeb43-f970-4348-8a1c-77ab4db1b2f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:12.051213 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:12.069555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041aeb43-f970-4348-8a1c-77ab4db1b2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:12.070983 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041aeb43-f970-4348-8a1c-77ab4db1b2f1 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:12.090925 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 686/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:22:14.714246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8c02a-9228-4125-ad94-99ce22ebb89a None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:14.714246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8c02a-9228-4125-ad94-99ce22ebb89a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:14.714246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8c02a-9228-4125-ad94-99ce22ebb89a None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:14.716013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 658/1344] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:14.720984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985031a3-6033-43d6-827d-7e2656277930 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:14.721453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985031a3-6033-43d6-827d-7e2656277930 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:14.721566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985031a3-6033-43d6-827d-7e2656277930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:14.792946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-985031a3-6033-43d6-827d-7e2656277930 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:14.794196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-985031a3-6033-43d6-827d-7e2656277930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:14.897790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 687/1345] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:14.935536 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8c02a-9228-4125-ad94-99ce22ebb89a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:14.937230 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-58e8c02a-9228-4125-ad94-99ce22ebb89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:15.030325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:15.049159 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8c02a-9228-4125-ad94-99ce22ebb89a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:15.123584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a2acd-c4b7-4844-82b3-dcbf8d1bc1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:15.124262 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a2acd-c4b7-4844-82b3-dcbf8d1bc1da service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:15.124543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a2acd-c4b7-4844-82b3-dcbf8d1bc1da service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:15.124821 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a2acd-c4b7-4844-82b3-dcbf8d1bc1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:15.126458 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c47a2acd-c4b7-4844-82b3-dcbf8d1bc1da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:15.251274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a2acd-c4b7-4844-82b3-dcbf8d1bc1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:15.252668 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a2acd-c4b7-4844-82b3-dcbf8d1bc1da service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:15.274162 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 659/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:22:19.433437 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10fe07-6c74-411c-b53c-08602d0aa653 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:19.435496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10fe07-6c74-411c-b53c-08602d0aa653 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:19.435496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10fe07-6c74-411c-b53c-08602d0aa653 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:19.437162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 688/1347] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:19.442768 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bccce-fdec-49fc-a472-85b135de4294 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:19.443263 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bccce-fdec-49fc-a472-85b135de4294 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:19.443374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bccce-fdec-49fc-a472-85b135de4294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:19.458835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:19.513576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-180bccce-fdec-49fc-a472-85b135de4294 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:19.515177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-180bccce-fdec-49fc-a472-85b135de4294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:19.621457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 660/1348] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:19.659783 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10fe07-6c74-411c-b53c-08602d0aa653 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:19.661411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0a10fe07-6c74-411c-b53c-08602d0aa653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:19.724142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:19.774377 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10fe07-6c74-411c-b53c-08602d0aa653 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:19.853700 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed483f31-725e-4e74-a542-87e450deff4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:19.854634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed483f31-725e-4e74-a542-87e450deff4d service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:19.855128 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed483f31-725e-4e74-a542-87e450deff4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:19.855620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed483f31-725e-4e74-a542-87e450deff4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:19.858772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ed483f31-725e-4e74-a542-87e450deff4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:19.981132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:19.985288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed483f31-725e-4e74-a542-87e450deff4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:19.986867 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed483f31-725e-4e74-a542-87e450deff4d service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:20.008023 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 689/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:22:25.082411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32987783-08ac-49a1-9487-ffd5ca50ca2f None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:25.082915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32987783-08ac-49a1-9487-ffd5ca50ca2f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:25.082915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32987783-08ac-49a1-9487-ffd5ca50ca2f None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:25.084599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 661/1350] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 08:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:25.090008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b6740-5ea7-4612-8cd1-5201d5c92191 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:25.090486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b6740-5ea7-4612-8cd1-5201d5c92191 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:25.090689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b6740-5ea7-4612-8cd1-5201d5c92191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:25.177001 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-066b6740-5ea7-4612-8cd1-5201d5c92191 None None] MFA Rules not processed for user `b1146aa09d30458f9ab3b3bec8f94233`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:25.178695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-066b6740-5ea7-4612-8cd1-5201d5c92191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:25.296494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 690/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 08:22:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:29.438785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7762d3-d7f2-4e33-8dd3-516c179142a9 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:29.439320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7762d3-d7f2-4e33-8dd3-516c179142a9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:29.439320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7762d3-d7f2-4e33-8dd3-516c179142a9 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:29.442985 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 662/1352] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 08:22:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:29.451945 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e524be4-76bb-421d-b5a1-516fe7f32caa None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:29.451945 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e524be4-76bb-421d-b5a1-516fe7f32caa None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:29.452388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e524be4-76bb-421d-b5a1-516fe7f32caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:29.509076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:29.538056 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3e524be4-76bb-421d-b5a1-516fe7f32caa None None] MFA Rules not processed for user `b1146aa09d30458f9ab3b3bec8f94233`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:29.539680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3e524be4-76bb-421d-b5a1-516fe7f32caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:29.619584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=59 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:29.659926 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 691/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 08:22:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:31.022846 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceed5a3-63ca-4c6d-9b36-2986738312ce None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:31.023376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceed5a3-63ca-4c6d-9b36-2986738312ce None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:31.023376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceed5a3-63ca-4c6d-9b36-2986738312ce None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:31.024797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 663/1354] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 08:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:31.030261 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa9d81-dba2-454a-be8c-3b04b8f646f3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:31.030693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa9d81-dba2-454a-be8c-3b04b8f646f3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:31.030946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa9d81-dba2-454a-be8c-3b04b8f646f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:31.108185 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4dfa9d81-dba2-454a-be8c-3b04b8f646f3 None None] MFA Rules not processed for user `b1146aa09d30458f9ab3b3bec8f94233`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:31.109404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4dfa9d81-dba2-454a-be8c-3b04b8f646f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:31.153674 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:31.222549 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 692/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 08:22:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:22:34.673245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da78d6-7853-4431-a6c8-4f8c142dddbd None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:34.673747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da78d6-7853-4431-a6c8-4f8c142dddbd None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:34.673747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da78d6-7853-4431-a6c8-4f8c142dddbd None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:34.675227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 664/1356] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:34.682123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcea40-a4c8-41dc-bfb6-3f7f465d09cf None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:34.683214 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcea40-a4c8-41dc-bfb6-3f7f465d09cf None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:34.684005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcea40-a4c8-41dc-bfb6-3f7f465d09cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:34.761297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-dbbcea40-a4c8-41dc-bfb6-3f7f465d09cf None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:34.762756 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-dbbcea40-a4c8-41dc-bfb6-3f7f465d09cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:34.867119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 693/1357] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:34.923753 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4751-191f-4290-87d6-3195dbec9874 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:34.924630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4751-191f-4290-87d6-3195dbec9874 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:34.925260 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4751-191f-4290-87d6-3195dbec9874 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:34.928549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 665/1358] 10.222.0.64 () {54 vars in 962 bytes} [Thu Jul 21 08:22:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:34.937969 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d7a5-f0e2-4aca-bdd6-c638c5650e2c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:34.938687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d7a5-f0e2-4aca-bdd6-c638c5650e2c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:34.939204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d7a5-f0e2-4aca-bdd6-c638c5650e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:34.959182 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:35.025340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-31b1d7a5-f0e2-4aca-bdd6-c638c5650e2c None None] MFA Rules not processed for user `131bb5462c8b478783a350d37caa76ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:35.026800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-31b1d7a5-f0e2-4aca-bdd6-c638c5650e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:35.154120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 694/1359] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Jul 21 08:22:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:35.161872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd4751-191f-4290-87d6-3195dbec9874 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:35.163699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-22bd4751-191f-4290-87d6-3195dbec9874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:35.315944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd4751-191f-4290-87d6-3195dbec9874 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:35.394317 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:35.444416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd6693-bc7e-4d18-ba62-7f2748ed0767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:35.445069 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd6693-bc7e-4d18-ba62-7f2748ed0767 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:35.445350 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd6693-bc7e-4d18-ba62-7f2748ed0767 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:35.445629 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd6693-bc7e-4d18-ba62-7f2748ed0767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:35.449462 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e3dd6693-bc7e-4d18-ba62-7f2748ed0767 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:35.552089 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd6693-bc7e-4d18-ba62-7f2748ed0767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:35.553900 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd6693-bc7e-4d18-ba62-7f2748ed0767 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:35.573546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 666/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:22:37.870666 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e208af-47a5-430b-a097-b3b098330c11 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:37.871231 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e208af-47a5-430b-a097-b3b098330c11 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:37.871231 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e208af-47a5-430b-a097-b3b098330c11 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:37.872883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 695/1361] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:37.879002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc9b54-94d5-4de6-a4f1-4833bc4224f8 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:37.879903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc9b54-94d5-4de6-a4f1-4833bc4224f8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:37.880151 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc9b54-94d5-4de6-a4f1-4833bc4224f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:37.946447 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0dcc9b54-94d5-4de6-a4f1-4833bc4224f8 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:37.947983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0dcc9b54-94d5-4de6-a4f1-4833bc4224f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:37.987916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:38.059185 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 667/1362] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:38.106021 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e208af-47a5-430b-a097-b3b098330c11 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:38.107681 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-57e208af-47a5-430b-a097-b3b098330c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:38.189069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:38.278276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e208af-47a5-430b-a097-b3b098330c11 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:38.431090 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24022d16-b5eb-45b5-981e-c939843314c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:38.431090 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24022d16-b5eb-45b5-981e-c939843314c7 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:38.431090 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24022d16-b5eb-45b5-981e-c939843314c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:38.431090 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24022d16-b5eb-45b5-981e-c939843314c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:38.432200 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-24022d16-b5eb-45b5-981e-c939843314c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:38.470857 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:38.544518 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24022d16-b5eb-45b5-981e-c939843314c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:38.546121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24022d16-b5eb-45b5-981e-c939843314c7 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:38.565394 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 696/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:22:40.989023 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fa7ab-4bea-4ba7-9ad6-a5cfe7738bd8 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:40.989586 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fa7ab-4bea-4ba7-9ad6-a5cfe7738bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:40.989784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fa7ab-4bea-4ba7-9ad6-a5cfe7738bd8 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:40.991407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 668/1364] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:40.997508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ed419-2f7d-49b2-8116-0280e5d80d85 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:40.997952 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ed419-2f7d-49b2-8116-0280e5d80d85 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:40.998215 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ed419-2f7d-49b2-8116-0280e5d80d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:41.080028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d97ed419-2f7d-49b2-8116-0280e5d80d85 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:41.081513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d97ed419-2f7d-49b2-8116-0280e5d80d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:41.195326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:41.202682 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 697/1365] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:41.244749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445faff-b705-4bcf-8def-f4dc108ea526 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:41.245290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445faff-b705-4bcf-8def-f4dc108ea526 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:41.245671 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445faff-b705-4bcf-8def-f4dc108ea526 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:41.247344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 669/1366] 10.222.0.64 () {54 vars in 962 bytes} [Thu Jul 21 08:22:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:41.252934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18696de2-34a7-45d6-a95c-1424a1305487 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:41.253225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18696de2-34a7-45d6-a95c-1424a1305487 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:41.253502 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18696de2-34a7-45d6-a95c-1424a1305487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:41.337760 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-18696de2-34a7-45d6-a95c-1424a1305487 None None] MFA Rules not processed for user `131bb5462c8b478783a350d37caa76ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:41.339577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-18696de2-34a7-45d6-a95c-1424a1305487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:41.502116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 698/1367] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Jul 21 08:22:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:41.510372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445faff-b705-4bcf-8def-f4dc108ea526 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:41.512068 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f445faff-b705-4bcf-8def-f4dc108ea526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:41.675105 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445faff-b705-4bcf-8def-f4dc108ea526 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:41.696788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:41.798676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e06fe3-0a6f-4607-badd-02ebfb17de69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:41.799400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e06fe3-0a6f-4607-badd-02ebfb17de69 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:41.799814 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e06fe3-0a6f-4607-badd-02ebfb17de69 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:41.800209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e06fe3-0a6f-4607-badd-02ebfb17de69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:41.801960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-50e06fe3-0a6f-4607-badd-02ebfb17de69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:41.900206 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e06fe3-0a6f-4607-badd-02ebfb17de69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:41.902049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e06fe3-0a6f-4607-badd-02ebfb17de69 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:41.924511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 670/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:22:42.845210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4790734-a98f-4834-8d84-ebacdac82369 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:42.845737 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4790734-a98f-4834-8d84-ebacdac82369 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:42.845737 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4790734-a98f-4834-8d84-ebacdac82369 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:42.848006 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 699/1369] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:42.852779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e446b-d704-45f6-9e24-4149e1b850d3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:42.853479 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e446b-d704-45f6-9e24-4149e1b850d3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:42.853479 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e446b-d704-45f6-9e24-4149e1b850d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:42.886409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:42.924993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c87e446b-d704-45f6-9e24-4149e1b850d3 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:42.926388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c87e446b-d704-45f6-9e24-4149e1b850d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:43.031644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 671/1370] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:43.377709 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876fb43-96d0-49cf-8673-673bde47fd5a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:43.377709 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876fb43-96d0-49cf-8673-673bde47fd5a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:43.377709 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876fb43-96d0-49cf-8673-673bde47fd5a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:43.379740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 700/1371] 10.222.0.64 () {54 vars in 964 bytes} [Thu Jul 21 08:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:43.383146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f98b8a-972c-44dc-9962-f5f2f9c74e5e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:43.383417 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f98b8a-972c-44dc-9962-f5f2f9c74e5e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:43.383755 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f98b8a-972c-44dc-9962-f5f2f9c74e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:43.474703 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-91f98b8a-972c-44dc-9962-f5f2f9c74e5e None None] MFA Rules not processed for user `bd620e5fcb9c4b82865d1d0c508ce8c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:43.475975 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-91f98b8a-972c-44dc-9962-f5f2f9c74e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:43.525911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:43.561077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 672/1372] 10.222.0.64 () {58 vars in 1061 bytes} [Thu Jul 21 08:22:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:43.570425 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876fb43-96d0-49cf-8673-673bde47fd5a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:43.572515 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9876fb43-96d0-49cf-8673-673bde47fd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:43.631863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:43.693443 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876fb43-96d0-49cf-8673-673bde47fd5a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:43.772728 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca023917-906e-4aa3-aa86-68ad6e2a5858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:43.773562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca023917-906e-4aa3-aa86-68ad6e2a5858 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:43.773946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca023917-906e-4aa3-aa86-68ad6e2a5858 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:43.774322 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca023917-906e-4aa3-aa86-68ad6e2a5858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:43.777158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ca023917-906e-4aa3-aa86-68ad6e2a5858 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:43.885152 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:43.899760 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca023917-906e-4aa3-aa86-68ad6e2a5858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:43.901764 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca023917-906e-4aa3-aa86-68ad6e2a5858 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:43.920969 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 701/1373] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:22:44.030468 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1dfd8-6c37-46ed-8de7-3c2271bc13c3 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:44.030930 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1dfd8-6c37-46ed-8de7-3c2271bc13c3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:44.031185 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1dfd8-6c37-46ed-8de7-3c2271bc13c3 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:44.032706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 673/1374] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:44.037546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed022bd-a3ce-4341-ae14-ae62b01e6801 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:44.037834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed022bd-a3ce-4341-ae14-ae62b01e6801 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:44.038109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed022bd-a3ce-4341-ae14-ae62b01e6801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:44.102448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3ed022bd-a3ce-4341-ae14-ae62b01e6801 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:44.104165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3ed022bd-a3ce-4341-ae14-ae62b01e6801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:44.204227 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 702/1375] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:44.249098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1dfd8-6c37-46ed-8de7-3c2271bc13c3 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:44.250749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cfb1dfd8-6c37-46ed-8de7-3c2271bc13c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:44.406917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1dfd8-6c37-46ed-8de7-3c2271bc13c3 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:44.465427 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:44.530965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac11f7-7947-436c-9467-cab76751068b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:44.531631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac11f7-7947-436c-9467-cab76751068b service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:44.531952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac11f7-7947-436c-9467-cab76751068b service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:44.532254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac11f7-7947-436c-9467-cab76751068b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:44.533890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5cac11f7-7947-436c-9467-cab76751068b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:44.627393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac11f7-7947-436c-9467-cab76751068b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:44.629219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac11f7-7947-436c-9467-cab76751068b service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:44.647353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 674/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:22:46.710418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f142f0-b19a-4df3-8f20-c0422ef13965 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:46.710902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f142f0-b19a-4df3-8f20-c0422ef13965 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:46.710902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f142f0-b19a-4df3-8f20-c0422ef13965 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:46.712608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 703/1377] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:22:46.717690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10f76d-e915-4cb5-a6ee-bb2bcb3e69c8 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:46.718133 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10f76d-e915-4cb5-a6ee-bb2bcb3e69c8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:46.718226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10f76d-e915-4cb5-a6ee-bb2bcb3e69c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:46.785758 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-de10f76d-e915-4cb5-a6ee-bb2bcb3e69c8 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:46.786958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-de10f76d-e915-4cb5-a6ee-bb2bcb3e69c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:46.793783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:46.893168 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 675/1378] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:46.941627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f142f0-b19a-4df3-8f20-c0422ef13965 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:46.941627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-80f142f0-b19a-4df3-8f20-c0422ef13965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:47.011446 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:47.097278 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f142f0-b19a-4df3-8f20-c0422ef13965 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:47.216995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3c3ed-d60d-48ac-b739-05785d96ee72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:47.217671 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3c3ed-d60d-48ac-b739-05785d96ee72 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:47.217956 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3c3ed-d60d-48ac-b739-05785d96ee72 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:47.218232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3c3ed-d60d-48ac-b739-05785d96ee72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:47.219929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-dcf3c3ed-d60d-48ac-b739-05785d96ee72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:47.238286 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:47.327697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3c3ed-d60d-48ac-b739-05785d96ee72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:47.329319 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3c3ed-d60d-48ac-b739-05785d96ee72 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:47.359817 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 704/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:22:49.450227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057dc90-471d-404a-b47d-265f5bcf8953 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:49.450227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057dc90-471d-404a-b47d-265f5bcf8953 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:49.450227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057dc90-471d-404a-b47d-265f5bcf8953 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:49.455234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 676/1380] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:49.457350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00160d3-9fa6-476b-99e6-d8cced22025e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:49.457890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00160d3-9fa6-476b-99e6-d8cced22025e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:49.457890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00160d3-9fa6-476b-99e6-d8cced22025e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:49.533678 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f00160d3-9fa6-476b-99e6-d8cced22025e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:49.534830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f00160d3-9fa6-476b-99e6-d8cced22025e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:49.631977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:49.640043 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 705/1381] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:49.689304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057dc90-471d-404a-b47d-265f5bcf8953 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:49.691276 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d057dc90-471d-404a-b47d-265f5bcf8953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:49.871319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:49.888427 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057dc90-471d-404a-b47d-265f5bcf8953 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:50.021707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a310a-c99f-4212-8aaf-697c64b44035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:50.022382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a310a-c99f-4212-8aaf-697c64b44035 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:50.022668 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a310a-c99f-4212-8aaf-697c64b44035 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:50.023063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a310a-c99f-4212-8aaf-697c64b44035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:50.025262 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-652a310a-c99f-4212-8aaf-697c64b44035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:50.131353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a310a-c99f-4212-8aaf-697c64b44035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:50.132951 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a310a-c99f-4212-8aaf-697c64b44035 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:50.144503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:50.156439 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 677/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:22:52.295031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2a1fa-2390-4b81-ba01-51c3a74f498c None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:52.295683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2a1fa-2390-4b81-ba01-51c3a74f498c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:52.295683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2a1fa-2390-4b81-ba01-51c3a74f498c None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:52.297291 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 706/1383] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:52.304723 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed06bf5-5e60-4987-bef8-4444ae4d93aa None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:52.305250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed06bf5-5e60-4987-bef8-4444ae4d93aa None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:52.305353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed06bf5-5e60-4987-bef8-4444ae4d93aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:52.374566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-aed06bf5-5e60-4987-bef8-4444ae4d93aa None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:52.375821 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-aed06bf5-5e60-4987-bef8-4444ae4d93aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:52.476734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 678/1384] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:22:52.518953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2a1fa-2390-4b81-ba01-51c3a74f498c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:52.520640 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d1a2a1fa-2390-4b81-ba01-51c3a74f498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:52.678220 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2a1fa-2390-4b81-ba01-51c3a74f498c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:52.760970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:52.817197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ace5f5-f49b-4aa0-93b7-a8c631a92661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:52.818059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ace5f5-f49b-4aa0-93b7-a8c631a92661 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:52.818468 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ace5f5-f49b-4aa0-93b7-a8c631a92661 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:52.818849 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ace5f5-f49b-4aa0-93b7-a8c631a92661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:52.820999 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e7ace5f5-f49b-4aa0-93b7-a8c631a92661 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:52.942898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ace5f5-f49b-4aa0-93b7-a8c631a92661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:52.944580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ace5f5-f49b-4aa0-93b7-a8c631a92661 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:52.971587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 707/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:22:55.213038 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5e06-6d69-4670-b99a-0efc3ac90318 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:55.213617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5e06-6d69-4670-b99a-0efc3ac90318 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:55.213617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5e06-6d69-4670-b99a-0efc3ac90318 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:55.214965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 679/1386] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:55.220485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb11653-0ea0-450b-bd6d-4b0e46e20469 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:55.220909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb11653-0ea0-450b-bd6d-4b0e46e20469 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:55.221071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb11653-0ea0-450b-bd6d-4b0e46e20469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:55.290666 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ffb11653-0ea0-450b-bd6d-4b0e46e20469 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:55.291915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ffb11653-0ea0-450b-bd6d-4b0e46e20469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:55.328033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:55.399957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 708/1387] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:55.446638 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5e06-6d69-4670-b99a-0efc3ac90318 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:55.448319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8c6f5e06-6d69-4670-b99a-0efc3ac90318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:55.528106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:55.604002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5e06-6d69-4670-b99a-0efc3ac90318 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:55.722443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d296e29-8b58-4745-b6c5-01173ec253fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:55.723107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d296e29-8b58-4745-b6c5-01173ec253fb service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:55.723384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d296e29-8b58-4745-b6c5-01173ec253fb service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:55.723693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d296e29-8b58-4745-b6c5-01173ec253fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:55.725366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8d296e29-8b58-4745-b6c5-01173ec253fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:55.768870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:55.826437 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d296e29-8b58-4745-b6c5-01173ec253fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:55.829005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d296e29-8b58-4745-b6c5-01173ec253fb service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:55.848362 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 680/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:22:57.991463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94ccba-437b-4a72-a387-52aa6fbc5ac0 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:57.992392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94ccba-437b-4a72-a387-52aa6fbc5ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:57.992392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94ccba-437b-4a72-a387-52aa6fbc5ac0 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:57.994169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 709/1389] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:22:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:57.999483 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c07e7-b396-4750-925a-c7a5215f42e9 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:58.000019 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c07e7-b396-4750-925a-c7a5215f42e9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:58.000131 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c07e7-b396-4750-925a-c7a5215f42e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:58.074148 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-228c07e7-b396-4750-925a-c7a5215f42e9 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:58.075358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-228c07e7-b396-4750-925a-c7a5215f42e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:58.174184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 681/1390] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:58.220873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94ccba-437b-4a72-a387-52aa6fbc5ac0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:58.222747 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bb94ccba-437b-4a72-a387-52aa6fbc5ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:58.385609 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94ccba-437b-4a72-a387-52aa6fbc5ac0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:58.402807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:58.520414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af224a2f-022a-4641-b455-5bfdc3c6a789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:58.521223 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af224a2f-022a-4641-b455-5bfdc3c6a789 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:58.521568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af224a2f-022a-4641-b455-5bfdc3c6a789 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:58.521967 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af224a2f-022a-4641-b455-5bfdc3c6a789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:58.523749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-af224a2f-022a-4641-b455-5bfdc3c6a789 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:58.639833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af224a2f-022a-4641-b455-5bfdc3c6a789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:58.641731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af224a2f-022a-4641-b455-5bfdc3c6a789 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:58.665224 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 710/1391] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:00.755251 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba168e34-2752-40bb-9564-84c6c59b29ad None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:00.755839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba168e34-2752-40bb-9564-84c6c59b29ad None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:00.755839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba168e34-2752-40bb-9564-84c6c59b29ad None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:00.757088 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 682/1392] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:00.763126 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bad5a-f3d8-4890-bb33-d0b371c69485 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:00.763623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bad5a-f3d8-4890-bb33-d0b371c69485 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:00.763720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bad5a-f3d8-4890-bb33-d0b371c69485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:00.789066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:00.838899 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ad3bad5a-f3d8-4890-bb33-d0b371c69485 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:00.840151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ad3bad5a-f3d8-4890-bb33-d0b371c69485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:00.961147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 711/1393] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:01.005669 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba168e34-2752-40bb-9564-84c6c59b29ad None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:01.007279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ba168e34-2752-40bb-9564-84c6c59b29ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:01.022920 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:01.158682 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba168e34-2752-40bb-9564-84c6c59b29ad None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:01.247161 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:01.276162 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307722a-a634-41e0-b428-0032e6f04550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:01.276739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307722a-a634-41e0-b428-0032e6f04550 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:01.277022 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307722a-a634-41e0-b428-0032e6f04550 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:01.277291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307722a-a634-41e0-b428-0032e6f04550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:01.278972 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a307722a-a634-41e0-b428-0032e6f04550 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:01.374076 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307722a-a634-41e0-b428-0032e6f04550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:01.375696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307722a-a634-41e0-b428-0032e6f04550 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:01.395256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 683/1394] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:02.238057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31ac88-8d2a-45a5-bfbf-5bd4e5676133 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:02.238663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31ac88-8d2a-45a5-bfbf-5bd4e5676133 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:02.238663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31ac88-8d2a-45a5-bfbf-5bd4e5676133 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:02.240232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 712/1395] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:02.245567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed856c33-452d-4467-bf5b-715a1540f7c4 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:02.246015 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed856c33-452d-4467-bf5b-715a1540f7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:02.246120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed856c33-452d-4467-bf5b-715a1540f7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:02.313505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ed856c33-452d-4467-bf5b-715a1540f7c4 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:02.314742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ed856c33-452d-4467-bf5b-715a1540f7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:02.365340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:02.419924 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 684/1396] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:02.477033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b75ac-f4d8-4094-9649-b77297ccdcac None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:02.477299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b75ac-f4d8-4094-9649-b77297ccdcac None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:02.477779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b75ac-f4d8-4094-9649-b77297ccdcac None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:02.479561 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 713/1397] 10.222.0.64 () {54 vars in 966 bytes} [Thu Jul 21 08:23:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:02.484830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe5037-cfca-46c0-8459-5e1b2e08795e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:02.485124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe5037-cfca-46c0-8459-5e1b2e08795e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:02.485398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe5037-cfca-46c0-8459-5e1b2e08795e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:02.566043 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-11fe5037-cfca-46c0-8459-5e1b2e08795e None None] MFA Rules not processed for user `4a57dc68aeb5482a86d5983b466d933d`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:02.567399 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-11fe5037-cfca-46c0-8459-5e1b2e08795e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:02.649394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 685/1398] 10.222.0.64 () {58 vars in 1063 bytes} [Thu Jul 21 08:23:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:02.657167 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b75ac-f4d8-4094-9649-b77297ccdcac None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:02.658693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d21b75ac-f4d8-4094-9649-b77297ccdcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:02.765514 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:02.767768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b75ac-f4d8-4094-9649-b77297ccdcac None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:02.840804 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07f4a7-447a-4932-8602-dae680bb1389 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a57dc68aeb5482a86d5983b466d933d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:02.841396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07f4a7-447a-4932-8602-dae680bb1389 service glance] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:02.841685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07f4a7-447a-4932-8602-dae680bb1389 service glance] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:02.841961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07f4a7-447a-4932-8602-dae680bb1389 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:02.843626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cd07f4a7-447a-4932-8602-dae680bb1389 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:02.958813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07f4a7-447a-4932-8602-dae680bb1389 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:02.960334 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07f4a7-447a-4932-8602-dae680bb1389 service glance] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:02.980204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 714/1399] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:03.462941 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61574a61-0cdd-4a93-8cab-73a89e909af8 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:03.463429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61574a61-0cdd-4a93-8cab-73a89e909af8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:03.463519 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61574a61-0cdd-4a93-8cab-73a89e909af8 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:03.465071 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 686/1400] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:03.470345 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc3031-f3c7-4c9b-9002-e6799ad9ae85 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:03.470807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc3031-f3c7-4c9b-9002-e6799ad9ae85 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:03.470921 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc3031-f3c7-4c9b-9002-e6799ad9ae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:03.508321 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:03.540465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8afc3031-f3c7-4c9b-9002-e6799ad9ae85 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:03.541768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8afc3031-f3c7-4c9b-9002-e6799ad9ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:03.649737 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 715/1401] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:03.700961 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61574a61-0cdd-4a93-8cab-73a89e909af8 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:03.702654 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-61574a61-0cdd-4a93-8cab-73a89e909af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:03.715863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151795ef-36e7-4188-ab10-4e75c8fbe215 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:03.716214 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151795ef-36e7-4188-ab10-4e75c8fbe215 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:03.716621 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151795ef-36e7-4188-ab10-4e75c8fbe215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:03.752536 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:03.781731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-151795ef-36e7-4188-ab10-4e75c8fbe215 None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:03.782945 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-151795ef-36e7-4188-ab10-4e75c8fbe215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:03.839452 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:03.861804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61574a61-0cdd-4a93-8cab-73a89e909af8 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:03.881746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 716/1402] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 08:23:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:23:03.932176 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7efb-b42a-4f2c-a6f2-3a14abb013d9 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:03.932720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7efb-b42a-4f2c-a6f2-3a14abb013d9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:03.933153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7efb-b42a-4f2c-a6f2-3a14abb013d9 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:03.934904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 717/1403] 10.222.0.64 () {54 vars in 943 bytes} [Thu Jul 21 08:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:23:03.941412 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df3fdb-8194-4c29-b514-6f702b12a0ba None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:03.941702 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df3fdb-8194-4c29-b514-6f702b12a0ba None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:03.941981 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df3fdb-8194-4c29-b514-6f702b12a0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:03.992365 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c727103-ff95-4e7b-b084-a4c440954c18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:03.993005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c727103-ff95-4e7b-b084-a4c440954c18 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:03.993395 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c727103-ff95-4e7b-b084-a4c440954c18 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:03.993689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c727103-ff95-4e7b-b084-a4c440954c18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:03.995339 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0c727103-ff95-4e7b-b084-a4c440954c18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:04.002413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:04.018601 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d0df3fdb-8194-4c29-b514-6f702b12a0ba None None] MFA Rules not processed for user `a8d7cfd6610a4df095daea14ecc37b21`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:04.019855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d0df3fdb-8194-4c29-b514-6f702b12a0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:04.088274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c727103-ff95-4e7b-b084-a4c440954c18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:04.089960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c727103-ff95-4e7b-b084-a4c440954c18 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:04.108099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 687/1404] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:04.127494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 718/1405] 10.222.0.64 () {58 vars in 1040 bytes} [Thu Jul 21 08:23:03 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:23:04.137260 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c727103-ff95-4e7b-b084-a4c440954c18 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:04.138508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0c727103-ff95-4e7b-b084-a4c440954c18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:04.242331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c727103-ff95-4e7b-b084-a4c440954c18 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:04.297418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:04.357133 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f322b-c706-48ed-9cd2-7812d86ed187 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:04.357797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f322b-c706-48ed-9cd2-7812d86ed187 service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:04.358074 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f322b-c706-48ed-9cd2-7812d86ed187 service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:04.358346 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f322b-c706-48ed-9cd2-7812d86ed187 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:04.360093 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bc5f322b-c706-48ed-9cd2-7812d86ed187 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:04.452619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f322b-c706-48ed-9cd2-7812d86ed187 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:04.454267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f322b-c706-48ed-9cd2-7812d86ed187 service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:04.463696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 688/1406] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:23:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:23:06.199535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417913-01f2-4567-a849-67d0e92734d2 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:06.200094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417913-01f2-4567-a849-67d0e92734d2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:06.200094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417913-01f2-4567-a849-67d0e92734d2 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:06.209031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 719/1407] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:23:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:06.209576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b74a3-8e4f-4ae2-b382-f3a885b4e109 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:06.210026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b74a3-8e4f-4ae2-b382-f3a885b4e109 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:06.210188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b74a3-8e4f-4ae2-b382-f3a885b4e109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:06.291721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-800b74a3-8e4f-4ae2-b382-f3a885b4e109 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:06.292878 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-800b74a3-8e4f-4ae2-b382-f3a885b4e109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:06.335104 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:06.416941 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 689/1408] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:06.466341 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee417913-01f2-4567-a849-67d0e92734d2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:06.467947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ee417913-01f2-4567-a849-67d0e92734d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:06.506814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:06.635719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee417913-01f2-4567-a849-67d0e92734d2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:06.752243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:06.759916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6384e31-ed2d-49d0-8727-cf7057a0bb41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:06.760782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6384e31-ed2d-49d0-8727-cf7057a0bb41 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:06.761139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6384e31-ed2d-49d0-8727-cf7057a0bb41 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:06.761588 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6384e31-ed2d-49d0-8727-cf7057a0bb41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:06.763815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a6384e31-ed2d-49d0-8727-cf7057a0bb41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:06.865965 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6384e31-ed2d-49d0-8727-cf7057a0bb41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:06.867643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6384e31-ed2d-49d0-8727-cf7057a0bb41 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:06.887810 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 720/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:16.414870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=30 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:16.884840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=48 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:26.953305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc9379-c23a-45cc-8cb2-0a7c8bd610a5 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:26.954337 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc9379-c23a-45cc-8cb2-0a7c8bd610a5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:26.954337 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc9379-c23a-45cc-8cb2-0a7c8bd610a5 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:26.955914 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 690/1410] 10.222.0.64 () {54 vars in 918 bytes} [Thu Jul 21 08:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:26.964903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc32c8-8764-4317-854c-4b67e24626fc None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:26.965393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc32c8-8764-4317-854c-4b67e24626fc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:26.965491 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc32c8-8764-4317-854c-4b67e24626fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:27.056726 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-adbc32c8-8764-4317-854c-4b67e24626fc None None] MFA Rules not processed for user `b1146aa09d30458f9ab3b3bec8f94233`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:27.057940 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-adbc32c8-8764-4317-854c-4b67e24626fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:27.182763 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 721/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Jul 21 08:23:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:27.197617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785d65d-2339-4298-891c-1c4309ad01b4 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:27.197906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785d65d-2339-4298-891c-1c4309ad01b4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:27.198184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785d65d-2339-4298-891c-1c4309ad01b4 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:27.199567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 691/1412] 10.222.0.64 () {54 vars in 918 bytes} [Thu Jul 21 08:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:27.204520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4868eb-5eee-445f-a749-696d6168f61f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:27.204788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4868eb-5eee-445f-a749-696d6168f61f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:27.205111 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4868eb-5eee-445f-a749-696d6168f61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:27.286349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:27.289568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ec4868eb-5eee-445f-a749-696d6168f61f None None] MFA Rules not processed for user `131bb5462c8b478783a350d37caa76ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:27.291767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ec4868eb-5eee-445f-a749-696d6168f61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:27.425665 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 722/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Jul 21 08:23:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:29.924581 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a65877-9953-4d94-941a-b518da7e419e None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:29.925452 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a65877-9953-4d94-941a-b518da7e419e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:29.925452 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a65877-9953-4d94-941a-b518da7e419e None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:29.927643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 692/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:23:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:29.933463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c38a3-95ed-4826-8c1e-89ad3fec2861 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:29.933941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c38a3-95ed-4826-8c1e-89ad3fec2861 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:29.934041 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c38a3-95ed-4826-8c1e-89ad3fec2861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:30.003898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-519c38a3-95ed-4826-8c1e-89ad3fec2861 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:30.005132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-519c38a3-95ed-4826-8c1e-89ad3fec2861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:30.070139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:30.117127 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 723/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:30.165253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a65877-9953-4d94-941a-b518da7e419e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:30.166895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-93a65877-9953-4d94-941a-b518da7e419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:30.347799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a65877-9953-4d94-941a-b518da7e419e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:30.427169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:30.484839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59b4bf-d81f-4ddd-beb9-76f3ef5b6ff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:30.485839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59b4bf-d81f-4ddd-beb9-76f3ef5b6ff6 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:30.486267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59b4bf-d81f-4ddd-beb9-76f3ef5b6ff6 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:30.486706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59b4bf-d81f-4ddd-beb9-76f3ef5b6ff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:30.489335 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3b59b4bf-d81f-4ddd-beb9-76f3ef5b6ff6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:30.584396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59b4bf-d81f-4ddd-beb9-76f3ef5b6ff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:30.586254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59b4bf-d81f-4ddd-beb9-76f3ef5b6ff6 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:30.605118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 693/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:31.531714 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2068131-63d0-40ac-9e7b-8418b02306de None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:31.532300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2068131-63d0-40ac-9e7b-8418b02306de None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:31.532300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2068131-63d0-40ac-9e7b-8418b02306de None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:31.534431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 724/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:23:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:31.539823 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bee5f-a564-4d93-ad6b-23945c71ec5a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:31.540300 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bee5f-a564-4d93-ad6b-23945c71ec5a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:31.540403 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bee5f-a564-4d93-ad6b-23945c71ec5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:31.628732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8a3bee5f-a564-4d93-ad6b-23945c71ec5a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:31.629952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8a3bee5f-a564-4d93-ad6b-23945c71ec5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:31.657550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:31.728259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 694/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:31.887293 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2068131-63d0-40ac-9e7b-8418b02306de None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:31.889790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d2068131-63d0-40ac-9e7b-8418b02306de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:32.059199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2068131-63d0-40ac-9e7b-8418b02306de None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:32.111186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:32.188787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d3b57-36cf-4300-ad7a-b3d150491a5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:32.189444 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d3b57-36cf-4300-ad7a-b3d150491a5f service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:32.189719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d3b57-36cf-4300-ad7a-b3d150491a5f service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:32.189989 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d3b57-36cf-4300-ad7a-b3d150491a5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:32.191775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f55d3b57-36cf-4300-ad7a-b3d150491a5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:32.285753 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d3b57-36cf-4300-ad7a-b3d150491a5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:32.287381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d3b57-36cf-4300-ad7a-b3d150491a5f service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:32.308385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 725/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:33.207675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568fa64-460c-4fce-9415-8eb10857548f None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:33.208730 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568fa64-460c-4fce-9415-8eb10857548f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:33.208730 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568fa64-460c-4fce-9415-8eb10857548f None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:33.210949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 695/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:23:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:23:33.219482 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374e215-4f2d-4e19-9e7a-9d9143ac3924 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:33.220307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374e215-4f2d-4e19-9e7a-9d9143ac3924 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:33.220481 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374e215-4f2d-4e19-9e7a-9d9143ac3924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:33.280428 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:33.310844 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2374e215-4f2d-4e19-9e7a-9d9143ac3924 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:33.312019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2374e215-4f2d-4e19-9e7a-9d9143ac3924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:33.429863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 726/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:23:33.586368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568fa64-460c-4fce-9415-8eb10857548f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:33.588100 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3568fa64-460c-4fce-9415-8eb10857548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:33.743141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568fa64-460c-4fce-9415-8eb10857548f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:33.761166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:33.863195 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a250279-eb6f-43ad-8615-b7825fc7e9ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:33.863768 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a250279-eb6f-43ad-8615-b7825fc7e9ea service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:33.864070 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a250279-eb6f-43ad-8615-b7825fc7e9ea service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:33.864340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a250279-eb6f-43ad-8615-b7825fc7e9ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:33.865986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8a250279-eb6f-43ad-8615-b7825fc7e9ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:33.963557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a250279-eb6f-43ad-8615-b7825fc7e9ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:33.965188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a250279-eb6f-43ad-8615-b7825fc7e9ea service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:33.984069 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 696/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:34.877117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a76df-6dac-4a0a-bbb9-e81fa043b3a2 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:34.877900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a76df-6dac-4a0a-bbb9-e81fa043b3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:34.877900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a76df-6dac-4a0a-bbb9-e81fa043b3a2 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:34.879735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 727/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:23:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:34.885449 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d5cbb-5345-4e34-93b6-e7cb3e140c56 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:34.886234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d5cbb-5345-4e34-93b6-e7cb3e140c56 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:34.886338 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d5cbb-5345-4e34-93b6-e7cb3e140c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:34.905776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:34.962589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9f0d5cbb-5345-4e34-93b6-e7cb3e140c56 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:34.963843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9f0d5cbb-5345-4e34-93b6-e7cb3e140c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:35.074568 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 697/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:35.227785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a76df-6dac-4a0a-bbb9-e81fa043b3a2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:35.229533 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ac5a76df-6dac-4a0a-bbb9-e81fa043b3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:35.355670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:35.396080 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a76df-6dac-4a0a-bbb9-e81fa043b3a2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:35.511797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19379148-15c4-4ee2-8863-8f592a3d8236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:35.512383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19379148-15c4-4ee2-8863-8f592a3d8236 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:35.512664 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19379148-15c4-4ee2-8863-8f592a3d8236 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:35.512938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19379148-15c4-4ee2-8863-8f592a3d8236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:35.514582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-19379148-15c4-4ee2-8863-8f592a3d8236 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:35.595641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:35.616178 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19379148-15c4-4ee2-8863-8f592a3d8236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:35.618451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19379148-15c4-4ee2-8863-8f592a3d8236 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:35.638065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 728/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:36.526619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc258b72-14b5-4d6a-9935-5ecc34228791 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:36.527152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc258b72-14b5-4d6a-9935-5ecc34228791 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:36.527152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc258b72-14b5-4d6a-9935-5ecc34228791 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:36.529231 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 698/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:23:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:23:36.534594 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599e5d6-0f5b-419a-8cfa-1fc3f9a45767 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:36.535091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599e5d6-0f5b-419a-8cfa-1fc3f9a45767 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:36.535199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599e5d6-0f5b-419a-8cfa-1fc3f9a45767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:36.616996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f599e5d6-0f5b-419a-8cfa-1fc3f9a45767 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:36.618248 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f599e5d6-0f5b-419a-8cfa-1fc3f9a45767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:36.719740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 729/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:36.878878 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc258b72-14b5-4d6a-9935-5ecc34228791 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:36.880338 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cc258b72-14b5-4d6a-9935-5ecc34228791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:36.968452 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:37.032946 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc258b72-14b5-4d6a-9935-5ecc34228791 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:37.153856 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c68c5-e64a-4ac5-9f21-03ea4c7929c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:37.154497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c68c5-e64a-4ac5-9f21-03ea4c7929c9 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:37.154773 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c68c5-e64a-4ac5-9f21-03ea4c7929c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:37.155056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c68c5-e64a-4ac5-9f21-03ea4c7929c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:37.156699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ef3c68c5-e64a-4ac5-9f21-03ea4c7929c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:37.206677 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:37.252368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c68c5-e64a-4ac5-9f21-03ea4c7929c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:37.253973 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c68c5-e64a-4ac5-9f21-03ea4c7929c9 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:37.272544 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 699/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:38.113975 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e5774-f153-4a99-a207-fe77744446b6 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:38.114469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e5774-f153-4a99-a207-fe77744446b6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:38.114586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e5774-f153-4a99-a207-fe77744446b6 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:38.115980 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 730/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:38.122381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11095ae-965d-41ec-b613-eafe25cbfdc3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:38.123177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11095ae-965d-41ec-b613-eafe25cbfdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:38.123357 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11095ae-965d-41ec-b613-eafe25cbfdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:38.204036 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b11095ae-965d-41ec-b613-eafe25cbfdc3 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:38.205250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b11095ae-965d-41ec-b613-eafe25cbfdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:38.321504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 700/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:38.477723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e5774-f153-4a99-a207-fe77744446b6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:38.479268 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b73e5774-f153-4a99-a207-fe77744446b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:38.532717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:38.647635 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e5774-f153-4a99-a207-fe77744446b6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:38.762019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a1b2a-8d32-4a39-b23a-66676130c4f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:38.762576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a1b2a-8d32-4a39-b23a-66676130c4f3 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:38.762854 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a1b2a-8d32-4a39-b23a-66676130c4f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:38.763132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a1b2a-8d32-4a39-b23a-66676130c4f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:38.764826 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-040a1b2a-8d32-4a39-b23a-66676130c4f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:38.772003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:38.863059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a1b2a-8d32-4a39-b23a-66676130c4f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:38.864723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a1b2a-8d32-4a39-b23a-66676130c4f3 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:38.890188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 731/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:39.702227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54541c1c-8d82-441f-b67c-d7b543ceaa30 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:39.702813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54541c1c-8d82-441f-b67c-d7b543ceaa30 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:39.702813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54541c1c-8d82-441f-b67c-d7b543ceaa30 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:39.704102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 701/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:39.713808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412c198-f321-4126-bb70-1c864a4eab92 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:39.714293 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412c198-f321-4126-bb70-1c864a4eab92 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:39.714402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412c198-f321-4126-bb70-1c864a4eab92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:39.793878 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e412c198-f321-4126-bb70-1c864a4eab92 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:39.795101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e412c198-f321-4126-bb70-1c864a4eab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:39.866196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:39.897638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 732/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:40.050257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54541c1c-8d82-441f-b67c-d7b543ceaa30 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:40.051726 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-54541c1c-8d82-441f-b67c-d7b543ceaa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:40.074023 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:40.220720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54541c1c-8d82-441f-b67c-d7b543ceaa30 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:40.321801 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:40.349374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e44ce9-af75-459b-899a-97f63f8d3ee8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:40.350022 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e44ce9-af75-459b-899a-97f63f8d3ee8 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:40.350295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e44ce9-af75-459b-899a-97f63f8d3ee8 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:40.350573 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e44ce9-af75-459b-899a-97f63f8d3ee8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:40.352474 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-81e44ce9-af75-459b-899a-97f63f8d3ee8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:40.452402 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e44ce9-af75-459b-899a-97f63f8d3ee8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:40.453755 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e44ce9-af75-459b-899a-97f63f8d3ee8 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:40.472728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 702/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:41.309943 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b889670-3f76-4dde-9bef-550bf0bd0015 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:41.310553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b889670-3f76-4dde-9bef-550bf0bd0015 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:41.310553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b889670-3f76-4dde-9bef-550bf0bd0015 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:41.311966 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 733/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:41.318175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1facf-ea06-4383-8bd8-61d044ee7c47 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:41.318940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1facf-ea06-4383-8bd8-61d044ee7c47 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:41.319085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1facf-ea06-4383-8bd8-61d044ee7c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:41.400578 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-91b1facf-ea06-4383-8bd8-61d044ee7c47 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:41.401819 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-91b1facf-ea06-4383-8bd8-61d044ee7c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:41.448363 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:41.506966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 703/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:41.656815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b889670-3f76-4dde-9bef-550bf0bd0015 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:41.658338 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0b889670-3f76-4dde-9bef-550bf0bd0015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:41.825789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b889670-3f76-4dde-9bef-550bf0bd0015 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:41.882007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:41.958090 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a065748-add3-4a62-9547-7eeb83fca55c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:41.958687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a065748-add3-4a62-9547-7eeb83fca55c service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:41.958975 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a065748-add3-4a62-9547-7eeb83fca55c service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:41.959258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a065748-add3-4a62-9547-7eeb83fca55c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:41.961545 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9a065748-add3-4a62-9547-7eeb83fca55c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:42.064475 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a065748-add3-4a62-9547-7eeb83fca55c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:42.066104 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a065748-add3-4a62-9547-7eeb83fca55c service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:42.085676 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 734/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:42.915407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1dc19a-5cbf-411c-80ff-fae4a6eee427 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:42.916389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1dc19a-5cbf-411c-80ff-fae4a6eee427 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:42.916389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1dc19a-5cbf-411c-80ff-fae4a6eee427 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:42.918617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 704/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:23:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:42.925979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44b0bf-9dd8-4bc4-818b-46366fd04c1d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:42.926429 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44b0bf-9dd8-4bc4-818b-46366fd04c1d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:42.926533 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44b0bf-9dd8-4bc4-818b-46366fd04c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:43.008447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7d44b0bf-9dd8-4bc4-818b-46366fd04c1d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:43.009682 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7d44b0bf-9dd8-4bc4-818b-46366fd04c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:43.012134 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:43.134388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 735/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:23:43.291115 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1dc19a-5cbf-411c-80ff-fae4a6eee427 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:43.293664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-be1dc19a-5cbf-411c-80ff-fae4a6eee427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:43.455247 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1dc19a-5cbf-411c-80ff-fae4a6eee427 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:43.489107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:43.576728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69ddd9-98f0-4d94-9311-bfa292490dec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:43.577287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69ddd9-98f0-4d94-9311-bfa292490dec service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:43.577565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69ddd9-98f0-4d94-9311-bfa292490dec service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:43.577919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69ddd9-98f0-4d94-9311-bfa292490dec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:43.579584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7f69ddd9-98f0-4d94-9311-bfa292490dec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:43.670754 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69ddd9-98f0-4d94-9311-bfa292490dec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:43.672401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69ddd9-98f0-4d94-9311-bfa292490dec service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:43.691366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 705/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:45.606241 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e14425-a31f-490a-8d69-e7d7e0f92b72 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:45.606848 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e14425-a31f-490a-8d69-e7d7e0f92b72 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:45.606848 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e14425-a31f-490a-8d69-e7d7e0f92b72 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:45.608215 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 736/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:45.614467 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522e78e-1637-4b97-9ed7-3f820f47fc85 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:45.614912 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522e78e-1637-4b97-9ed7-3f820f47fc85 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:45.615049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522e78e-1637-4b97-9ed7-3f820f47fc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:45.672970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:45.700073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b522e78e-1637-4b97-9ed7-3f820f47fc85 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:45.701316 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b522e78e-1637-4b97-9ed7-3f820f47fc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:45.809942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 706/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:45.852915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e14425-a31f-490a-8d69-e7d7e0f92b72 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:45.854450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-33e14425-a31f-490a-8d69-e7d7e0f92b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:45.972883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e14425-a31f-490a-8d69-e7d7e0f92b72 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:46.006910 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:46.051266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2106466-2aa5-4347-82a8-f4e131d0cb18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:46.051948 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2106466-2aa5-4347-82a8-f4e131d0cb18 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:46.052221 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2106466-2aa5-4347-82a8-f4e131d0cb18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:46.052489 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2106466-2aa5-4347-82a8-f4e131d0cb18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:46.054129 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c2106466-2aa5-4347-82a8-f4e131d0cb18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:46.179483 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2106466-2aa5-4347-82a8-f4e131d0cb18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:46.180900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2106466-2aa5-4347-82a8-f4e131d0cb18 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:46.199697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 737/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:48.416348 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d30f-1051-4d0c-b268-bcff231b70f7 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:48.417222 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d30f-1051-4d0c-b268-bcff231b70f7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:48.417222 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d30f-1051-4d0c-b268-bcff231b70f7 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:48.419207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 707/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:23:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:48.427434 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790f5fe-3491-40aa-970a-0fb29aa59fb3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:48.427901 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790f5fe-3491-40aa-970a-0fb29aa59fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:48.428029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790f5fe-3491-40aa-970a-0fb29aa59fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:48.495584 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4790f5fe-3491-40aa-970a-0fb29aa59fb3 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:48.496836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4790f5fe-3491-40aa-970a-0fb29aa59fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:48.510619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:48.603339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 738/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:48.647330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9d30f-1051-4d0c-b268-bcff231b70f7 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:48.650151 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-35a9d30f-1051-4d0c-b268-bcff231b70f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:48.772756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9d30f-1051-4d0c-b268-bcff231b70f7 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:48.785124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:48.851376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8dc7d-1366-42c2-b7f0-ad44fbba5379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:48.852035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8dc7d-1366-42c2-b7f0-ad44fbba5379 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:48.852344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8dc7d-1366-42c2-b7f0-ad44fbba5379 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:48.852619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8dc7d-1366-42c2-b7f0-ad44fbba5379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:48.854293 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1ac8dc7d-1366-42c2-b7f0-ad44fbba5379 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:48.970780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8dc7d-1366-42c2-b7f0-ad44fbba5379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:48.972270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8dc7d-1366-42c2-b7f0-ad44fbba5379 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:48.990797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 708/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:51.405822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee4e52-734a-435a-a3fc-b6adb1b30a13 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:51.406407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee4e52-734a-435a-a3fc-b6adb1b30a13 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:51.406407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee4e52-734a-435a-a3fc-b6adb1b30a13 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:51.407827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 739/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:51.414406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6ab39-7883-42b1-8abe-f06ea0f68856 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:51.415400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6ab39-7883-42b1-8abe-f06ea0f68856 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:51.415400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6ab39-7883-42b1-8abe-f06ea0f68856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:51.471943 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:51.490676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-bed6ab39-7883-42b1-8abe-f06ea0f68856 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:51.492009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bed6ab39-7883-42b1-8abe-f06ea0f68856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:51.597206 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 709/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:51.653938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee4e52-734a-435a-a3fc-b6adb1b30a13 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:51.655544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-59ee4e52-734a-435a-a3fc-b6adb1b30a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:51.779190 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee4e52-734a-435a-a3fc-b6adb1b30a13 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:51.823628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:51.859264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0733aaa-5088-430b-8b61-e06afd6fda71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:51.859975 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0733aaa-5088-430b-8b61-e06afd6fda71 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:51.860259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0733aaa-5088-430b-8b61-e06afd6fda71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:51.860535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0733aaa-5088-430b-8b61-e06afd6fda71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:51.862198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d0733aaa-5088-430b-8b61-e06afd6fda71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:51.976658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0733aaa-5088-430b-8b61-e06afd6fda71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:51.978151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0733aaa-5088-430b-8b61-e06afd6fda71 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:51.997083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 740/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:54.177437 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33372331-cdaf-4f77-be08-92babd522943 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:54.178010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33372331-cdaf-4f77-be08-92babd522943 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:54.178010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33372331-cdaf-4f77-be08-92babd522943 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:54.179425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 710/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:54.188489 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76ba17-e737-401a-9d0f-5304e7df7f75 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:54.189241 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76ba17-e737-401a-9d0f-5304e7df7f75 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:54.189391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76ba17-e737-401a-9d0f-5304e7df7f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:54.268800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6f76ba17-e737-401a-9d0f-5304e7df7f75 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:54.270016 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6f76ba17-e737-401a-9d0f-5304e7df7f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:54.291417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:54.388607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 741/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:54.429521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33372331-cdaf-4f77-be08-92babd522943 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:54.432036 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-33372331-cdaf-4f77-be08-92babd522943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:54.548095 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33372331-cdaf-4f77-be08-92babd522943 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:54.568480 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:54.625489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382dbeb-2894-417c-8b72-d90ca4cea61b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:54.626107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382dbeb-2894-417c-8b72-d90ca4cea61b service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:54.626389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382dbeb-2894-417c-8b72-d90ca4cea61b service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:54.626693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382dbeb-2894-417c-8b72-d90ca4cea61b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:54.628358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b382dbeb-2894-417c-8b72-d90ca4cea61b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:54.748271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382dbeb-2894-417c-8b72-d90ca4cea61b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:54.749684 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382dbeb-2894-417c-8b72-d90ca4cea61b service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:54.770106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 711/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:56.954174 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de2ab-f336-49fe-a87e-5a6dfcacb289 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:56.955086 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de2ab-f336-49fe-a87e-5a6dfcacb289 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:56.955086 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de2ab-f336-49fe-a87e-5a6dfcacb289 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:56.957294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 742/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:23:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:56.963954 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574548a-bf18-42d0-8077-ccc0fa447184 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:56.964697 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574548a-bf18-42d0-8077-ccc0fa447184 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:56.964842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574548a-bf18-42d0-8077-ccc0fa447184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:57.038057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:57.041500 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6574548a-bf18-42d0-8077-ccc0fa447184 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:57.043380 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6574548a-bf18-42d0-8077-ccc0fa447184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:57.147314 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 712/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:57.186011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de2ab-f336-49fe-a87e-5a6dfcacb289 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:57.187630 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5c9de2ab-f336-49fe-a87e-5a6dfcacb289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:57.297622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de2ab-f336-49fe-a87e-5a6dfcacb289 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:57.357848 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:57.385412 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3d75b-eed4-4c30-837b-4451f32b179a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:57.386065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3d75b-eed4-4c30-837b-4451f32b179a service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:57.386325 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3d75b-eed4-4c30-837b-4451f32b179a service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:57.386640 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3d75b-eed4-4c30-837b-4451f32b179a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:57.388328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e6c3d75b-eed4-4c30-837b-4451f32b179a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:57.514447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3d75b-eed4-4c30-837b-4451f32b179a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:57.515945 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3d75b-eed4-4c30-837b-4451f32b179a service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:57.534971 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 743/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:59.649876 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b02cc-708e-46e3-a121-b7f03e9ede5f None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:59.650768 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b02cc-708e-46e3-a121-b7f03e9ede5f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:59.650768 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b02cc-708e-46e3-a121-b7f03e9ede5f None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:59.652917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 713/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:23:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:59.658850 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b4138-bb2f-499f-989b-2731c6f80b61 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:59.659336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b4138-bb2f-499f-989b-2731c6f80b61 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:59.659434 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b4138-bb2f-499f-989b-2731c6f80b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:59.740259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-cb5b4138-bb2f-499f-989b-2731c6f80b61 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:59.741386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cb5b4138-bb2f-499f-989b-2731c6f80b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:59.775126 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:59.847938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 744/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:59.887893 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b02cc-708e-46e3-a121-b7f03e9ede5f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:59.889504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7e2b02cc-708e-46e3-a121-b7f03e9ede5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:59.998026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b02cc-708e-46e3-a121-b7f03e9ede5f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:00.027763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:00.079511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5417c-5104-40e2-9730-6196c582fc81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:00.080198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5417c-5104-40e2-9730-6196c582fc81 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:00.080482 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5417c-5104-40e2-9730-6196c582fc81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:00.080757 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5417c-5104-40e2-9730-6196c582fc81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:00.082397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d1d5417c-5104-40e2-9730-6196c582fc81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:00.216145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5417c-5104-40e2-9730-6196c582fc81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:00.217647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5417c-5104-40e2-9730-6196c582fc81 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:00.237546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 714/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:24:02.437467 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488ff85-1d65-490c-9c2c-febe3d54f011 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:02.438048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488ff85-1d65-490c-9c2c-febe3d54f011 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:02.438048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488ff85-1d65-490c-9c2c-febe3d54f011 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:02.439474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 745/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:02.446144 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7b2af-b1e6-4e97-855d-890da9e60f54 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:02.446600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7b2af-b1e6-4e97-855d-890da9e60f54 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:02.446715 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7b2af-b1e6-4e97-855d-890da9e60f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:02.520484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a2c7b2af-b1e6-4e97-855d-890da9e60f54 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:02.521712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a2c7b2af-b1e6-4e97-855d-890da9e60f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:02.531408 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:02.639017 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 715/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:02.677460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488ff85-1d65-490c-9c2c-febe3d54f011 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:24:02.679907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9488ff85-1d65-490c-9c2c-febe3d54f011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:02.792018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488ff85-1d65-490c-9c2c-febe3d54f011 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:02.855276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:02.875319 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5542c7-a4c3-4abc-a895-2ba5c79924c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:02.876050 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5542c7-a4c3-4abc-a895-2ba5c79924c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:02.876336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5542c7-a4c3-4abc-a895-2ba5c79924c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:02.876612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5542c7-a4c3-4abc-a895-2ba5c79924c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:02.878261 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5c5542c7-a4c3-4abc-a895-2ba5c79924c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:02.995523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5542c7-a4c3-4abc-a895-2ba5c79924c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:02.997073 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5542c7-a4c3-4abc-a895-2ba5c79924c9 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:03.017091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 746/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:24:05.118063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ce04d-fcd6-42e3-ab47-6cac42dbee14 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:05.118970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ce04d-fcd6-42e3-ab47-6cac42dbee14 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:05.118970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ce04d-fcd6-42e3-ab47-6cac42dbee14 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:05.121216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 716/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:24:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:05.127656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343129f-4422-47ad-a9bc-e37e2a539735 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:05.128337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343129f-4422-47ad-a9bc-e37e2a539735 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:05.128529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343129f-4422-47ad-a9bc-e37e2a539735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:05.205430 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8343129f-4422-47ad-a9bc-e37e2a539735 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:05.206666 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8343129f-4422-47ad-a9bc-e37e2a539735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:05.246683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:05.309003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 747/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:05.346872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ce04d-fcd6-42e3-ab47-6cac42dbee14 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:24:05.349320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d84ce04d-fcd6-42e3-ab47-6cac42dbee14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:05.464584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ce04d-fcd6-42e3-ab47-6cac42dbee14 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:05.504535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:05.549227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16c148-d97e-47db-94b3-e1ea6c598529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:05.550157 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16c148-d97e-47db-94b3-e1ea6c598529 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:05.550525 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16c148-d97e-47db-94b3-e1ea6c598529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:05.550786 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16c148-d97e-47db-94b3-e1ea6c598529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:05.553314 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-db16c148-d97e-47db-94b3-e1ea6c598529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:05.681741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16c148-d97e-47db-94b3-e1ea6c598529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:05.683266 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16c148-d97e-47db-94b3-e1ea6c598529 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:05.702665 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 717/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:24:07.773989 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212cfd7-65c5-4090-bb01-a9c72c813f3a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:07.774750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212cfd7-65c5-4090-bb01-a9c72c813f3a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:07.774750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212cfd7-65c5-4090-bb01-a9c72c813f3a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:07.776076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 748/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:24:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:07.782614 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b16b4-a4c8-4a1b-925e-b07a7044c765 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:07.783327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b16b4-a4c8-4a1b-925e-b07a7044c765 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:07.783476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b16b4-a4c8-4a1b-925e-b07a7044c765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:07.858851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-dd9b16b4-a4c8-4a1b-925e-b07a7044c765 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:07.860303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-dd9b16b4-a4c8-4a1b-925e-b07a7044c765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:07.882870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:07.966900 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 718/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:08.014374 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212cfd7-65c5-4090-bb01-a9c72c813f3a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:24:08.015933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7212cfd7-65c5-4090-bb01-a9c72c813f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:08.138379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212cfd7-65c5-4090-bb01-a9c72c813f3a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:08.219395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:08.227310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745f5e1-f5df-4d53-90e2-36add327cd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:08.228026 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745f5e1-f5df-4d53-90e2-36add327cd9d service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:08.228295 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745f5e1-f5df-4d53-90e2-36add327cd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:08.228561 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745f5e1-f5df-4d53-90e2-36add327cd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:08.230274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2745f5e1-f5df-4d53-90e2-36add327cd9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:08.362470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745f5e1-f5df-4d53-90e2-36add327cd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:08.363990 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745f5e1-f5df-4d53-90e2-36add327cd9d service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:08.384814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 749/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:24:10.512024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156aaad-bac5-475f-ae74-5998937544f2 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:10.512603 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156aaad-bac5-475f-ae74-5998937544f2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:10.512603 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156aaad-bac5-475f-ae74-5998937544f2 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:10.513959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 719/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:10.520534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6654b3-b837-4dc4-9f40-b113a002bd9b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:10.521057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6654b3-b837-4dc4-9f40-b113a002bd9b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:10.521183 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6654b3-b837-4dc4-9f40-b113a002bd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:10.605879 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5b6654b3-b837-4dc4-9f40-b113a002bd9b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:10.607129 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5b6654b3-b837-4dc4-9f40-b113a002bd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:10.660092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:10.709597 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 750/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:10.747631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156aaad-bac5-475f-ae74-5998937544f2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:24:10.749229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d156aaad-bac5-475f-ae74-5998937544f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:10.872291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156aaad-bac5-475f-ae74-5998937544f2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:10.920907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:10.953199 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242d67d-32a9-4115-90b3-530bbbeab252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:10.954062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242d67d-32a9-4115-90b3-530bbbeab252 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:10.954432 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242d67d-32a9-4115-90b3-530bbbeab252 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:10.954741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242d67d-32a9-4115-90b3-530bbbeab252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:10.957368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0242d67d-32a9-4115-90b3-530bbbeab252 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:11.073503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242d67d-32a9-4115-90b3-530bbbeab252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:11.074974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242d67d-32a9-4115-90b3-530bbbeab252 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:11.094139 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 720/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:24:20.707816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=22 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:21.091310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=66 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:30.994614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eabb5-2456-4348-9c0e-bbd06f9592f7 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:30.995354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eabb5-2456-4348-9c0e-bbd06f9592f7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:30.995454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eabb5-2456-4348-9c0e-bbd06f9592f7 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:30.996914 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 751/1471] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:24:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:31.005835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960856d-b526-49dd-9a7f-9a144bb5df7b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:31.006289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960856d-b526-49dd-9a7f-9a144bb5df7b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:31.006398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960856d-b526-49dd-9a7f-9a144bb5df7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:31.084441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-4960856d-b526-49dd-9a7f-9a144bb5df7b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:31.085663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4960856d-b526-49dd-9a7f-9a144bb5df7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:31.189734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 721/1472] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:31.288014 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544f4e3-a2c5-4333-bfd4-c7ffc49de733 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:31.288671 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544f4e3-a2c5-4333-bfd4-c7ffc49de733 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:31.289180 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544f4e3-a2c5-4333-bfd4-c7ffc49de733 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:31.291408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 752/1473] 10.222.0.64 () {54 vars in 966 bytes} [Thu Jul 21 08:24:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:31.296512 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc152b3-ac6a-4144-a5de-7ef905023272 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:31.296808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc152b3-ac6a-4144-a5de-7ef905023272 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:31.297086 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc152b3-ac6a-4144-a5de-7ef905023272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:31.377616 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-adc152b3-ac6a-4144-a5de-7ef905023272 None None] MFA Rules not processed for user `4a57dc68aeb5482a86d5983b466d933d`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:31.378842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-adc152b3-ac6a-4144-a5de-7ef905023272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:31.400376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:31.457955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 722/1474] 10.222.0.64 () {58 vars in 1063 bytes} [Thu Jul 21 08:24:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:31.465661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544f4e3-a2c5-4333-bfd4-c7ffc49de733 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:24:31.467285 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5544f4e3-a2c5-4333-bfd4-c7ffc49de733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:31.577264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544f4e3-a2c5-4333-bfd4-c7ffc49de733 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:31.666876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784db8f-c9b7-4fa6-bed9-278164273cfe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a57dc68aeb5482a86d5983b466d933d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:31.667677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784db8f-c9b7-4fa6-bed9-278164273cfe service glance] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:31.667967 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784db8f-c9b7-4fa6-bed9-278164273cfe service glance] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:31.668250 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784db8f-c9b7-4fa6-bed9-278164273cfe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:31.669898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a784db8f-c9b7-4fa6-bed9-278164273cfe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:31.724464 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:31.782723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784db8f-c9b7-4fa6-bed9-278164273cfe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:31.784228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784db8f-c9b7-4fa6-bed9-278164273cfe service glance] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:31.804274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 753/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:24:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:24:33.934487 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f15393-10d3-4bbb-bb81-fe6bc8fec927 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:33.935359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f15393-10d3-4bbb-bb81-fe6bc8fec927 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:33.935359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f15393-10d3-4bbb-bb81-fe6bc8fec927 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:33.937579 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 723/1476] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:24:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:33.945679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee4733-c475-4864-b002-02e3a9cc2f4a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:33.946150 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee4733-c475-4864-b002-02e3a9cc2f4a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:33.946265 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee4733-c475-4864-b002-02e3a9cc2f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:34.026944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5dee4733-c475-4864-b002-02e3a9cc2f4a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:34.028302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5dee4733-c475-4864-b002-02e3a9cc2f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:34.146107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 754/1477] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:24:34.172284 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f15393-10d3-4bbb-bb81-fe6bc8fec927 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:24:34.174667 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-39f15393-10d3-4bbb-bb81-fe6bc8fec927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:34.316453 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f15393-10d3-4bbb-bb81-fe6bc8fec927 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:34.365657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:34.413281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd0b7a-417e-4f21-a795-9a1ffb40f430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:34.413965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd0b7a-417e-4f21-a795-9a1ffb40f430 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:34.414237 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd0b7a-417e-4f21-a795-9a1ffb40f430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:34.414502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd0b7a-417e-4f21-a795-9a1ffb40f430 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:34.415244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd0b7a-417e-4f21-a795-9a1ffb40f430 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:34.417113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-8fcd0b7a-417e-4f21-a795-9a1ffb40f430 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:24:34.417113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 21 08:24:34.417113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: Jul 21 08:24:34.418265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd0b7a-417e-4f21-a795-9a1ffb40f430 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:34.437197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 724/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 08:24:34 2022] GET /identity/v3/projects => generated 2553 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:24:36.491325 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729f722-e041-47a6-b1b6-69f8ebfd79a2 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:36.491849 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729f722-e041-47a6-b1b6-69f8ebfd79a2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:36.491849 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729f722-e041-47a6-b1b6-69f8ebfd79a2 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:36.493248 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 755/1479] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:36.499918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c8dc0-f9e1-4396-85fa-3aaa56531d84 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:36.500360 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c8dc0-f9e1-4396-85fa-3aaa56531d84 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:36.500544 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c8dc0-f9e1-4396-85fa-3aaa56531d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:36.577176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ab6c8dc0-f9e1-4396-85fa-3aaa56531d84 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:36.578420 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ab6c8dc0-f9e1-4396-85fa-3aaa56531d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:36.696229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 725/1480] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:36.746585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729f722-e041-47a6-b1b6-69f8ebfd79a2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:24:36.748176 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a729f722-e041-47a6-b1b6-69f8ebfd79a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:36.758625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:36.916074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729f722-e041-47a6-b1b6-69f8ebfd79a2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:37.020148 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:37.057715 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e4ec8-f911-4706-9968-76d1b6f9dd43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:37.058414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e4ec8-f911-4706-9968-76d1b6f9dd43 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:37.058704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e4ec8-f911-4706-9968-76d1b6f9dd43 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:37.058981 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e4ec8-f911-4706-9968-76d1b6f9dd43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:37.060684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-121e4ec8-f911-4706-9968-76d1b6f9dd43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:37.162656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e4ec8-f911-4706-9968-76d1b6f9dd43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:37.164341 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e4ec8-f911-4706-9968-76d1b6f9dd43 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:37.184562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 756/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:24:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:24:39.451121 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0440b9-e7a0-4775-b39c-4f8cb9f15da4 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:39.451731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0440b9-e7a0-4775-b39c-4f8cb9f15da4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:39.451731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0440b9-e7a0-4775-b39c-4f8cb9f15da4 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:39.453475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 726/1482] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:39.459068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd250b-c2ac-4da6-99f1-f50aac616d08 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:39.459517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd250b-c2ac-4da6-99f1-f50aac616d08 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:39.459732 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd250b-c2ac-4da6-99f1-f50aac616d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:39.529946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-94cd250b-c2ac-4da6-99f1-f50aac616d08 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:39.531169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-94cd250b-c2ac-4da6-99f1-f50aac616d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:39.583529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:39.659404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 757/1483] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:39.701205 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0440b9-e7a0-4775-b39c-4f8cb9f15da4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:24:39.702763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ce0440b9-e7a0-4775-b39c-4f8cb9f15da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:39.734314 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:39.819507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0440b9-e7a0-4775-b39c-4f8cb9f15da4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:39.907470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e56e21-384b-481b-90db-a15e4761bceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:39.908160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e56e21-384b-481b-90db-a15e4761bceb service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:39.908442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e56e21-384b-481b-90db-a15e4761bceb service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:39.908718 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e56e21-384b-481b-90db-a15e4761bceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:39.910409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d4e56e21-384b-481b-90db-a15e4761bceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:39.993638 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:40.030630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e56e21-384b-481b-90db-a15e4761bceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:40.032133 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e56e21-384b-481b-90db-a15e4761bceb service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:40.050362 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 727/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:24:42.146098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92319316-eb7c-4ae5-9fc0-833e8896aa7d None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:42.146649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92319316-eb7c-4ae5-9fc0-833e8896aa7d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:42.146649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92319316-eb7c-4ae5-9fc0-833e8896aa7d None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:42.148114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 758/1485] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:42.154932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff41cd-52ed-41d0-bfe3-8b41f3fe803e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:42.155729 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff41cd-52ed-41d0-bfe3-8b41f3fe803e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:42.155876 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff41cd-52ed-41d0-bfe3-8b41f3fe803e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:42.238240 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-91ff41cd-52ed-41d0-bfe3-8b41f3fe803e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:42.239463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-91ff41cd-52ed-41d0-bfe3-8b41f3fe803e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:42.357968 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 728/1486] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:42.399816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92319316-eb7c-4ae5-9fc0-833e8896aa7d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:24:42.401868 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-92319316-eb7c-4ae5-9fc0-833e8896aa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:42.514585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92319316-eb7c-4ae5-9fc0-833e8896aa7d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:42.588110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:42.590234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0790fe-98e1-468d-ac81-7a6648df0aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:42.590923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0790fe-98e1-468d-ac81-7a6648df0aba service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:42.591209 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0790fe-98e1-468d-ac81-7a6648df0aba service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:42.591489 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0790fe-98e1-468d-ac81-7a6648df0aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:42.593862 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9f0790fe-98e1-468d-ac81-7a6648df0aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:42.713118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0790fe-98e1-468d-ac81-7a6648df0aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:42.714546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0790fe-98e1-468d-ac81-7a6648df0aba service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:42.734358 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 759/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:24:44.873731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b382f5-faa4-4d49-a59f-5c2e6bf5cac5 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:44.874191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b382f5-faa4-4d49-a59f-5c2e6bf5cac5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:44.874310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b382f5-faa4-4d49-a59f-5c2e6bf5cac5 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:44.875885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 729/1488] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:44.885369 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791b57c-e2a7-45f1-b0c8-7660688f550d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:44.885827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791b57c-e2a7-45f1-b0c8-7660688f550d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:44.886112 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791b57c-e2a7-45f1-b0c8-7660688f550d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:44.956862 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3791b57c-e2a7-45f1-b0c8-7660688f550d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:44.958087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3791b57c-e2a7-45f1-b0c8-7660688f550d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:45.023126 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:45.071419 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 760/1489] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:45.116214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b382f5-faa4-4d49-a59f-5c2e6bf5cac5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:24:45.118524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-28b382f5-faa4-4d49-a59f-5c2e6bf5cac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:45.161090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:45.237246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b382f5-faa4-4d49-a59f-5c2e6bf5cac5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:45.316822 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f41f0-6cde-4746-b91d-b737a7db6032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:45.317477 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f41f0-6cde-4746-b91d-b737a7db6032 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:45.317758 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f41f0-6cde-4746-b91d-b737a7db6032 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:45.318031 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f41f0-6cde-4746-b91d-b737a7db6032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:45.319709 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f12f41f0-6cde-4746-b91d-b737a7db6032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:45.403809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:45.436309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f41f0-6cde-4746-b91d-b737a7db6032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:45.437795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f41f0-6cde-4746-b91d-b737a7db6032 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:45.457432 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 730/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:24:47.705443 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e07e9-68a4-4c2d-8fdd-8ceea74e9d3f None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:47.706250 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e07e9-68a4-4c2d-8fdd-8ceea74e9d3f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:47.706250 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e07e9-68a4-4c2d-8fdd-8ceea74e9d3f None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:47.708425 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 761/1491] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 08:24:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:47.715746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59826e3d-26de-4985-834b-1897e1f39de7 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:47.716231 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59826e3d-26de-4985-834b-1897e1f39de7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:47.716325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59826e3d-26de-4985-834b-1897e1f39de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:47.783256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-59826e3d-26de-4985-834b-1897e1f39de7 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:47.784501 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-59826e3d-26de-4985-834b-1897e1f39de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:47.889248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 731/1492] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 08:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:47.938845 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e07e9-68a4-4c2d-8fdd-8ceea74e9d3f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:24:47.940497 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0e2e07e9-68a4-4c2d-8fdd-8ceea74e9d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:48.054691 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e07e9-68a4-4c2d-8fdd-8ceea74e9d3f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:48.131221 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84b350-8f6e-4938-b573-cae922e8db41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:48.131949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84b350-8f6e-4938-b573-cae922e8db41 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:48.132225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84b350-8f6e-4938-b573-cae922e8db41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:48.132497 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84b350-8f6e-4938-b573-cae922e8db41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:48.134473 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bc84b350-8f6e-4938-b573-cae922e8db41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:48.143715 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:48.256863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84b350-8f6e-4938-b573-cae922e8db41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:48.258662 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84b350-8f6e-4938-b573-cae922e8db41 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:48.279011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 762/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:24:57.887252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=82 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:58.276625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=50 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:20.013099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad025f-9c25-4c05-9bdf-5830007852f4 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:20.013720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad025f-9c25-4c05-9bdf-5830007852f4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:20.013720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad025f-9c25-4c05-9bdf-5830007852f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:20.102518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-15ad025f-9c25-4c05-9bdf-5830007852f4 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:20.103788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-15ad025f-9c25-4c05-9bdf-5830007852f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:20.211555 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 732/1494] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:20.220127 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0d4a7-2cdd-45b1-92bf-491d4281e6be None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:20.220658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0d4a7-2cdd-45b1-92bf-491d4281e6be None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:20.220658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0d4a7-2cdd-45b1-92bf-491d4281e6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:20.299501 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-32b0d4a7-2cdd-45b1-92bf-491d4281e6be None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:20.300684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-32b0d4a7-2cdd-45b1-92bf-491d4281e6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:20.412128 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 763/1495] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:26:20.417244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad025f-9c25-4c05-9bdf-5830007852f4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:20.418476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-15ad025f-9c25-4c05-9bdf-5830007852f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:20.430275 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad025f-9c25-4c05-9bdf-5830007852f4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:20.494871 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:20.530115 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552a6b1-1db7-45fe-9c32-51eb1e92a4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:20.530782 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552a6b1-1db7-45fe-9c32-51eb1e92a4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:20.531089 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552a6b1-1db7-45fe-9c32-51eb1e92a4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:20.531364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552a6b1-1db7-45fe-9c32-51eb1e92a4f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:20.532139 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552a6b1-1db7-45fe-9c32-51eb1e92a4f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:26:20.532439 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552a6b1-1db7-45fe-9c32-51eb1e92a4f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:20.533464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-d552a6b1-1db7-45fe-9c32-51eb1e92a4f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:26:20.533464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 21 08:26:20.533464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: Jul 21 08:26:20.534372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552a6b1-1db7-45fe-9c32-51eb1e92a4f5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:20.545880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 733/1496] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:26:20.554480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0d4a7-2cdd-45b1-92bf-491d4281e6be None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:20.563947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0d4a7-2cdd-45b1-92bf-491d4281e6be None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:20.638358 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:20.676787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346cfbe-e14f-4654-aea3-f5de4f4f98c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:20.677461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346cfbe-e14f-4654-aea3-f5de4f4f98c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:20.677921 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346cfbe-e14f-4654-aea3-f5de4f4f98c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:20.678186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346cfbe-e14f-4654-aea3-f5de4f4f98c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:20.678894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346cfbe-e14f-4654-aea3-f5de4f4f98c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:20.680743 dv-cinder-850320-1-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-f346cfbe-e14f-4654-aea3-f5de4f4f98c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:26:20.680743 dv-cinder-850320-1-smb devstack@keystone.service[80237]: warnings.warn(msg) Jul 21 08:26:20.680743 dv-cinder-850320-1-smb devstack@keystone.service[80237]: Jul 21 08:26:20.681993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346cfbe-e14f-4654-aea3-f5de4f4f98c7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:20.746241 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 764/1497] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:26:20 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:20.752374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552a6b1-1db7-45fe-9c32-51eb1e92a4f5 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:20.755047 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d552a6b1-1db7-45fe-9c32-51eb1e92a4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:20.797067 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552a6b1-1db7-45fe-9c32-51eb1e92a4f5 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:20.914819 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd620c-b2ad-4dee-8d05-4b57cc4e73c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:20.915494 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd620c-b2ad-4dee-8d05-4b57cc4e73c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:20.915801 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd620c-b2ad-4dee-8d05-4b57cc4e73c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:20.916072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd620c-b2ad-4dee-8d05-4b57cc4e73c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:20.916766 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd620c-b2ad-4dee-8d05-4b57cc4e73c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:20.917795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-36bd620c-b2ad-4dee-8d05-4b57cc4e73c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:26:20.917795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 21 08:26:20.917795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: Jul 21 08:26:20.918995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd620c-b2ad-4dee-8d05-4b57cc4e73c8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:20.960957 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 734/1498] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:26:20 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:20.965244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346cfbe-e14f-4654-aea3-f5de4f4f98c7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:20.966787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f346cfbe-e14f-4654-aea3-f5de4f4f98c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:21.039393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346cfbe-e14f-4654-aea3-f5de4f4f98c7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:21.132071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:21.145088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ee317-d5c2-4608-a769-3ebf7a3022fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:21.145776 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee317-d5c2-4608-a769-3ebf7a3022fb admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:21.146065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee317-d5c2-4608-a769-3ebf7a3022fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:21.146405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee317-d5c2-4608-a769-3ebf7a3022fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:21.147471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ee317-d5c2-4608-a769-3ebf7a3022fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:21.148539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-f59ee317-d5c2-4608-a769-3ebf7a3022fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:26:21.148539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: warnings.warn(msg) Jul 21 08:26:21.148539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: Jul 21 08:26:21.149456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ee317-d5c2-4608-a769-3ebf7a3022fb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:21.162793 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 765/1499] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:21.167075 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd620c-b2ad-4dee-8d05-4b57cc4e73c8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:21.168649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-36bd620c-b2ad-4dee-8d05-4b57cc4e73c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:21.180992 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd620c-b2ad-4dee-8d05-4b57cc4e73c8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:21.208522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:21.285403 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb9d6e-54ed-4138-bf41-2ee67ef42092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:21.286076 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb9d6e-54ed-4138-bf41-2ee67ef42092 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:21.286355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb9d6e-54ed-4138-bf41-2ee67ef42092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:21.286626 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb9d6e-54ed-4138-bf41-2ee67ef42092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:21.287461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb9d6e-54ed-4138-bf41-2ee67ef42092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:21.288542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-2edb9d6e-54ed-4138-bf41-2ee67ef42092 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:26:21.288542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 21 08:26:21.288542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: Jul 21 08:26:21.289434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb9d6e-54ed-4138-bf41-2ee67ef42092 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:21.302495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 735/1500] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:21.306803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ee317-d5c2-4608-a769-3ebf7a3022fb admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:21.308368 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f59ee317-d5c2-4608-a769-3ebf7a3022fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:21.342736 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ee317-d5c2-4608-a769-3ebf7a3022fb admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:21.447465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07552-acae-4e12-9a5c-bfa52785659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:21.448395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07552-acae-4e12-9a5c-bfa52785659c admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:21.448679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07552-acae-4e12-9a5c-bfa52785659c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:21.448957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07552-acae-4e12-9a5c-bfa52785659c admin admin] PATH_INFO: `/v3/projects/d83bd5534fb04a00aecf6ef70fe26d29/users/5c1ffc4b7ad340f4a95925b8f49e22e1/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:21.475658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e07552-acae-4e12-9a5c-bfa52785659c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83bd5534fb04a00aecf6ef70fe26d29, user_id=5c1ffc4b7ad340f4a95925b8f49e22e1, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:21.476718 dv-cinder-850320-1-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-77e07552-acae-4e12-9a5c-bfa52785659c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:26:21.476718 dv-cinder-850320-1-smb devstack@keystone.service[80237]: warnings.warn(msg) Jul 21 08:26:21.476718 dv-cinder-850320-1-smb devstack@keystone.service[80237]: Jul 21 08:26:21.478662 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e07552-acae-4e12-9a5c-bfa52785659c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:21.513845 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 766/1501] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:26:21 2022] PUT /identity/v3/projects/d83bd5534fb04a00aecf6ef70fe26d29/users/5c1ffc4b7ad340f4a95925b8f49e22e1/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:21.527017 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ba082-32a7-4065-8552-6ebf7af6d9fd None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:21.527309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ba082-32a7-4065-8552-6ebf7af6d9fd None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:21.527580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ba082-32a7-4065-8552-6ebf7af6d9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:21.584945 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-323ba082-32a7-4065-8552-6ebf7af6d9fd None None] MFA Rules not processed for user `5c1ffc4b7ad340f4a95925b8f49e22e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:21.586094 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-323ba082-32a7-4065-8552-6ebf7af6d9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:21.666150 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 736/1502] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:26:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:21.682221 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ac129-9e9d-42b3-9111-6222d8c7ccd9 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:21.682509 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ac129-9e9d-42b3-9111-6222d8c7ccd9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:21.682783 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ac129-9e9d-42b3-9111-6222d8c7ccd9 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:21.684234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 767/1503] 10.222.0.64 () {54 vars in 964 bytes} [Thu Jul 21 08:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:26:21.689124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebd490-2c2d-45ba-a65d-acf7483a4e2c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:21.689408 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebd490-2c2d-45ba-a65d-acf7483a4e2c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:21.689721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebd490-2c2d-45ba-a65d-acf7483a4e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:21.719580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:21.766718 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-51ebd490-2c2d-45ba-a65d-acf7483a4e2c None None] MFA Rules not processed for user `bd620e5fcb9c4b82865d1d0c508ce8c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:21.767959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-51ebd490-2c2d-45ba-a65d-acf7483a4e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:21.851521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 737/1504] 10.222.0.64 () {58 vars in 1061 bytes} [Thu Jul 21 08:26:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:26:21.863557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ac129-9e9d-42b3-9111-6222d8c7ccd9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:21.865806 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-db4ac129-9e9d-42b3-9111-6222d8c7ccd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:21.919345 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:21.986520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ac129-9e9d-42b3-9111-6222d8c7ccd9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:22.072786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a164651-21f5-41e3-8929-ad15a4c97836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:22.073724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a164651-21f5-41e3-8929-ad15a4c97836 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:22.074164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a164651-21f5-41e3-8929-ad15a4c97836 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:22.074580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a164651-21f5-41e3-8929-ad15a4c97836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:22.077241 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8a164651-21f5-41e3-8929-ad15a4c97836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:22.318944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a164651-21f5-41e3-8929-ad15a4c97836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:22.320383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a164651-21f5-41e3-8929-ad15a4c97836 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:22.323982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:22.339688 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 768/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:26:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:26:22.392176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a852edf-95e4-424f-a198-5869ee1f4ec3 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:22.392618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a852edf-95e4-424f-a198-5869ee1f4ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:22.392719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a852edf-95e4-424f-a198-5869ee1f4ec3 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:22.394067 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 738/1506] 10.222.0.64 () {52 vars in 829 bytes} [Thu Jul 21 08:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:26:22.398032 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a164651-21f5-41e3-8929-ad15a4c97836 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:22.399252 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8a164651-21f5-41e3-8929-ad15a4c97836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:22.504222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a164651-21f5-41e3-8929-ad15a4c97836 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:22.598285 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611024f1-b1b2-436a-8893-38723a6b4263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:22.599085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611024f1-b1b2-436a-8893-38723a6b4263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:22.599396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611024f1-b1b2-436a-8893-38723a6b4263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:22.599817 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611024f1-b1b2-436a-8893-38723a6b4263 admin admin] PATH_INFO: `/v3/users/5c1ffc4b7ad340f4a95925b8f49e22e1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:22.613143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611024f1-b1b2-436a-8893-38723a6b4263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1ffc4b7ad340f4a95925b8f49e22e1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:22.614200 dv-cinder-850320-1-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-611024f1-b1b2-436a-8893-38723a6b4263 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:26:22.614200 dv-cinder-850320-1-smb devstack@keystone.service[80237]: warnings.warn(msg) Jul 21 08:26:22.614200 dv-cinder-850320-1-smb devstack@keystone.service[80237]: Jul 21 08:26:22.615512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611024f1-b1b2-436a-8893-38723a6b4263 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:22.625421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:22.693454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-611024f1-b1b2-436a-8893-38723a6b4263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1ffc4b7ad340f4a95925b8f49e22e1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:22.694585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-611024f1-b1b2-436a-8893-38723a6b4263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1ffc4b7ad340f4a95925b8f49e22e1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:22.695138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-611024f1-b1b2-436a-8893-38723a6b4263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1ffc4b7ad340f4a95925b8f49e22e1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:22.714767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-611024f1-b1b2-436a-8893-38723a6b4263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1ffc4b7ad340f4a95925b8f49e22e1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:22.728547 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-611024f1-b1b2-436a-8893-38723a6b4263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1ffc4b7ad340f4a95925b8f49e22e1'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:22.754407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 769/1507] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:26:22 2022] DELETE /identity/v3/users/5c1ffc4b7ad340f4a95925b8f49e22e1 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:22.760299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc5cc9-387b-4902-86fd-25f2b32961f7 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:22.760690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc5cc9-387b-4902-86fd-25f2b32961f7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:22.761105 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc5cc9-387b-4902-86fd-25f2b32961f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:22.825872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-47dc5cc9-387b-4902-86fd-25f2b32961f7 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:22.827079 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-47dc5cc9-387b-4902-86fd-25f2b32961f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:22.910487 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:22.923318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 739/1508] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:22.933996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611024f1-b1b2-436a-8893-38723a6b4263 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:22.935259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-611024f1-b1b2-436a-8893-38723a6b4263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:23.046642 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611024f1-b1b2-436a-8893-38723a6b4263 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:23.110961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:23.132428 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452d11d-25b7-4ec7-beb1-c5c576f30043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:23.133089 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452d11d-25b7-4ec7-beb1-c5c576f30043 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:23.133384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452d11d-25b7-4ec7-beb1-c5c576f30043 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:23.133660 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452d11d-25b7-4ec7-beb1-c5c576f30043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:23.135290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8452d11d-25b7-4ec7-beb1-c5c576f30043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:23.255749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452d11d-25b7-4ec7-beb1-c5c576f30043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:23.258071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452d11d-25b7-4ec7-beb1-c5c576f30043 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:23.278459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 770/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:26:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:26:23.639964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc5cc9-387b-4902-86fd-25f2b32961f7 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:23.641206 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-47dc5cc9-387b-4902-86fd-25f2b32961f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:23.653436 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc5cc9-387b-4902-86fd-25f2b32961f7 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:23.754694 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d3639-75ee-4523-85ba-c02b234ee5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:23.755684 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d3639-75ee-4523-85ba-c02b234ee5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:23.755992 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d3639-75ee-4523-85ba-c02b234ee5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:23.756390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d3639-75ee-4523-85ba-c02b234ee5d3 admin admin] PATH_INFO: `/v3/projects/d83bd5534fb04a00aecf6ef70fe26d29` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:23.767243 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d3639-75ee-4523-85ba-c02b234ee5d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83bd5534fb04a00aecf6ef70fe26d29)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:23.768332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-aa2d3639-75ee-4523-85ba-c02b234ee5d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:26:23.768332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 21 08:26:23.768332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: Jul 21 08:26:23.769564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d3639-75ee-4523-85ba-c02b234ee5d3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:23.833535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aa2d3639-75ee-4523-85ba-c02b234ee5d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83bd5534fb04a00aecf6ef70fe26d29', 'request_id': 'req-aa2d3639-75ee-4523-85ba-c02b234ee5d3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:23.968342 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aa2d3639-75ee-4523-85ba-c02b234ee5d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83bd5534fb04a00aecf6ef70fe26d29', 'request_id': 'req-aa2d3639-75ee-4523-85ba-c02b234ee5d3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:23.979192 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aa2d3639-75ee-4523-85ba-c02b234ee5d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83bd5534fb04a00aecf6ef70fe26d29', 'request_id': 'req-aa2d3639-75ee-4523-85ba-c02b234ee5d3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:24.006452 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aa2d3639-75ee-4523-85ba-c02b234ee5d3 admin admin] The token cache is being invalidate because project d83bd5534fb04a00aecf6ef70fe26d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:26:24.006739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aa2d3639-75ee-4523-85ba-c02b234ee5d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:24.007292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-aa2d3639-75ee-4523-85ba-c02b234ee5d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:24.008697 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 740/1510] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:26:23 2022] DELETE /identity/v3/projects/d83bd5534fb04a00aecf6ef70fe26d29 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:33.275360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=62 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:34.003770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:14.764713 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a5df7-9230-4798-97f8-1d45e0f96c33 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:14.765294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a5df7-9230-4798-97f8-1d45e0f96c33 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:14.765294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a5df7-9230-4798-97f8-1d45e0f96c33 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:14.766576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 771/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:28:14.772604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4443-8374-4c15-b17c-ef53dff37a27 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:14.773333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4443-8374-4c15-b17c-ef53dff37a27 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:14.773504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4443-8374-4c15-b17c-ef53dff37a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:14.882500 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-41ec4443-8374-4c15-b17c-ef53dff37a27 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:14.882944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-41ec4443-8374-4c15-b17c-ef53dff37a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:15.010192 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 741/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:15.172209 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a5df7-9230-4798-97f8-1d45e0f96c33 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:15.174472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cf5a5df7-9230-4798-97f8-1d45e0f96c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:15.306619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a5df7-9230-4798-97f8-1d45e0f96c33 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:15.313169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029240e0-758d-43a0-bc64-5e8b56f6be0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:15.313818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029240e0-758d-43a0-bc64-5e8b56f6be0f service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:15.314098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029240e0-758d-43a0-bc64-5e8b56f6be0f service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:15.314392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029240e0-758d-43a0-bc64-5e8b56f6be0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:15.322881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029240e0-758d-43a0-bc64-5e8b56f6be0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:15.324499 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029240e0-758d-43a0-bc64-5e8b56f6be0f service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:15.334248 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 772/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:16.170830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496eeba-29ce-45f8-9232-9515a1f8641d None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:16.171721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496eeba-29ce-45f8-9232-9515a1f8641d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:16.171721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496eeba-29ce-45f8-9232-9515a1f8641d None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:16.174023 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 742/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:28:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:28:16.180259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a92ff6-624b-4492-b50a-65b561584420 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:16.181053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a92ff6-624b-4492-b50a-65b561584420 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:16.181194 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a92ff6-624b-4492-b50a-65b561584420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:16.204290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-28a92ff6-624b-4492-b50a-65b561584420 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:16.205504 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-28a92ff6-624b-4492-b50a-65b561584420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:16.214209 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 773/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:16.364564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496eeba-29ce-45f8-9232-9515a1f8641d None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:16.386615 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496eeba-29ce-45f8-9232-9515a1f8641d None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:16.393335 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db0be9-d959-43e8-86d5-a4127877cb9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:16.394017 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db0be9-d959-43e8-86d5-a4127877cb9a service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:16.394297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db0be9-d959-43e8-86d5-a4127877cb9a service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:16.394596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db0be9-d959-43e8-86d5-a4127877cb9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:16.403536 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db0be9-d959-43e8-86d5-a4127877cb9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:16.405265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db0be9-d959-43e8-86d5-a4127877cb9a service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:16.416205 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 743/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:18.102779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d5ee0-f64e-4da3-8b02-cdf1a20fbc51 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:18.103382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d5ee0-f64e-4da3-8b02-cdf1a20fbc51 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:18.103382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d5ee0-f64e-4da3-8b02-cdf1a20fbc51 None None] PATH_INFO: `/v3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:18.104852 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 774/1517] 10.222.0.61 () {54 vars in 925 bytes} [Thu Jul 21 08:28:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:28:18.111855 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411670d-e72b-46df-b451-3f378bcce8ef None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:18.112338 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411670d-e72b-46df-b451-3f378bcce8ef None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:18.112545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411670d-e72b-46df-b451-3f378bcce8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:18.173743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9411670d-e72b-46df-b451-3f378bcce8ef None None] MFA Rules not processed for user `b1146aa09d30458f9ab3b3bec8f94233`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:18.175022 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9411670d-e72b-46df-b451-3f378bcce8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:18.194548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:18.256274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 744/1518] 10.222.0.61 () {58 vars in 1015 bytes} [Thu Jul 21 08:28:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:22.217380 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f77e95-ce90-4ee5-84be-70de6f018080 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:22.217903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f77e95-ce90-4ee5-84be-70de6f018080 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:22.218092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f77e95-ce90-4ee5-84be-70de6f018080 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:22.219717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 775/1519] 10.222.0.64 () {54 vars in 961 bytes} [Thu Jul 21 08:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:28:22.225659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f44025-c910-4a47-b6b7-f0310ce824a2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:22.226095 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f44025-c910-4a47-b6b7-f0310ce824a2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:22.226278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f44025-c910-4a47-b6b7-f0310ce824a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:22.251401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-93f44025-c910-4a47-b6b7-f0310ce824a2 None None] MFA Rules not processed for user `b1146aa09d30458f9ab3b3bec8f94233`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:22.252647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-93f44025-c910-4a47-b6b7-f0310ce824a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:22.261653 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 745/1520] 10.222.0.64 () {58 vars in 1058 bytes} [Thu Jul 21 08:28:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:22.269743 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f77e95-ce90-4ee5-84be-70de6f018080 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:22.283882 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f77e95-ce90-4ee5-84be-70de6f018080 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:22.288993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84e37c-13ab-41ec-af29-1856d1514bf9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1146aa09d30458f9ab3b3bec8f94233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:22.289632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e37c-13ab-41ec-af29-1856d1514bf9 service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:22.289918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e37c-13ab-41ec-af29-1856d1514bf9 service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:22.290230 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e37c-13ab-41ec-af29-1856d1514bf9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:22.298807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84e37c-13ab-41ec-af29-1856d1514bf9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:22.300458 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84e37c-13ab-41ec-af29-1856d1514bf9 service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:22.310264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 776/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:27.660359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097ac48-783b-4dc5-bf7e-a4a830304461 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:27.660988 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097ac48-783b-4dc5-bf7e-a4a830304461 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:27.660988 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097ac48-783b-4dc5-bf7e-a4a830304461 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:27.662304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 746/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:28:27.668520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3659c-b053-4cdb-9c41-38a5c21b9013 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:27.669272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3659c-b053-4cdb-9c41-38a5c21b9013 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:27.669609 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3659c-b053-4cdb-9c41-38a5c21b9013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:27.693592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-73f3659c-b053-4cdb-9c41-38a5c21b9013 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:27.694808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-73f3659c-b053-4cdb-9c41-38a5c21b9013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:27.703302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 777/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:27.866849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097ac48-783b-4dc5-bf7e-a4a830304461 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:27.888215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097ac48-783b-4dc5-bf7e-a4a830304461 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:27.894246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564357e6-ea09-4fd3-adfa-d6c24e9bd78d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:27.894891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564357e6-ea09-4fd3-adfa-d6c24e9bd78d service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:27.895183 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564357e6-ea09-4fd3-adfa-d6c24e9bd78d service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:27.895460 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564357e6-ea09-4fd3-adfa-d6c24e9bd78d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:27.904515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564357e6-ea09-4fd3-adfa-d6c24e9bd78d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:27.906121 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564357e6-ea09-4fd3-adfa-d6c24e9bd78d service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:27.916736 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 747/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:28.734169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52092f-254d-497b-9d21-1684da6a4c22 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:28.734988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52092f-254d-497b-9d21-1684da6a4c22 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:28.734988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52092f-254d-497b-9d21-1684da6a4c22 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:28.737357 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 778/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:28:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:28:28.744225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7047a-fcf8-4beb-b331-72d5d80e1772 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:28.744667 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7047a-fcf8-4beb-b331-72d5d80e1772 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:28.744759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7047a-fcf8-4beb-b331-72d5d80e1772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:28.765339 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e4a7047a-fcf8-4beb-b331-72d5d80e1772 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:28.767065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e4a7047a-fcf8-4beb-b331-72d5d80e1772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:28.776974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 748/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:28.930596 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52092f-254d-497b-9d21-1684da6a4c22 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:28.950924 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52092f-254d-497b-9d21-1684da6a4c22 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:28.957436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3502d-90bb-46be-92ae-b06db95726a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:28.958080 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3502d-90bb-46be-92ae-b06db95726a9 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:28.958359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3502d-90bb-46be-92ae-b06db95726a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:28.958634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3502d-90bb-46be-92ae-b06db95726a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:28.967024 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3502d-90bb-46be-92ae-b06db95726a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:28.968661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3502d-90bb-46be-92ae-b06db95726a9 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:28.978800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 779/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:33.125959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e85d1-ebd1-4fa5-bc67-c7af5c84b177 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:33.126553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e85d1-ebd1-4fa5-bc67-c7af5c84b177 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:33.126553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e85d1-ebd1-4fa5-bc67-c7af5c84b177 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:33.128260 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 749/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:28:33.133632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25588861-a846-49fe-af7b-e6f8c12eb172 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:33.134082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25588861-a846-49fe-af7b-e6f8c12eb172 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:33.134221 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25588861-a846-49fe-af7b-e6f8c12eb172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:33.156177 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-25588861-a846-49fe-af7b-e6f8c12eb172 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:33.157391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-25588861-a846-49fe-af7b-e6f8c12eb172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:33.166735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 780/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:33.243834 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e85d1-ebd1-4fa5-bc67-c7af5c84b177 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:33.246710 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a06e85d1-ebd1-4fa5-bc67-c7af5c84b177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:33.338018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e85d1-ebd1-4fa5-bc67-c7af5c84b177 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:33.342285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32005c-82a8-4bc9-9ca0-c438c34f2606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:33.342920 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32005c-82a8-4bc9-9ca0-c438c34f2606 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:33.343201 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32005c-82a8-4bc9-9ca0-c438c34f2606 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:33.343474 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32005c-82a8-4bc9-9ca0-c438c34f2606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:33.357107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32005c-82a8-4bc9-9ca0-c438c34f2606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:33.359289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32005c-82a8-4bc9-9ca0-c438c34f2606 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:33.370219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 750/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:35.395234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387388f-db79-44b5-838f-d011df5c055b None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.395847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387388f-db79-44b5-838f-d011df5c055b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.395847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387388f-db79-44b5-838f-d011df5c055b None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.397253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 781/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:28:35.402778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bf736-155f-4633-bc11-718c96e5779c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.403225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bf736-155f-4633-bc11-718c96e5779c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.403328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bf736-155f-4633-bc11-718c96e5779c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.423527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-623bf736-155f-4633-bc11-718c96e5779c None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:35.424794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-623bf736-155f-4633-bc11-718c96e5779c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:35.433304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 751/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:35.472933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387388f-db79-44b5-838f-d011df5c055b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:35.489608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387388f-db79-44b5-838f-d011df5c055b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:35.493940 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae4c6d-7557-4a18-a457-bc4aff6820cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:35.494578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae4c6d-7557-4a18-a457-bc4aff6820cb service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.494833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae4c6d-7557-4a18-a457-bc4aff6820cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.495098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae4c6d-7557-4a18-a457-bc4aff6820cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.505248 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae4c6d-7557-4a18-a457-bc4aff6820cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:35.506687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae4c6d-7557-4a18-a457-bc4aff6820cb service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:35.516281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 782/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:39.183122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6856fbd-c0f0-40ff-8b6a-aca08325ce79 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:39.183761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6856fbd-c0f0-40ff-8b6a-aca08325ce79 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:39.183761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6856fbd-c0f0-40ff-8b6a-aca08325ce79 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:39.185073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 752/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:28:39.190521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb286c78-75e5-49e1-a4ed-cf42f2bab7af None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:39.190955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb286c78-75e5-49e1-a4ed-cf42f2bab7af None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:39.191076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb286c78-75e5-49e1-a4ed-cf42f2bab7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:39.210930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fb286c78-75e5-49e1-a4ed-cf42f2bab7af None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:39.212150 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fb286c78-75e5-49e1-a4ed-cf42f2bab7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:39.221404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 783/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:39.521515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6856fbd-c0f0-40ff-8b6a-aca08325ce79 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:39.524771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a6856fbd-c0f0-40ff-8b6a-aca08325ce79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:39.604594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:39.627781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6856fbd-c0f0-40ff-8b6a-aca08325ce79 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:39.632597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a2271-5a76-4f82-afb6-1e7f434dadc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:39.633232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a2271-5a76-4f82-afb6-1e7f434dadc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:39.633510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a2271-5a76-4f82-afb6-1e7f434dadc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:39.633785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a2271-5a76-4f82-afb6-1e7f434dadc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:39.643356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a2271-5a76-4f82-afb6-1e7f434dadc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:39.644867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a2271-5a76-4f82-afb6-1e7f434dadc5 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:39.654357 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 753/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:41.728557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924f065-e77c-4e7d-a6a7-ec6f92c544d2 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:41.729447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924f065-e77c-4e7d-a6a7-ec6f92c544d2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:41.729447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924f065-e77c-4e7d-a6a7-ec6f92c544d2 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:41.731735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 784/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:28:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:28:41.739756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14b90b-f89c-404a-bec7-166e3870d2f0 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:41.740196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14b90b-f89c-404a-bec7-166e3870d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:41.740305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14b90b-f89c-404a-bec7-166e3870d2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:41.760460 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1f14b90b-f89c-404a-bec7-166e3870d2f0 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:41.761661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1f14b90b-f89c-404a-bec7-166e3870d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:41.770801 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 754/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:42.085940 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924f065-e77c-4e7d-a6a7-ec6f92c544d2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:42.088547 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8924f065-e77c-4e7d-a6a7-ec6f92c544d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:42.105963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924f065-e77c-4e7d-a6a7-ec6f92c544d2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:42.110202 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b8685-1090-41d8-9c4d-b04902e5f696 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:42.110846 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b8685-1090-41d8-9c4d-b04902e5f696 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:42.111132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b8685-1090-41d8-9c4d-b04902e5f696 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:42.111488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b8685-1090-41d8-9c4d-b04902e5f696 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:42.121329 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b8685-1090-41d8-9c4d-b04902e5f696 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:42.122790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b8685-1090-41d8-9c4d-b04902e5f696 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:42.133390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 785/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:51.755536 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=11 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:52.129182 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:16.878383 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beba5f-2f2f-4b30-8de7-d20bb826fc86 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:16.878979 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beba5f-2f2f-4b30-8de7-d20bb826fc86 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:16.878979 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beba5f-2f2f-4b30-8de7-d20bb826fc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:16.880305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f04b1b-2092-44ed-a44c-7aa57c48fcc5 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:16.880725 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f04b1b-2092-44ed-a44c-7aa57c48fcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:16.882130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f04b1b-2092-44ed-a44c-7aa57c48fcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:16.935003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-87beba5f-2f2f-4b30-8de7-d20bb826fc86 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:16.943622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-95f04b1b-2092-44ed-a44c-7aa57c48fcc5 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:16.943833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-87beba5f-2f2f-4b30-8de7-d20bb826fc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:16.943929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-95f04b1b-2092-44ed-a44c-7aa57c48fcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:16.960008 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 755/1540] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:16.961886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a6a5e-26df-4af7-bfcc-3ed9a38819f9 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:16.967325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a6a5e-26df-4af7-bfcc-3ed9a38819f9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:16.968180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a6a5e-26df-4af7-bfcc-3ed9a38819f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.001576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 786/1541] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:17.004742 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d50f7d-8f10-41c5-b139-a82e35dc4d43 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.014153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d50f7d-8f10-41c5-b139-a82e35dc4d43 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.014790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d50f7d-8f10-41c5-b139-a82e35dc4d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.022454 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-d93a6a5e-26df-4af7-bfcc-3ed9a38819f9 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:17.029486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d93a6a5e-26df-4af7-bfcc-3ed9a38819f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.069938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 756/1542] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:17.072724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7c3ca-ff75-4757-ba02-564caa49936d None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.080479 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7c3ca-ff75-4757-ba02-564caa49936d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.081524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7c3ca-ff75-4757-ba02-564caa49936d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.090516 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d6d50f7d-8f10-41c5-b139-a82e35dc4d43 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:17.094191 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d6d50f7d-8f10-41c5-b139-a82e35dc4d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.114135 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 787/1543] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:17.117764 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83221d-e090-40f2-b77e-caf3b606c02f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.118387 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83221d-e090-40f2-b77e-caf3b606c02f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.118873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83221d-e090-40f2-b77e-caf3b606c02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.133727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-60b7c3ca-ff75-4757-ba02-564caa49936d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:17.136386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-60b7c3ca-ff75-4757-ba02-564caa49936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.165417 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 757/1544] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:17.175631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c386f7c-0544-4079-a9e8-cecc15a0e31f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.175631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c386f7c-0544-4079-a9e8-cecc15a0e31f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.175631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c386f7c-0544-4079-a9e8-cecc15a0e31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.175988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1d83221d-e090-40f2-b77e-caf3b606c02f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:17.179619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1d83221d-e090-40f2-b77e-caf3b606c02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.218897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 788/1545] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:17.223784 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83221d-e090-40f2-b77e-caf3b606c02f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.236088 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2c386f7c-0544-4079-a9e8-cecc15a0e31f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:17.242024 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83221d-e090-40f2-b77e-caf3b606c02f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:17.242312 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2c386f7c-0544-4079-a9e8-cecc15a0e31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.260077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf3022-aa23-4daa-abfc-fc1fcf29ad34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:17.261683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf3022-aa23-4daa-abfc-fc1fcf29ad34 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.262182 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf3022-aa23-4daa-abfc-fc1fcf29ad34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.262672 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf3022-aa23-4daa-abfc-fc1fcf29ad34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.263642 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf3022-aa23-4daa-abfc-fc1fcf29ad34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:17.263774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 758/1546] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:17.264306 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf3022-aa23-4daa-abfc-fc1fcf29ad34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:17.265247 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b93de-707e-4430-9b47-e304e4eef28f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.265537 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b93de-707e-4430-9b47-e304e4eef28f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.265820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b93de-707e-4430-9b47-e304e4eef28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.266462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-c4bf3022-aa23-4daa-abfc-fc1fcf29ad34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:30:17.266462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: warnings.warn(msg) Jul 21 08:30:17.266462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: Jul 21 08:30:17.267778 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf3022-aa23-4daa-abfc-fc1fcf29ad34 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:17.287457 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 789/1547] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:17.288711 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf3022-aa23-4daa-abfc-fc1fcf29ad34 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.297284 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-bc9b93de-707e-4430-9b47-e304e4eef28f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:17.298514 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bc9b93de-707e-4430-9b47-e304e4eef28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.300751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf3022-aa23-4daa-abfc-fc1fcf29ad34 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:17.306047 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a09dcd-d3cd-467e-9456-194be206a191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:17.306951 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a09dcd-d3cd-467e-9456-194be206a191 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.307473 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a09dcd-d3cd-467e-9456-194be206a191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.307993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a09dcd-d3cd-467e-9456-194be206a191 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.308309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 759/1548] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:17.309158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a09dcd-d3cd-467e-9456-194be206a191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:17.309590 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41d9a2-e3b1-4731-bdc3-7d67e9f492c2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.309877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a09dcd-d3cd-467e-9456-194be206a191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:17.310000 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41d9a2-e3b1-4731-bdc3-7d67e9f492c2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.310184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41d9a2-e3b1-4731-bdc3-7d67e9f492c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.312165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a09dcd-d3cd-467e-9456-194be206a191 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:17.329917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2e41d9a2-e3b1-4731-bdc3-7d67e9f492c2 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:17.331128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2e41d9a2-e3b1-4731-bdc3-7d67e9f492c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.332212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 790/1549] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:17.333382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a09dcd-d3cd-467e-9456-194be206a191 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.339928 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 760/1550] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:17.341235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f49b63-4fe4-4499-90fd-19104b37a5ff None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.341523 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f49b63-4fe4-4499-90fd-19104b37a5ff None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.341799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f49b63-4fe4-4499-90fd-19104b37a5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.348570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a09dcd-d3cd-467e-9456-194be206a191 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:17.354475 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf954c6-2f8d-40c1-825f-a276592f5268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:17.355566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf954c6-2f8d-40c1-825f-a276592f5268 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.356328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf954c6-2f8d-40c1-825f-a276592f5268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.356852 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf954c6-2f8d-40c1-825f-a276592f5268 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.357780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf954c6-2f8d-40c1-825f-a276592f5268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:17.358300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf954c6-2f8d-40c1-825f-a276592f5268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:17.360994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf954c6-2f8d-40c1-825f-a276592f5268 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:17.364086 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-85f49b63-4fe4-4499-90fd-19104b37a5ff None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:17.365260 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-85f49b63-4fe4-4499-90fd-19104b37a5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.374167 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 761/1551] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:17.375550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 791/1552] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:17.375734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366a05-d52a-4412-a001-600676b94035 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.376006 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366a05-d52a-4412-a001-600676b94035 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.376279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366a05-d52a-4412-a001-600676b94035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.376641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf954c6-2f8d-40c1-825f-a276592f5268 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.389446 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf954c6-2f8d-40c1-825f-a276592f5268 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:17.394960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452b3ca-37e4-45a0-bdaf-f04f45ae288c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:17.395678 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452b3ca-37e4-45a0-bdaf-f04f45ae288c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.395955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452b3ca-37e4-45a0-bdaf-f04f45ae288c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.396234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452b3ca-37e4-45a0-bdaf-f04f45ae288c admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.396940 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452b3ca-37e4-45a0-bdaf-f04f45ae288c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:17.398865 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452b3ca-37e4-45a0-bdaf-f04f45ae288c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:17.399193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-d4366a05-d52a-4412-a001-600676b94035 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:17.400439 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d4366a05-d52a-4412-a001-600676b94035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.411949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 762/1553] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:17.414149 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a771ea-70f0-4565-855f-7ae59bfa354f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.414421 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a771ea-70f0-4565-855f-7ae59bfa354f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.414771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a771ea-70f0-4565-855f-7ae59bfa354f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.437478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-56a771ea-70f0-4565-855f-7ae59bfa354f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:17.438651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-56a771ea-70f0-4565-855f-7ae59bfa354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.451120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 792/1554] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/projects => generated 405 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:17.451120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7aeef4-8568-48b9-9a33-7e86b4d735de None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.451120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7aeef4-8568-48b9-9a33-7e86b4d735de None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.451120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7aeef4-8568-48b9-9a33-7e86b4d735de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.452608 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 763/1555] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:17.453955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a771ea-70f0-4565-855f-7ae59bfa354f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.465378 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a771ea-70f0-4565-855f-7ae59bfa354f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:17.472355 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-de7aeef4-8568-48b9-9a33-7e86b4d735de None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:17.473666 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-de7aeef4-8568-48b9-9a33-7e86b4d735de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.531214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff0d3b-b93d-46a6-87dd-668f56f3179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:17.531903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff0d3b-b93d-46a6-87dd-668f56f3179b admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.532189 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff0d3b-b93d-46a6-87dd-668f56f3179b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.532462 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff0d3b-b93d-46a6-87dd-668f56f3179b admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.533156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff0d3b-b93d-46a6-87dd-668f56f3179b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:17.534191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-f7ff0d3b-b93d-46a6-87dd-668f56f3179b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:30:17.534191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 21 08:30:17.534191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: Jul 21 08:30:17.535532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff0d3b-b93d-46a6-87dd-668f56f3179b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:17.541810 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 793/1556] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:17.543124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e550b0-6b55-4da5-83d7-edfde85ac1f3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.543411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e550b0-6b55-4da5-83d7-edfde85ac1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.543807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e550b0-6b55-4da5-83d7-edfde85ac1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.565952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 764/1557] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/projects => generated 355 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:17.567097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c10d69-3437-44e1-9098-8767b813c302 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.567385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c10d69-3437-44e1-9098-8767b813c302 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.567687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c10d69-3437-44e1-9098-8767b813c302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.571810 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d8e550b0-6b55-4da5-83d7-edfde85ac1f3 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:17.572893 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d8e550b0-6b55-4da5-83d7-edfde85ac1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.589068 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f3c10d69-3437-44e1-9098-8767b813c302 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:17.590288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f3c10d69-3437-44e1-9098-8767b813c302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.641717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 794/1558] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:17.642896 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e550b0-6b55-4da5-83d7-edfde85ac1f3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.653671 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e550b0-6b55-4da5-83d7-edfde85ac1f3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:17.663214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 765/1559] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:17.663214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c10d69-3437-44e1-9098-8767b813c302 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.664796 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f242-3522-4da9-a204-aaed0b1f72f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:17.666087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f242-3522-4da9-a204-aaed0b1f72f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.666666 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f242-3522-4da9-a204-aaed0b1f72f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.667181 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f242-3522-4da9-a204-aaed0b1f72f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.668527 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29f242-3522-4da9-a204-aaed0b1f72f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:17.669569 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c10d69-3437-44e1-9098-8767b813c302 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:17.672833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29f242-3522-4da9-a204-aaed0b1f72f9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:17.676387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999bf32-7573-4086-8e6d-83e660fbe3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:17.678562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999bf32-7573-4086-8e6d-83e660fbe3ca admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.678562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999bf32-7573-4086-8e6d-83e660fbe3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.680799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999bf32-7573-4086-8e6d-83e660fbe3ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.681619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999bf32-7573-4086-8e6d-83e660fbe3ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:17.681938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999bf32-7573-4086-8e6d-83e660fbe3ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:17.683569 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999bf32-7573-4086-8e6d-83e660fbe3ca admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:17.688243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:17.697481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 766/1560] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:17.698535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999bf32-7573-4086-8e6d-83e660fbe3ca admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.709819 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999bf32-7573-4086-8e6d-83e660fbe3ca admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:17.714497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150a1e0-2b83-48a9-b344-f2881c7c7bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:17.715158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150a1e0-2b83-48a9-b344-f2881c7c7bea admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.715439 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150a1e0-2b83-48a9-b344-f2881c7c7bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.715744 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150a1e0-2b83-48a9-b344-f2881c7c7bea admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.716432 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150a1e0-2b83-48a9-b344-f2881c7c7bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:17.717378 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 795/1561] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/projects => generated 391 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:17.718145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f242-3522-4da9-a204-aaed0b1f72f9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.718828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150a1e0-2b83-48a9-b344-f2881c7c7bea admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:17.729560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:17.741995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 767/1562] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/users => generated 303 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:17.743128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978ba2c-ab08-4a47-bc8a-27f87a8a70cc None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.743412 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978ba2c-ab08-4a47-bc8a-27f87a8a70cc None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.743781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978ba2c-ab08-4a47-bc8a-27f87a8a70cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.762382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9978ba2c-ab08-4a47-bc8a-27f87a8a70cc None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:17.763583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9978ba2c-ab08-4a47-bc8a-27f87a8a70cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.797470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f242-3522-4da9-a204-aaed0b1f72f9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:17.802634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e65b8-5cba-4f94-ae5e-8abed7d5ac3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:17.803393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e65b8-5cba-4f94-ae5e-8abed7d5ac3a admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.803830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e65b8-5cba-4f94-ae5e-8abed7d5ac3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.804197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e65b8-5cba-4f94-ae5e-8abed7d5ac3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.805208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e65b8-5cba-4f94-ae5e-8abed7d5ac3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:17.805584 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e65b8-5cba-4f94-ae5e-8abed7d5ac3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:17.807317 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e65b8-5cba-4f94-ae5e-8abed7d5ac3a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:17.820249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 796/1563] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:17.821244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e65b8-5cba-4f94-ae5e-8abed7d5ac3a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.835412 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e65b8-5cba-4f94-ae5e-8abed7d5ac3a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:17.847112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 768/1564] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:17.847313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037d44a-a812-419c-8b6a-e5ee7e2222f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:17.847446 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978ba2c-ab08-4a47-bc8a-27f87a8a70cc None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.847569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037d44a-a812-419c-8b6a-e5ee7e2222f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.847569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037d44a-a812-419c-8b6a-e5ee7e2222f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.847569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037d44a-a812-419c-8b6a-e5ee7e2222f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.847569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037d44a-a812-419c-8b6a-e5ee7e2222f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:17.847569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-5037d44a-a812-419c-8b6a-e5ee7e2222f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:30:17.847569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: warnings.warn(msg) Jul 21 08:30:17.847569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: Jul 21 08:30:17.848191 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037d44a-a812-419c-8b6a-e5ee7e2222f2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:17.860392 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978ba2c-ab08-4a47-bc8a-27f87a8a70cc None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:17.866077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fbd96-d266-4059-8b53-26c77da1f7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:17.867030 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fbd96-d266-4059-8b53-26c77da1f7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.867146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fbd96-d266-4059-8b53-26c77da1f7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.867514 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fbd96-d266-4059-8b53-26c77da1f7a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.868356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fbd96-d266-4059-8b53-26c77da1f7a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:17.868732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fbd96-d266-4059-8b53-26c77da1f7a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:17.871189 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 797/1565] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/users => generated 278 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:17.872481 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037d44a-a812-419c-8b6a-e5ee7e2222f2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.880495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fbd96-d266-4059-8b53-26c77da1f7a0 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:17.886615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037d44a-a812-419c-8b6a-e5ee7e2222f2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:17.891894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03135e-11d7-45a3-8a92-97c899bcf74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:17.892791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03135e-11d7-45a3-8a92-97c899bcf74d admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.893075 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03135e-11d7-45a3-8a92-97c899bcf74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.893345 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03135e-11d7-45a3-8a92-97c899bcf74d admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.894266 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 769/1566] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:17.894382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03135e-11d7-45a3-8a92-97c899bcf74d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:17.894382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03135e-11d7-45a3-8a92-97c899bcf74d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:17.896394 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03135e-11d7-45a3-8a92-97c899bcf74d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:17.896876 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fbd96-d266-4059-8b53-26c77da1f7a0 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.908748 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fbd96-d266-4059-8b53-26c77da1f7a0 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:17.911749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 798/1567] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:17.911749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03135e-11d7-45a3-8a92-97c899bcf74d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.917917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0a1b8-524e-47f3-a25a-0bd7af59d2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:17.918596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0a1b8-524e-47f3-a25a-0bd7af59d2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.918884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0a1b8-524e-47f3-a25a-0bd7af59d2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.919293 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0a1b8-524e-47f3-a25a-0bd7af59d2e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.920083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0a1b8-524e-47f3-a25a-0bd7af59d2e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:17.922172 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03135e-11d7-45a3-8a92-97c899bcf74d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:17.922571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0a1b8-524e-47f3-a25a-0bd7af59d2e9 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:17.927418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a4bc8-91ed-49b0-ad0a-be5832d9032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:17.928118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a4bc8-91ed-49b0-ad0a-be5832d9032d admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.928413 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a4bc8-91ed-49b0-ad0a-be5832d9032d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.928705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a4bc8-91ed-49b0-ad0a-be5832d9032d admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.929395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a4bc8-91ed-49b0-ad0a-be5832d9032d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:17.931381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a4bc8-91ed-49b0-ad0a-be5832d9032d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:17.951379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 770/1568] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:17.952864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0a1b8-524e-47f3-a25a-0bd7af59d2e9 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.955704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 799/1569] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:17.955704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a4bc8-91ed-49b0-ad0a-be5832d9032d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.973152 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a4bc8-91ed-49b0-ad0a-be5832d9032d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.070565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0a1b8-524e-47f3-a25a-0bd7af59d2e9 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.070720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5714c00-535f-4c3b-8408-e467891ed26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.070720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5714c00-535f-4c3b-8408-e467891ed26d admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.070720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5714c00-535f-4c3b-8408-e467891ed26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.070720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5714c00-535f-4c3b-8408-e467891ed26d admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.071054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5714c00-535f-4c3b-8408-e467891ed26d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.071139 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a50f23-b4f3-42d6-be90-1f9ac588d580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.071246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5714c00-535f-4c3b-8408-e467891ed26d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.071334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a50f23-b4f3-42d6-be90-1f9ac588d580 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.071334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a50f23-b4f3-42d6-be90-1f9ac588d580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.071334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a50f23-b4f3-42d6-be90-1f9ac588d580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.071334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a50f23-b4f3-42d6-be90-1f9ac588d580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.071334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a50f23-b4f3-42d6-be90-1f9ac588d580 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.071334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 771/1570] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:18.071780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a50f23-b4f3-42d6-be90-1f9ac588d580 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.078423 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a50f23-b4f3-42d6-be90-1f9ac588d580 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.083290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fc826-cdc0-419b-8b94-df8e53a0a7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.084022 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fc826-cdc0-419b-8b94-df8e53a0a7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.085539 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fc826-cdc0-419b-8b94-df8e53a0a7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.085539 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fc826-cdc0-419b-8b94-df8e53a0a7f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.085539 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fc826-cdc0-419b-8b94-df8e53a0a7f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:18.085804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fc826-cdc0-419b-8b94-df8e53a0a7f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.087314 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fc826-cdc0-419b-8b94-df8e53a0a7f9 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.098512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 800/1571] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:17 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:18.099703 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5714c00-535f-4c3b-8408-e467891ed26d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.102827 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 772/1572] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:18.103899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fc826-cdc0-419b-8b94-df8e53a0a7f9 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.116041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fc826-cdc0-419b-8b94-df8e53a0a7f9 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.128993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:18.164169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:18.176551 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5714c00-535f-4c3b-8408-e467891ed26d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.181571 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72d3e4-1453-4467-9814-9795bf061e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.182357 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72d3e4-1453-4467-9814-9795bf061e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.182643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72d3e4-1453-4467-9814-9795bf061e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.183030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72d3e4-1453-4467-9814-9795bf061e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.183804 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72d3e4-1453-4467-9814-9795bf061e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.185263 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e7ea3-7294-4a23-ac20-68ad18f051ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.185461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72d3e4-1453-4467-9814-9795bf061e88 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.185942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e7ea3-7294-4a23-ac20-68ad18f051ca admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.186200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e7ea3-7294-4a23-ac20-68ad18f051ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.186494 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e7ea3-7294-4a23-ac20-68ad18f051ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.187274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e7ea3-7294-4a23-ac20-68ad18f051ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.189386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e7ea3-7294-4a23-ac20-68ad18f051ca admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.196256 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 801/1573] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:18.197100 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72d3e4-1453-4467-9814-9795bf061e88 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.207693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72d3e4-1453-4467-9814-9795bf061e88 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.212814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e37321-e4b5-423e-a13c-2b410ebf5785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.213471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e37321-e4b5-423e-a13c-2b410ebf5785 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.213762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e37321-e4b5-423e-a13c-2b410ebf5785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.214061 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e37321-e4b5-423e-a13c-2b410ebf5785 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.214721 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e37321-e4b5-423e-a13c-2b410ebf5785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.216669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e37321-e4b5-423e-a13c-2b410ebf5785 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.217994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 773/1574] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:18 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:18.218674 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e7ea3-7294-4a23-ac20-68ad18f051ca admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.255810 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 802/1575] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:18 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:18.256866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e37321-e4b5-423e-a13c-2b410ebf5785 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.293997 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e7ea3-7294-4a23-ac20-68ad18f051ca admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.319787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e37321-e4b5-423e-a13c-2b410ebf5785 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.325068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3ce27-7d35-4239-8f91-9d75afa89483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.325742 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3ce27-7d35-4239-8f91-9d75afa89483 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.326025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3ce27-7d35-4239-8f91-9d75afa89483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.326303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3ce27-7d35-4239-8f91-9d75afa89483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.327027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3ce27-7d35-4239-8f91-9d75afa89483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.328924 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3ce27-7d35-4239-8f91-9d75afa89483 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.341013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 803/1576] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:18.341853 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3ce27-7d35-4239-8f91-9d75afa89483 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.352377 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3ce27-7d35-4239-8f91-9d75afa89483 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.357971 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eade5be-c946-4584-82d8-7b9aa199d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.359013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eade5be-c946-4584-82d8-7b9aa199d0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.359299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eade5be-c946-4584-82d8-7b9aa199d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.359764 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eade5be-c946-4584-82d8-7b9aa199d0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.360502 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eade5be-c946-4584-82d8-7b9aa199d0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.362122 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eade5be-c946-4584-82d8-7b9aa199d0a1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.362837 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f709991-3b15-437e-8d76-3b38c85835be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.363530 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f709991-3b15-437e-8d76-3b38c85835be admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.363857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f709991-3b15-437e-8d76-3b38c85835be admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.364137 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f709991-3b15-437e-8d76-3b38c85835be admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.364853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f709991-3b15-437e-8d76-3b38c85835be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.366778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f709991-3b15-437e-8d76-3b38c85835be admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.376469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 804/1577] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:18.377309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eade5be-c946-4584-82d8-7b9aa199d0a1 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.391133 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eade5be-c946-4584-82d8-7b9aa199d0a1 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.394592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 774/1578] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:18 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:18.394592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f709991-3b15-437e-8d76-3b38c85835be admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.396628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a45a0c-7540-40f6-8473-d542bb39cd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.397625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a45a0c-7540-40f6-8473-d542bb39cd7a admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.398094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a45a0c-7540-40f6-8473-d542bb39cd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.398440 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a45a0c-7540-40f6-8473-d542bb39cd7a admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.399874 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a45a0c-7540-40f6-8473-d542bb39cd7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.402077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a45a0c-7540-40f6-8473-d542bb39cd7a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.406862 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f709991-3b15-437e-8d76-3b38c85835be admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.412024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d71f4-e616-40b6-82ea-fcf77c87d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.412854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d71f4-e616-40b6-82ea-fcf77c87d745 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.413196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d71f4-e616-40b6-82ea-fcf77c87d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.413579 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d71f4-e616-40b6-82ea-fcf77c87d745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.414561 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d71f4-e616-40b6-82ea-fcf77c87d745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.416949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d71f4-e616-40b6-82ea-fcf77c87d745 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.425739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 805/1579] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:18 2022] POST /identity/v3/users => generated 285 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:18.426911 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a45a0c-7540-40f6-8473-d542bb39cd7a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.439185 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a45a0c-7540-40f6-8473-d542bb39cd7a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.445981 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273f977-e0b1-44c2-9073-7af6fe320427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.446671 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273f977-e0b1-44c2-9073-7af6fe320427 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.446960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273f977-e0b1-44c2-9073-7af6fe320427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.447239 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273f977-e0b1-44c2-9073-7af6fe320427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.448010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273f977-e0b1-44c2-9073-7af6fe320427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.450552 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273f977-e0b1-44c2-9073-7af6fe320427 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.454228 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 775/1580] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:18 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:18.458394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d71f4-e616-40b6-82ea-fcf77c87d745 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.462169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 806/1581] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:18.462959 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273f977-e0b1-44c2-9073-7af6fe320427 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.474059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273f977-e0b1-44c2-9073-7af6fe320427 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.511702 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:18.530278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d71f4-e616-40b6-82ea-fcf77c87d745 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.532460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:18.537709 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796854d0-558e-4084-a4c1-79f5bff30bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.538647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796854d0-558e-4084-a4c1-79f5bff30bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.539165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796854d0-558e-4084-a4c1-79f5bff30bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.539733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796854d0-558e-4084-a4c1-79f5bff30bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.540686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796854d0-558e-4084-a4c1-79f5bff30bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.543220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796854d0-558e-4084-a4c1-79f5bff30bb4 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.546862 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee9139-a597-4006-a9da-a9c71777b4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.547973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9139-a597-4006-a9da-a9c71777b4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.548424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9139-a597-4006-a9da-a9c71777b4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.548736 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9139-a597-4006-a9da-a9c71777b4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.549415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee9139-a597-4006-a9da-a9c71777b4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.551396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee9139-a597-4006-a9da-a9c71777b4b5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.571920 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 776/1582] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:18 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:18.572343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 807/1583] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:18 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:18.573005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796854d0-558e-4084-a4c1-79f5bff30bb4 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.573130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee9139-a597-4006-a9da-a9c71777b4b5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.583111 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee9139-a597-4006-a9da-a9c71777b4b5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.587831 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796854d0-558e-4084-a4c1-79f5bff30bb4 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.588269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23eb898-0a45-4120-ba71-a391ded6fe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.589162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23eb898-0a45-4120-ba71-a391ded6fe36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.589444 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23eb898-0a45-4120-ba71-a391ded6fe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.589819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23eb898-0a45-4120-ba71-a391ded6fe36 admin admin] PATH_INFO: `/v3/projects/33d537b717724273a4d7a4d2e6a95782/users/2f64974821e049dd95c8cc5f17fcdf7e/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.592756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a3ef0-be87-4ae7-9838-b410602d91ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.593776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a3ef0-be87-4ae7-9838-b410602d91ae admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.594071 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a3ef0-be87-4ae7-9838-b410602d91ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.594356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a3ef0-be87-4ae7-9838-b410602d91ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.595103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a3ef0-be87-4ae7-9838-b410602d91ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.596769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a3ef0-be87-4ae7-9838-b410602d91ae admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.610581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23eb898-0a45-4120-ba71-a391ded6fe36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d537b717724273a4d7a4d2e6a95782, user_id=2f64974821e049dd95c8cc5f17fcdf7e, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.610776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 777/1584] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:18.610776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a3ef0-be87-4ae7-9838-b410602d91ae admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.610965 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23eb898-0a45-4120-ba71-a391ded6fe36 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.623088 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a3ef0-be87-4ae7-9838-b410602d91ae admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.627349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 808/1585] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:18 2022] PUT /identity/v3/projects/33d537b717724273a4d7a4d2e6a95782/users/2f64974821e049dd95c8cc5f17fcdf7e/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:18.628435 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23eb898-0a45-4120-ba71-a391ded6fe36 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.687203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9559690-1418-498e-9092-0bf39fb2a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.688103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9559690-1418-498e-9092-0bf39fb2a57d admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.688384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9559690-1418-498e-9092-0bf39fb2a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.688711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9559690-1418-498e-9092-0bf39fb2a57d admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.689393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9559690-1418-498e-9092-0bf39fb2a57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.691119 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9559690-1418-498e-9092-0bf39fb2a57d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.694162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23eb898-0a45-4120-ba71-a391ded6fe36 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.701002 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10709b-90fc-401d-93e9-d6e4b731a8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.701774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 778/1586] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:18.701923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10709b-90fc-401d-93e9-d6e4b731a8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.702456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10709b-90fc-401d-93e9-d6e4b731a8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.702761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9559690-1418-498e-9092-0bf39fb2a57d admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.702933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10709b-90fc-401d-93e9-d6e4b731a8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.705009 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10709b-90fc-401d-93e9-d6e4b731a8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.705792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10709b-90fc-401d-93e9-d6e4b731a8f6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.713085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9559690-1418-498e-9092-0bf39fb2a57d admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.717758 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a76120-8cc2-4043-8789-2f289abea644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.718068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 809/1587] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:18.718946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10709b-90fc-401d-93e9-d6e4b731a8f6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.723384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a76120-8cc2-4043-8789-2f289abea644 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.723716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a76120-8cc2-4043-8789-2f289abea644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.724042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a76120-8cc2-4043-8789-2f289abea644 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.724732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a76120-8cc2-4043-8789-2f289abea644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.729340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10709b-90fc-401d-93e9-d6e4b731a8f6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.730052 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a76120-8cc2-4043-8789-2f289abea644 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.735626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f61ea-3ad9-4e8c-a3ff-64572a7b1dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.737152 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f61ea-3ad9-4e8c-a3ff-64572a7b1dde admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.737436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f61ea-3ad9-4e8c-a3ff-64572a7b1dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.737722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f61ea-3ad9-4e8c-a3ff-64572a7b1dde admin admin] PATH_INFO: `/v3/projects/182f45a6fab54a40be8b6271e9e5660f/users/9a297cb26d404f4585a0e8bb4e66d4db/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.759419 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f61ea-3ad9-4e8c-a3ff-64572a7b1dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=182f45a6fab54a40be8b6271e9e5660f, user_id=9a297cb26d404f4585a0e8bb4e66d4db, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.762267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f61ea-3ad9-4e8c-a3ff-64572a7b1dde admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.763755 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 779/1588] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:18 2022] POST /identity/v3/users => generated 290 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:18.765289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a76120-8cc2-4043-8789-2f289abea644 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.779406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a76120-8cc2-4043-8789-2f289abea644 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.781761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 810/1589] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:18 2022] PUT /identity/v3/projects/182f45a6fab54a40be8b6271e9e5660f/users/9a297cb26d404f4585a0e8bb4e66d4db/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:18.782728 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f61ea-3ad9-4e8c-a3ff-64572a7b1dde admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.848240 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36193d0f-602f-4003-b717-f05f620e5d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.848492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f61ea-3ad9-4e8c-a3ff-64572a7b1dde admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.849069 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36193d0f-602f-4003-b717-f05f620e5d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.849362 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36193d0f-602f-4003-b717-f05f620e5d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.849646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36193d0f-602f-4003-b717-f05f620e5d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.850377 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36193d0f-602f-4003-b717-f05f620e5d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.852027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36193d0f-602f-4003-b717-f05f620e5d0a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.853581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b81a5-32aa-4fe9-a2af-18f3167f7a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.854348 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b81a5-32aa-4fe9-a2af-18f3167f7a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.854682 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b81a5-32aa-4fe9-a2af-18f3167f7a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.855068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b81a5-32aa-4fe9-a2af-18f3167f7a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.855927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b81a5-32aa-4fe9-a2af-18f3167f7a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.857564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b81a5-32aa-4fe9-a2af-18f3167f7a02 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.863642 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 780/1590] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:18.863642 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36193d0f-602f-4003-b717-f05f620e5d0a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.874107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36193d0f-602f-4003-b717-f05f620e5d0a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.874895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 811/1591] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:18.877232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29c314-06a5-44eb-bd79-828035d05586 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.878070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29c314-06a5-44eb-bd79-828035d05586 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.878357 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29c314-06a5-44eb-bd79-828035d05586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.879820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4b271-5d3b-4bfa-9b73-f33f959f334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.880788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4b271-5d3b-4bfa-9b73-f33f959f334f admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.881361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4b271-5d3b-4bfa-9b73-f33f959f334f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.881361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4b271-5d3b-4bfa-9b73-f33f959f334f admin admin] PATH_INFO: `/v3/projects/1861eff82fb5414c95aa2cf53dcae6a2/users/4df9cba16cec44d3ab51d8f17258db75/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.897244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7a29c314-06a5-44eb-bd79-828035d05586 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:18.898515 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7a29c314-06a5-44eb-bd79-828035d05586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:18.899288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4b271-5d3b-4bfa-9b73-f33f959f334f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1861eff82fb5414c95aa2cf53dcae6a2, user_id=4df9cba16cec44d3ab51d8f17258db75, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.900422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-75c4b271-5d3b-4bfa-9b73-f33f959f334f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:30:18.900422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 21 08:30:18.900422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: Jul 21 08:30:18.902337 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4b271-5d3b-4bfa-9b73-f33f959f334f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.906094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 812/1592] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:18.906879 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29c314-06a5-44eb-bd79-828035d05586 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.918494 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 781/1593] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:18 2022] PUT /identity/v3/projects/1861eff82fb5414c95aa2cf53dcae6a2/users/4df9cba16cec44d3ab51d8f17258db75/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:18.919318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4b271-5d3b-4bfa-9b73-f33f959f334f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:18.919808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29c314-06a5-44eb-bd79-828035d05586 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.933992 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:18.934295 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:18.982390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb86f2-17d4-47d8-8f4e-7db43fef7ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.983092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb86f2-17d4-47d8-8f4e-7db43fef7ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.983441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb86f2-17d4-47d8-8f4e-7db43fef7ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.983883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb86f2-17d4-47d8-8f4e-7db43fef7ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.984865 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb86f2-17d4-47d8-8f4e-7db43fef7ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.985197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4b271-5d3b-4bfa-9b73-f33f959f334f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:18.986612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb86f2-17d4-47d8-8f4e-7db43fef7ff0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.990347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de884863-7ff8-42c5-8fd2-d2f41c1cbaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:18.991015 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de884863-7ff8-42c5-8fd2-d2f41c1cbaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:18.991291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de884863-7ff8-42c5-8fd2-d2f41c1cbaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:18.991561 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de884863-7ff8-42c5-8fd2-d2f41c1cbaa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:18.992319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de884863-7ff8-42c5-8fd2-d2f41c1cbaa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:18.993932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de884863-7ff8-42c5-8fd2-d2f41c1cbaa7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:18.997359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 813/1594] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:18.998132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb86f2-17d4-47d8-8f4e-7db43fef7ff0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:19.005673 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 782/1595] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:19.006943 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c01c03-a394-4688-acb3-526ec958fae7 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.007215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c01c03-a394-4688-acb3-526ec958fae7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.007487 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c01c03-a394-4688-acb3-526ec958fae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.010788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb86f2-17d4-47d8-8f4e-7db43fef7ff0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:19.015884 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23b341-f38a-4012-9075-27ae58b18a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:19.016639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23b341-f38a-4012-9075-27ae58b18a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.016999 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23b341-f38a-4012-9075-27ae58b18a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.017314 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23b341-f38a-4012-9075-27ae58b18a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.018049 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23b341-f38a-4012-9075-27ae58b18a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:19.019858 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23b341-f38a-4012-9075-27ae58b18a9f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:19.031030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 814/1596] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:19.034187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23b341-f38a-4012-9075-27ae58b18a9f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:19.037481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b3c01c03-a394-4688-acb3-526ec958fae7 None None] MFA Rules not processed for user `9a297cb26d404f4585a0e8bb4e66d4db`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:19.038736 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b3c01c03-a394-4688-acb3-526ec958fae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:19.042643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23b341-f38a-4012-9075-27ae58b18a9f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:19.048860 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281e02a-15d1-4021-9e10-7cc9b7cb165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:19.049539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281e02a-15d1-4021-9e10-7cc9b7cb165a admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.049846 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281e02a-15d1-4021-9e10-7cc9b7cb165a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.050123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281e02a-15d1-4021-9e10-7cc9b7cb165a admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.050852 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281e02a-15d1-4021-9e10-7cc9b7cb165a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:19.052507 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281e02a-15d1-4021-9e10-7cc9b7cb165a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:19.065651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 815/1597] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:19.066482 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281e02a-15d1-4021-9e10-7cc9b7cb165a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:19.078696 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281e02a-15d1-4021-9e10-7cc9b7cb165a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:19.087575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718a5c6-5825-426e-8255-7b9ad548eec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:19.088288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718a5c6-5825-426e-8255-7b9ad548eec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.088567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718a5c6-5825-426e-8255-7b9ad548eec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.088842 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718a5c6-5825-426e-8255-7b9ad548eec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.089618 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718a5c6-5825-426e-8255-7b9ad548eec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:19.091216 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718a5c6-5825-426e-8255-7b9ad548eec7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:19.103437 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 816/1598] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:19.104150 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718a5c6-5825-426e-8255-7b9ad548eec7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:19.122721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 783/1599] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:19 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:19.124204 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c47be-7381-4546-bfe9-646b3ba6899f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.124561 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c47be-7381-4546-bfe9-646b3ba6899f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.124952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c47be-7381-4546-bfe9-646b3ba6899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.142480 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a63c47be-7381-4546-bfe9-646b3ba6899f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:19.143735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a63c47be-7381-4546-bfe9-646b3ba6899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:19.154959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 784/1600] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:19.154959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c47be-7381-4546-bfe9-646b3ba6899f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:19.170513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718a5c6-5825-426e-8255-7b9ad548eec7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:19.173240 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c47be-7381-4546-bfe9-646b3ba6899f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:19.174714 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73651377-1719-4e58-9c1d-6991cb9940b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:19.175410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73651377-1719-4e58-9c1d-6991cb9940b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.175794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73651377-1719-4e58-9c1d-6991cb9940b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.176073 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73651377-1719-4e58-9c1d-6991cb9940b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.177884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a9ea7-183c-425f-a2b7-a006f3f56875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:19.178778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a9ea7-183c-425f-a2b7-a006f3f56875 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.179196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a9ea7-183c-425f-a2b7-a006f3f56875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.179475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a9ea7-183c-425f-a2b7-a006f3f56875 admin admin] PATH_INFO: `/v3/projects/3e29a1a57a7944859207b4fb4c89dec8/users/4401e25f8d434f8d92875f16874b8c4d/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.185341 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73651377-1719-4e58-9c1d-6991cb9940b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:19.186905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73651377-1719-4e58-9c1d-6991cb9940b3 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:19.195866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a9ea7-183c-425f-a2b7-a006f3f56875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e29a1a57a7944859207b4fb4c89dec8, user_id=4401e25f8d434f8d92875f16874b8c4d, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:19.198013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 817/1601] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:19.198531 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a9ea7-183c-425f-a2b7-a006f3f56875 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:19.198953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73651377-1719-4e58-9c1d-6991cb9940b3 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:19.208608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73651377-1719-4e58-9c1d-6991cb9940b3 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:19.215404 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 785/1602] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:19 2022] PUT /identity/v3/projects/3e29a1a57a7944859207b4fb4c89dec8/users/4401e25f8d434f8d92875f16874b8c4d/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:19.216259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a9ea7-183c-425f-a2b7-a006f3f56875 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:19.285114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d99e2-d035-4449-aa62-eca371c7332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:19.286163 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d99e2-d035-4449-aa62-eca371c7332a admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.286447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d99e2-d035-4449-aa62-eca371c7332a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.286742 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d99e2-d035-4449-aa62-eca371c7332a admin admin] PATH_INFO: `/v3/projects/f33ad73ca971454fa0a41fa8e645c79c/users/2478d1c197744d58b267cd27980d1df9/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.288064 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a9ea7-183c-425f-a2b7-a006f3f56875 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:19.293077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1b146-16f4-463c-a8a4-abf269af20cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:19.293764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1b146-16f4-463c-a8a4-abf269af20cd admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.294038 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1b146-16f4-463c-a8a4-abf269af20cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.294316 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1b146-16f4-463c-a8a4-abf269af20cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.295203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1b146-16f4-463c-a8a4-abf269af20cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:19.297159 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1b146-16f4-463c-a8a4-abf269af20cd admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:19.303320 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d99e2-d035-4449-aa62-eca371c7332a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33ad73ca971454fa0a41fa8e645c79c, user_id=2478d1c197744d58b267cd27980d1df9, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:19.306889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d99e2-d035-4449-aa62-eca371c7332a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:19.311047 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 786/1603] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:19.311047 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1b146-16f4-463c-a8a4-abf269af20cd admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:19.317905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:19.322315 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1b146-16f4-463c-a8a4-abf269af20cd admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:19.327837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 818/1604] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:19 2022] PUT /identity/v3/projects/f33ad73ca971454fa0a41fa8e645c79c/users/2478d1c197744d58b267cd27980d1df9/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:19.339100 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d99e2-d035-4449-aa62-eca371c7332a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:19.349162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:19.398166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a87a1-c41a-467d-bf5a-b51af0c21956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:19.399111 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a87a1-c41a-467d-bf5a-b51af0c21956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.399568 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a87a1-c41a-467d-bf5a-b51af0c21956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.399742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a87a1-c41a-467d-bf5a-b51af0c21956 admin admin] PATH_INFO: `/v3/projects/29c9d8cf7a764ba1ba167908ad930bd9/users/56f006a445f24d83863b5fa8cd7bcc51/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.427437 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d99e2-d035-4449-aa62-eca371c7332a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:19.435316 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a87a1-c41a-467d-bf5a-b51af0c21956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c9d8cf7a764ba1ba167908ad930bd9, user_id=56f006a445f24d83863b5fa8cd7bcc51, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:19.437971 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04804b02-c9a2-4fce-ab03-fac687f6b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:19.439550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a87a1-c41a-467d-bf5a-b51af0c21956 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:19.439816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04804b02-c9a2-4fce-ab03-fac687f6b494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.440304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04804b02-c9a2-4fce-ab03-fac687f6b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.440824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04804b02-c9a2-4fce-ab03-fac687f6b494 admin admin] PATH_INFO: `/v3/projects/dbbb0cddb8c447d2bca523eed4d63144/users/c95f2ee426514d89afcec7ab5ea2634c/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.460350 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 787/1605] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:19 2022] PUT /identity/v3/projects/29c9d8cf7a764ba1ba167908ad930bd9/users/56f006a445f24d83863b5fa8cd7bcc51/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:19.461291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a87a1-c41a-467d-bf5a-b51af0c21956 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:19.462959 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04804b02-c9a2-4fce-ab03-fac687f6b494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbbb0cddb8c447d2bca523eed4d63144, user_id=c95f2ee426514d89afcec7ab5ea2634c, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:19.465776 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04804b02-c9a2-4fce-ab03-fac687f6b494 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:19.487025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 819/1606] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:19 2022] PUT /identity/v3/projects/dbbb0cddb8c447d2bca523eed4d63144/users/c95f2ee426514d89afcec7ab5ea2634c/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:19.499252 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04804b02-c9a2-4fce-ab03-fac687f6b494 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:19.540546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a87a1-c41a-467d-bf5a-b51af0c21956 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:19.562923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04804b02-c9a2-4fce-ab03-fac687f6b494 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:19.566924 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e25d0-11ff-4de1-bda1-2e92d648bfbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:19.568157 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e25d0-11ff-4de1-bda1-2e92d648bfbb service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.568306 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e25d0-11ff-4de1-bda1-2e92d648bfbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.568587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e25d0-11ff-4de1-bda1-2e92d648bfbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.624545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a3331-06a2-4eee-a5b1-8c9d262cd711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:19.625592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3331-06a2-4eee-a5b1-8c9d262cd711 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.626450 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3331-06a2-4eee-a5b1-8c9d262cd711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.627179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3331-06a2-4eee-a5b1-8c9d262cd711 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.628615 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a3331-06a2-4eee-a5b1-8c9d262cd711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:19.641524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e25d0-11ff-4de1-bda1-2e92d648bfbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:19.643372 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e25d0-11ff-4de1-bda1-2e92d648bfbb service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:19.644882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a3331-06a2-4eee-a5b1-8c9d262cd711 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:19.656983 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 820/1607] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:19.658109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e31b5d-f1dd-41c5-8eda-a1c386ffd205 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.658469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e31b5d-f1dd-41c5-8eda-a1c386ffd205 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.658884 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e31b5d-f1dd-41c5-8eda-a1c386ffd205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.682454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-04e31b5d-f1dd-41c5-8eda-a1c386ffd205 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:19.684370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-04e31b5d-f1dd-41c5-8eda-a1c386ffd205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:19.686618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 788/1608] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:19 2022] POST /identity/v3/projects => generated 353 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:19.687568 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a3331-06a2-4eee-a5b1-8c9d262cd711 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:19.722083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:19.738885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:19.780476 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 821/1609] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:19.782595 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0828b1-db05-4ec3-b75d-146085ec5d0f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.783253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0828b1-db05-4ec3-b75d-146085ec5d0f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.783934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a3331-06a2-4eee-a5b1-8c9d262cd711 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:19.784145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0828b1-db05-4ec3-b75d-146085ec5d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.789930 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912572ee-9945-4786-8e7d-8a571efd1627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:19.791311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912572ee-9945-4786-8e7d-8a571efd1627 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.791700 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912572ee-9945-4786-8e7d-8a571efd1627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.792192 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912572ee-9945-4786-8e7d-8a571efd1627 admin admin] PATH_INFO: `/v3/projects/61434fd155e34d04a5ee2b66286170dd/users/a7ed496bc9ef4eb9b3c1da70ab5f7b89/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.814168 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912572ee-9945-4786-8e7d-8a571efd1627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61434fd155e34d04a5ee2b66286170dd, user_id=a7ed496bc9ef4eb9b3c1da70ab5f7b89, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:19.817375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912572ee-9945-4786-8e7d-8a571efd1627 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:19.821780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ff0828b1-db05-4ec3-b75d-146085ec5d0f None None] MFA Rules not processed for user `2478d1c197744d58b267cd27980d1df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:19.823698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ff0828b1-db05-4ec3-b75d-146085ec5d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:19.842023 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 789/1610] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:19 2022] PUT /identity/v3/projects/61434fd155e34d04a5ee2b66286170dd/users/a7ed496bc9ef4eb9b3c1da70ab5f7b89/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:19.852960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c225d-0b73-4ad2-a863-ec4eff04f43f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.852960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c225d-0b73-4ad2-a863-ec4eff04f43f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.852960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c225d-0b73-4ad2-a863-ec4eff04f43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.878799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-852c225d-0b73-4ad2-a863-ec4eff04f43f None None] MFA Rules not processed for user `56f006a445f24d83863b5fa8cd7bcc51`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:19.880242 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-852c225d-0b73-4ad2-a863-ec4eff04f43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:19.953310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 822/1611] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:19.954789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd52ab3-80a2-4e19-bceb-685da1334887 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.955077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd52ab3-80a2-4e19-bceb-685da1334887 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.955358 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd52ab3-80a2-4e19-bceb-685da1334887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.966827 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 790/1612] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:19.968715 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c225d-0b73-4ad2-a863-ec4eff04f43f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:19.989454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4cd52ab3-80a2-4e19-bceb-685da1334887 None None] MFA Rules not processed for user `c95f2ee426514d89afcec7ab5ea2634c`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:19.991085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4cd52ab3-80a2-4e19-bceb-685da1334887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:20.105927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 823/1613] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:20.112064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd52ab3-80a2-4e19-bceb-685da1334887 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:20.115080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c225d-0b73-4ad2-a863-ec4eff04f43f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:20.124881 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fbb36-eff5-4bed-a689-f9229446b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:20.126545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fbb36-eff5-4bed-a689-f9229446b17c admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:20.127328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fbb36-eff5-4bed-a689-f9229446b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:20.127820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fbb36-eff5-4bed-a689-f9229446b17c admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:20.129188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fbb36-eff5-4bed-a689-f9229446b17c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:20.133224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fbb36-eff5-4bed-a689-f9229446b17c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:20.174336 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 791/1614] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:19 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:20.177811 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e30b7f-1335-453d-a1a2-f07d8ac5b1f6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:20.178169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e30b7f-1335-453d-a1a2-f07d8ac5b1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:20.178458 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e30b7f-1335-453d-a1a2-f07d8ac5b1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:20.212101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd52ab3-80a2-4e19-bceb-685da1334887 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:20.224314 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3b8f9-c630-42a4-b39e-3b2859ec254e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:20.225408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3b8f9-c630-42a4-b39e-3b2859ec254e service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:20.226299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3b8f9-c630-42a4-b39e-3b2859ec254e service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:20.226784 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3b8f9-c630-42a4-b39e-3b2859ec254e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:20.239654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3b8f9-c630-42a4-b39e-3b2859ec254e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:20.240897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-33e30b7f-1335-453d-a1a2-f07d8ac5b1f6 None None] MFA Rules not processed for user `a7ed496bc9ef4eb9b3c1da70ab5f7b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:20.241138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3b8f9-c630-42a4-b39e-3b2859ec254e service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:20.242104 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-33e30b7f-1335-453d-a1a2-f07d8ac5b1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:20.253761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:20.255769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 824/1615] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:20.259444 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3b8f9-c630-42a4-b39e-3b2859ec254e service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:20.264998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:20.271658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3b8f9-c630-42a4-b39e-3b2859ec254e service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:20.277459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1067e1-e873-4edb-b937-5be83aa02ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:20.278792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1067e1-e873-4edb-b937-5be83aa02ffb admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:20.280159 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1067e1-e873-4edb-b937-5be83aa02ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:20.280579 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1067e1-e873-4edb-b937-5be83aa02ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:20.281462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1067e1-e873-4edb-b937-5be83aa02ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:20.284082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1067e1-e873-4edb-b937-5be83aa02ffb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:20.325994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 825/1616] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:20 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:20.330044 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c0088-db5e-4edc-af64-43156e0b652a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:20.331654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c0088-db5e-4edc-af64-43156e0b652a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:20.332182 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c0088-db5e-4edc-af64-43156e0b652a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:20.333719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 826/1617] 10.222.0.64 () {54 vars in 962 bytes} [Thu Jul 21 08:30:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:20.335258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c0088-db5e-4edc-af64-43156e0b652a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:20.337757 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 792/1618] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:20.339247 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e68d5-f5dd-4c62-a031-df06bc92ece3 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:20.339958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e68d5-f5dd-4c62-a031-df06bc92ece3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:20.339958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e68d5-f5dd-4c62-a031-df06bc92ece3 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:20.342865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 793/1619] 10.222.0.64 () {54 vars in 962 bytes} [Thu Jul 21 08:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:20.344823 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181dd29-fd1a-4394-933d-4ae1e4532f03 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:20.345113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181dd29-fd1a-4394-933d-4ae1e4532f03 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:20.345387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181dd29-fd1a-4394-933d-4ae1e4532f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:20.400546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-d181dd29-fd1a-4394-933d-4ae1e4532f03 None None] MFA Rules not processed for user `2f64974821e049dd95c8cc5f17fcdf7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:20.403340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d181dd29-fd1a-4394-933d-4ae1e4532f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:20.449226 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c0088-db5e-4edc-af64-43156e0b652a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:20.457168 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af363ffd-3121-4382-8c25-2be59ecdda76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:20.458616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af363ffd-3121-4382-8c25-2be59ecdda76 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:20.459162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af363ffd-3121-4382-8c25-2be59ecdda76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:20.459589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af363ffd-3121-4382-8c25-2be59ecdda76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:20.460555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af363ffd-3121-4382-8c25-2be59ecdda76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:20.462958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af363ffd-3121-4382-8c25-2be59ecdda76 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:20.479925 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 827/1620] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:20.481064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af363ffd-3121-4382-8c25-2be59ecdda76 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:20.499068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af363ffd-3121-4382-8c25-2be59ecdda76 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:20.504663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b04c0-a2e1-44cf-b064-50050617e65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:20.505795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b04c0-a2e1-44cf-b064-50050617e65d admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:20.506119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b04c0-a2e1-44cf-b064-50050617e65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:20.507034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b04c0-a2e1-44cf-b064-50050617e65d admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:20.507927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b04c0-a2e1-44cf-b064-50050617e65d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:20.510272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b04c0-a2e1-44cf-b064-50050617e65d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:20.513381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 794/1621] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:20 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:20.514481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181dd29-fd1a-4394-933d-4ae1e4532f03 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:20.530404 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181dd29-fd1a-4394-933d-4ae1e4532f03 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:20.536128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8880f-2a7e-4d3e-84eb-daa8e6b728a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:20.536837 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8880f-2a7e-4d3e-84eb-daa8e6b728a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:20.537116 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8880f-2a7e-4d3e-84eb-daa8e6b728a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:20.537465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8880f-2a7e-4d3e-84eb-daa8e6b728a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:20.538191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8880f-2a7e-4d3e-84eb-daa8e6b728a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:20.542348 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 828/1622] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:20 2022] POST /identity/v3/users => generated 292 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:20.542348 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1569c-cd2f-475a-b42e-1c5d429ab882 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:20.542348 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1569c-cd2f-475a-b42e-1c5d429ab882 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:20.542644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8880f-2a7e-4d3e-84eb-daa8e6b728a7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:20.542757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1569c-cd2f-475a-b42e-1c5d429ab882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:20.578360 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 795/1623] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:20 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:20.580067 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95262e-e3ad-481c-b5b1-d253f69939df None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:20.580547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95262e-e3ad-481c-b5b1-d253f69939df None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:20.580728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95262e-e3ad-481c-b5b1-d253f69939df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:20.587783 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-26f1569c-cd2f-475a-b42e-1c5d429ab882 None None] MFA Rules not processed for user `131bb5462c8b478783a350d37caa76ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:20.589371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-26f1569c-cd2f-475a-b42e-1c5d429ab882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:20.602085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0b95262e-e3ad-481c-b5b1-d253f69939df None None] MFA Rules not processed for user `131bb5462c8b478783a350d37caa76ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:20.603691 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0b95262e-e3ad-481c-b5b1-d253f69939df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:20.711425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 796/1624] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Jul 21 08:30:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:20.712708 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95262e-e3ad-481c-b5b1-d253f69939df None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:20.719153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 829/1625] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Jul 21 08:30:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:20.721493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1569c-cd2f-475a-b42e-1c5d429ab882 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:20.736765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:20.781451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:20.814857 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1569c-cd2f-475a-b42e-1c5d429ab882 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:20.823622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3210c-2014-485f-b9b5-70b908a2d4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:20.824502 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3210c-2014-485f-b9b5-70b908a2d4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:20.824882 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3210c-2014-485f-b9b5-70b908a2d4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:20.826202 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3210c-2014-485f-b9b5-70b908a2d4b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:20.827020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3210c-2014-485f-b9b5-70b908a2d4b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:20.830131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3210c-2014-485f-b9b5-70b908a2d4b7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:20.832952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95262e-e3ad-481c-b5b1-d253f69939df None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:20.845408 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc1131-46a8-47a5-94f9-99699a5560fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:20.850427 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc1131-46a8-47a5-94f9-99699a5560fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:20.854531 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc1131-46a8-47a5-94f9-99699a5560fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:20.854850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc1131-46a8-47a5-94f9-99699a5560fd admin admin] PATH_INFO: `/v3/projects/7f6599cdc2264777bde841129001ff0f/users/cf9624f835f64a80b464cfa16a0491c3/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:20.876287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc1131-46a8-47a5-94f9-99699a5560fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f6599cdc2264777bde841129001ff0f, user_id=cf9624f835f64a80b464cfa16a0491c3, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:20.878507 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 830/1626] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:20 2022] POST /identity/v3/projects => generated 403 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:20.879380 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3210c-2014-485f-b9b5-70b908a2d4b7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:20.883216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc1131-46a8-47a5-94f9-99699a5560fd admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:20.938149 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 797/1627] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:20 2022] PUT /identity/v3/projects/7f6599cdc2264777bde841129001ff0f/users/cf9624f835f64a80b464cfa16a0491c3/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:20.941667 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc1131-46a8-47a5-94f9-99699a5560fd admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:21.049262 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3210c-2014-485f-b9b5-70b908a2d4b7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:21.086571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc1131-46a8-47a5-94f9-99699a5560fd admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:21.091964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc11728-51b4-42a9-9322-a5d1c295bb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:21.093337 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc11728-51b4-42a9-9322-a5d1c295bb68 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:21.093792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc11728-51b4-42a9-9322-a5d1c295bb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:21.094163 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc11728-51b4-42a9-9322-a5d1c295bb68 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:21.095030 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc11728-51b4-42a9-9322-a5d1c295bb68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:21.097098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc11728-51b4-42a9-9322-a5d1c295bb68 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:21.127569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9349319-f994-4c7d-b4d9-27c754fa925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:21.128450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349319-f994-4c7d-b4d9-27c754fa925f admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:21.128741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349319-f994-4c7d-b4d9-27c754fa925f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:21.129018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349319-f994-4c7d-b4d9-27c754fa925f admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:21.129912 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 798/1628] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:20 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:21.130153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9349319-f994-4c7d-b4d9-27c754fa925f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:21.132220 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9349319-f994-4c7d-b4d9-27c754fa925f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:21.133719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc11728-51b4-42a9-9322-a5d1c295bb68 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:21.150960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 831/1629] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:21.150960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9349319-f994-4c7d-b4d9-27c754fa925f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:21.236378 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc11728-51b4-42a9-9322-a5d1c295bb68 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:21.245659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690437d-2350-4031-8495-f2ec35ab3257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:21.247075 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690437d-2350-4031-8495-f2ec35ab3257 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:21.247466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690437d-2350-4031-8495-f2ec35ab3257 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:21.247871 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690437d-2350-4031-8495-f2ec35ab3257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:21.273751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:21.276775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:21.286460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9349319-f994-4c7d-b4d9-27c754fa925f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:21.300642 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1384849-ea58-4893-8a59-38cc25170ce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:21.301262 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1384849-ea58-4893-8a59-38cc25170ce8 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:21.301546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1384849-ea58-4893-8a59-38cc25170ce8 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:21.301823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1384849-ea58-4893-8a59-38cc25170ce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:21.342532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690437d-2350-4031-8495-f2ec35ab3257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:21.345181 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690437d-2350-4031-8495-f2ec35ab3257 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:21.362546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 799/1630] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:21.371444 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690437d-2350-4031-8495-f2ec35ab3257 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:21.395787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690437d-2350-4031-8495-f2ec35ab3257 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:21.406200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a4900-4565-4794-afb3-17f49e65ede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:21.407250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a4900-4565-4794-afb3-17f49e65ede3 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:21.407863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a4900-4565-4794-afb3-17f49e65ede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:21.408315 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a4900-4565-4794-afb3-17f49e65ede3 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:21.409170 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a4900-4565-4794-afb3-17f49e65ede3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:21.414694 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a4900-4565-4794-afb3-17f49e65ede3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:21.424022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1384849-ea58-4893-8a59-38cc25170ce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:21.425858 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1384849-ea58-4893-8a59-38cc25170ce8 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:21.447419 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 832/1631] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:21.449993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1384849-ea58-4893-8a59-38cc25170ce8 service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:21.477248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 800/1632] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:21 2022] POST /identity/v3/users => generated 308 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:21.478138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a4900-4565-4794-afb3-17f49e65ede3 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:21.495436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1384849-ea58-4893-8a59-38cc25170ce8 service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:21.499025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a4900-4565-4794-afb3-17f49e65ede3 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:21.501629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c0f40-e4bc-4ca8-9e8a-7000cb1dec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:21.502548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c0f40-e4bc-4ca8-9e8a-7000cb1dec9b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:21.503093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c0f40-e4bc-4ca8-9e8a-7000cb1dec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:21.503708 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c0f40-e4bc-4ca8-9e8a-7000cb1dec9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:21.504822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c0f40-e4bc-4ca8-9e8a-7000cb1dec9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:21.506705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c0f40-e4bc-4ca8-9e8a-7000cb1dec9b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:21.513201 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6922a1f-5a0e-4280-b239-a3c22123c769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:21.514039 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922a1f-5a0e-4280-b239-a3c22123c769 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:21.514477 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922a1f-5a0e-4280-b239-a3c22123c769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:21.515162 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922a1f-5a0e-4280-b239-a3c22123c769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:21.515978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6922a1f-5a0e-4280-b239-a3c22123c769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:21.517617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6922a1f-5a0e-4280-b239-a3c22123c769 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:21.529234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 833/1633] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:21.530313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c0f40-e4bc-4ca8-9e8a-7000cb1dec9b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:21.541863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 801/1634] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:21.543035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6922a1f-5a0e-4280-b239-a3c22123c769 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:21.543670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c0f40-e4bc-4ca8-9e8a-7000cb1dec9b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:21.554142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b400132-ce75-48fc-bf97-fd4205106fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:21.555547 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b400132-ce75-48fc-bf97-fd4205106fce admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:21.556404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b400132-ce75-48fc-bf97-fd4205106fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:21.556915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b400132-ce75-48fc-bf97-fd4205106fce admin admin] PATH_INFO: `/v3/projects/f4f2f7d17d6149149403f3536f73d607/users/b86fe28a6e17455998bafad8da62b8a0/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:21.571344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6922a1f-5a0e-4280-b239-a3c22123c769 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:21.579287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b400132-ce75-48fc-bf97-fd4205106fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f2f7d17d6149149403f3536f73d607, user_id=b86fe28a6e17455998bafad8da62b8a0, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:21.583053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b400132-ce75-48fc-bf97-fd4205106fce admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:21.584268 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9ecd3-a3cb-4e3d-bab6-ddaf80628375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:21.584979 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9ecd3-a3cb-4e3d-bab6-ddaf80628375 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:21.585245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9ecd3-a3cb-4e3d-bab6-ddaf80628375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:21.585536 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9ecd3-a3cb-4e3d-bab6-ddaf80628375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:21.586886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9ecd3-a3cb-4e3d-bab6-ddaf80628375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:21.588527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9ecd3-a3cb-4e3d-bab6-ddaf80628375 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:21.617017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 834/1635] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:21 2022] PUT /identity/v3/projects/f4f2f7d17d6149149403f3536f73d607/users/b86fe28a6e17455998bafad8da62b8a0/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:21.617017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b400132-ce75-48fc-bf97-fd4205106fce admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:21.619974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 802/1636] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:21.621018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9ecd3-a3cb-4e3d-bab6-ddaf80628375 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:21.647317 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9ecd3-a3cb-4e3d-bab6-ddaf80628375 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:21.772737 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2961f-bc29-48a4-8b1e-3bb0a4d77ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:21.773666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2961f-bc29-48a4-8b1e-3bb0a4d77ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:21.773965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2961f-bc29-48a4-8b1e-3bb0a4d77ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:21.774224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2961f-bc29-48a4-8b1e-3bb0a4d77ee2 admin admin] PATH_INFO: `/v3/projects/0e4d8800eca145ff9906d068c37e328d/users/af383a0516994eccaa0cf7fc56398c35/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:21.805946 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2961f-bc29-48a4-8b1e-3bb0a4d77ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4d8800eca145ff9906d068c37e328d, user_id=af383a0516994eccaa0cf7fc56398c35, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:21.808292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b400132-ce75-48fc-bf97-fd4205106fce admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:21.808747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2961f-bc29-48a4-8b1e-3bb0a4d77ee2 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:21.830871 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0986ebd-2e88-4584-aa9b-838d8538d57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:21.836518 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0986ebd-2e88-4584-aa9b-838d8538d57e admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:21.837005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0986ebd-2e88-4584-aa9b-838d8538d57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:21.837294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0986ebd-2e88-4584-aa9b-838d8538d57e admin admin] PATH_INFO: `/v3/projects/7f6599cdc2264777bde841129001ff0f/users/cf9624f835f64a80b464cfa16a0491c3/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:21.843832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0986ebd-2e88-4584-aa9b-838d8538d57e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f6599cdc2264777bde841129001ff0f, user_id=cf9624f835f64a80b464cfa16a0491c3, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:21.846495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 803/1637] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:21 2022] PUT /identity/v3/projects/0e4d8800eca145ff9906d068c37e328d/users/af383a0516994eccaa0cf7fc56398c35/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:21.847561 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2961f-bc29-48a4-8b1e-3bb0a4d77ee2 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:21.851116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0986ebd-2e88-4584-aa9b-838d8538d57e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:21.887830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 835/1638] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:21 2022] PUT /identity/v3/projects/7f6599cdc2264777bde841129001ff0f/users/cf9624f835f64a80b464cfa16a0491c3/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:21.887830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0986ebd-2e88-4584-aa9b-838d8538d57e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:21.932553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2961f-bc29-48a4-8b1e-3bb0a4d77ee2 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:21.942127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:22.005220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99a4c4-4ce4-45ae-aff2-ccd573de0b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:22.006162 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99a4c4-4ce4-45ae-aff2-ccd573de0b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.006445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99a4c4-4ce4-45ae-aff2-ccd573de0b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.006803 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99a4c4-4ce4-45ae-aff2-ccd573de0b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.007546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99a4c4-4ce4-45ae-aff2-ccd573de0b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:22.009340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99a4c4-4ce4-45ae-aff2-ccd573de0b0e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:22.021025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 804/1639] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:22.025761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99a4c4-4ce4-45ae-aff2-ccd573de0b0e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:22.037402 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99a4c4-4ce4-45ae-aff2-ccd573de0b0e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:22.043657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f2667-7bb2-44f3-a89a-1e49295e80ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:22.043657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f2667-7bb2-44f3-a89a-1e49295e80ac admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.043657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f2667-7bb2-44f3-a89a-1e49295e80ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.043657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f2667-7bb2-44f3-a89a-1e49295e80ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.044052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0986ebd-2e88-4584-aa9b-838d8538d57e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:22.045097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f2667-7bb2-44f3-a89a-1e49295e80ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:22.046895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f2667-7bb2-44f3-a89a-1e49295e80ac admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:22.056601 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e39d7a-5d0e-436a-bb25-796ef529d57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:22.057445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e39d7a-5d0e-436a-bb25-796ef529d57a admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.057732 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e39d7a-5d0e-436a-bb25-796ef529d57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.058008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e39d7a-5d0e-436a-bb25-796ef529d57a admin admin] PATH_INFO: `/v3/projects/72a98fdda4374e08a24816e0c961083d/users/3ba107a7f4244caeb2fd833c559a4697/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.062130 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 805/1640] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:22.062130 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44cda8-bc5c-43a3-8dc3-75877d2c91be None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.062130 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44cda8-bc5c-43a3-8dc3-75877d2c91be None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.062130 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44cda8-bc5c-43a3-8dc3-75877d2c91be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.063442 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:22.098705 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-5c44cda8-bc5c-43a3-8dc3-75877d2c91be None None] MFA Rules not processed for user `cf9624f835f64a80b464cfa16a0491c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:22.100017 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5c44cda8-bc5c-43a3-8dc3-75877d2c91be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:22.102034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e39d7a-5d0e-436a-bb25-796ef529d57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a98fdda4374e08a24816e0c961083d, user_id=3ba107a7f4244caeb2fd833c559a4697, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:22.104800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e39d7a-5d0e-436a-bb25-796ef529d57a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:22.128466 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 836/1641] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:21 2022] PUT /identity/v3/projects/72a98fdda4374e08a24816e0c961083d/users/3ba107a7f4244caeb2fd833c559a4697/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:22.128466 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94218a0-dfca-43ce-9eb6-5d41ab04f465 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.128466 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94218a0-dfca-43ce-9eb6-5d41ab04f465 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.128466 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94218a0-dfca-43ce-9eb6-5d41ab04f465 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.134803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 837/1642] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 21 08:30:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:22.136115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439eefd-7c74-441c-8bae-a5ce91a1ad58 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.136395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439eefd-7c74-441c-8bae-a5ce91a1ad58 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.136661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439eefd-7c74-441c-8bae-a5ce91a1ad58 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.138061 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 838/1643] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 21 08:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:22.138747 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439eefd-7c74-441c-8bae-a5ce91a1ad58 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:22.211553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 806/1644] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:22 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:22.211553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44cda8-bc5c-43a3-8dc3-75877d2c91be None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:22.224236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44cda8-bc5c-43a3-8dc3-75877d2c91be None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:22.289111 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439eefd-7c74-441c-8bae-a5ce91a1ad58 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:22.300767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc5b26-ec59-4a18-a4cd-1580c2e34789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:22.302872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5b26-ec59-4a18-a4cd-1580c2e34789 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.302872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5b26-ec59-4a18-a4cd-1580c2e34789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.303064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c64d80-1302-48eb-860d-ea3d197de127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:22.303209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5b26-ec59-4a18-a4cd-1580c2e34789 admin admin] PATH_INFO: `/v3/projects/0e4d8800eca145ff9906d068c37e328d/users/af383a0516994eccaa0cf7fc56398c35/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.303293 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c64d80-1302-48eb-860d-ea3d197de127 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.303555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c64d80-1302-48eb-860d-ea3d197de127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.303754 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c64d80-1302-48eb-860d-ea3d197de127 admin admin] PATH_INFO: `/v3/projects/f4f2f7d17d6149149403f3536f73d607/users/b86fe28a6e17455998bafad8da62b8a0/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.304339 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc5b26-ec59-4a18-a4cd-1580c2e34789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4d8800eca145ff9906d068c37e328d, user_id=af383a0516994eccaa0cf7fc56398c35, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:22.307318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc5b26-ec59-4a18-a4cd-1580c2e34789 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:22.310766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c64d80-1302-48eb-860d-ea3d197de127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f2f7d17d6149149403f3536f73d607, user_id=b86fe28a6e17455998bafad8da62b8a0, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:22.313845 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c64d80-1302-48eb-860d-ea3d197de127 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:22.328775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 807/1645] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:22 2022] PUT /identity/v3/projects/0e4d8800eca145ff9906d068c37e328d/users/af383a0516994eccaa0cf7fc56398c35/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:22.328775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc5b26-ec59-4a18-a4cd-1580c2e34789 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:22.338801 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 839/1646] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:22 2022] PUT /identity/v3/projects/f4f2f7d17d6149149403f3536f73d607/users/b86fe28a6e17455998bafad8da62b8a0/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:22.344946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849b201-34c5-4163-8252-7ff31325713e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.345133 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849b201-34c5-4163-8252-7ff31325713e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.345394 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849b201-34c5-4163-8252-7ff31325713e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.360415 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:22.372899 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b849b201-34c5-4163-8252-7ff31325713e None None] MFA Rules not processed for user `131bb5462c8b478783a350d37caa76ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:22.374453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b849b201-34c5-4163-8252-7ff31325713e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:22.482000 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc5b26-ec59-4a18-a4cd-1580c2e34789 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:22.522419 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 840/1647] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 08:30:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:22.530080 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f3724-c641-4434-a2df-4639e9c31456 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.530080 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f3724-c641-4434-a2df-4639e9c31456 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.530369 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f3724-c641-4434-a2df-4639e9c31456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.560434 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a62f3724-c641-4434-a2df-4639e9c31456 None None] MFA Rules not processed for user `131bb5462c8b478783a350d37caa76ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:22.561895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a62f3724-c641-4434-a2df-4639e9c31456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:22.581838 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 841/1648] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 08:30:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:22.582991 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f3724-c641-4434-a2df-4639e9c31456 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:22.645281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6762ac8-645f-4769-bd29-a0cdd84d4c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:22.647298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6762ac8-645f-4769-bd29-a0cdd84d4c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.649338 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6762ac8-645f-4769-bd29-a0cdd84d4c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.649662 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6762ac8-645f-4769-bd29-a0cdd84d4c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.650472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6762ac8-645f-4769-bd29-a0cdd84d4c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:22.652352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6762ac8-645f-4769-bd29-a0cdd84d4c07 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:22.671331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 808/1649] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:22.673211 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ed672-3307-4294-a592-567ea9359237 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.673511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ed672-3307-4294-a592-567ea9359237 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.673784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ed672-3307-4294-a592-567ea9359237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.708316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f3724-c641-4434-a2df-4639e9c31456 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:22.715171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6ba3f-b870-4207-9817-79fd0ff58a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:22.715902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6ba3f-b870-4207-9817-79fd0ff58a2e service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.716187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6ba3f-b870-4207-9817-79fd0ff58a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.716480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6ba3f-b870-4207-9817-79fd0ff58a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.722065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-073ed672-3307-4294-a592-567ea9359237 None None] MFA Rules not processed for user `af383a0516994eccaa0cf7fc56398c35`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:22.724039 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-073ed672-3307-4294-a592-567ea9359237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:22.760859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:22.854893 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6ba3f-b870-4207-9817-79fd0ff58a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:22.856743 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6ba3f-b870-4207-9817-79fd0ff58a2e service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:22.879721 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 842/1650] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:22 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:22.881105 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac051eb-a502-49b8-b848-b1591b1333bb None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.881480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac051eb-a502-49b8-b848-b1591b1333bb None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.881766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac051eb-a502-49b8-b848-b1591b1333bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.882421 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 809/1651] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:22.884176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ed672-3307-4294-a592-567ea9359237 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:22.896936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ed672-3307-4294-a592-567ea9359237 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:22.901693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a103aea-eba7-42f8-8e86-42798eae87ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:22.902691 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a103aea-eba7-42f8-8e86-42798eae87ef service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.903186 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a103aea-eba7-42f8-8e86-42798eae87ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.903802 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a103aea-eba7-42f8-8e86-42798eae87ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.916203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-dac051eb-a502-49b8-b848-b1591b1333bb None None] MFA Rules not processed for user `b86fe28a6e17455998bafad8da62b8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:22.917488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-dac051eb-a502-49b8-b848-b1591b1333bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:22.921411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a103aea-eba7-42f8-8e86-42798eae87ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:22.923280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a103aea-eba7-42f8-8e86-42798eae87ef service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:22.939244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 810/1652] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:22.941969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a103aea-eba7-42f8-8e86-42798eae87ef service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:22.953743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a103aea-eba7-42f8-8e86-42798eae87ef service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:22.959683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ec6e8-dc8a-43e8-9151-66f1c85f180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:22.960369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ec6e8-dc8a-43e8-9151-66f1c85f180b admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.960507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ec6e8-dc8a-43e8-9151-66f1c85f180b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.960876 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ec6e8-dc8a-43e8-9151-66f1c85f180b admin admin] PATH_INFO: `/v3/projects/72a98fdda4374e08a24816e0c961083d/users/3ba107a7f4244caeb2fd833c559a4697/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.963288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ec6e8-dc8a-43e8-9151-66f1c85f180b admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a98fdda4374e08a24816e0c961083d, user_id=3ba107a7f4244caeb2fd833c559a4697, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:22.966494 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ec6e8-dc8a-43e8-9151-66f1c85f180b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:22.983211 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 811/1653] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:22 2022] PUT /identity/v3/projects/72a98fdda4374e08a24816e0c961083d/users/3ba107a7f4244caeb2fd833c559a4697/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:22.990644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ec6e8-dc8a-43e8-9151-66f1c85f180b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:23.025197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:23.067618 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 843/1654] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:22 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:23.091037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ec6e8-dc8a-43e8-9151-66f1c85f180b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:23.104961 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c43ab9-7257-4123-a8c9-9a4a25d35130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:23.105647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c43ab9-7257-4123-a8c9-9a4a25d35130 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:23.105925 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c43ab9-7257-4123-a8c9-9a4a25d35130 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:23.106193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c43ab9-7257-4123-a8c9-9a4a25d35130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:23.220369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c43ab9-7257-4123-a8c9-9a4a25d35130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:23.222477 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c43ab9-7257-4123-a8c9-9a4a25d35130 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:23.260546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 812/1655] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:24.085718 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac051eb-a502-49b8-b848-b1591b1333bb None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:24.101828 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac051eb-a502-49b8-b848-b1591b1333bb None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:24.117117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cdb49-f35b-4f62-bbc9-1204213630fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:24.121244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cdb49-f35b-4f62-bbc9-1204213630fc service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:24.121576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cdb49-f35b-4f62-bbc9-1204213630fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:24.124396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cdb49-f35b-4f62-bbc9-1204213630fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:24.380567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6cdb49-f35b-4f62-bbc9-1204213630fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:24.382218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6cdb49-f35b-4f62-bbc9-1204213630fc service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:24.419476 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 844/1656] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:30:24.470785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c43ab9-7257-4123-a8c9-9a4a25d35130 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:24.481459 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c43ab9-7257-4123-a8c9-9a4a25d35130 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:24.488653 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6584-d5c0-4686-8e1f-16ec0ea28181 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:24.490395 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6584-d5c0-4686-8e1f-16ec0ea28181 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:24.490687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6584-d5c0-4686-8e1f-16ec0ea28181 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:24.490966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6584-d5c0-4686-8e1f-16ec0ea28181 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:24.654063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f6584-d5c0-4686-8e1f-16ec0ea28181 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:24.655763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f6584-d5c0-4686-8e1f-16ec0ea28181 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:24.684721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 813/1657] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:24.793350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cdb49-f35b-4f62-bbc9-1204213630fc service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:24.878396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cdb49-f35b-4f62-bbc9-1204213630fc service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:24.878396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeca622-7e12-4ffa-b74f-e8baa40f1761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:24.878396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeca622-7e12-4ffa-b74f-e8baa40f1761 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:24.878396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeca622-7e12-4ffa-b74f-e8baa40f1761 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:24.879311 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeca622-7e12-4ffa-b74f-e8baa40f1761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:24.905707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:24.955272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeca622-7e12-4ffa-b74f-e8baa40f1761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:24.958892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeca622-7e12-4ffa-b74f-e8baa40f1761 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:24.991668 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 845/1658] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:24 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:25.298221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6584-d5c0-4686-8e1f-16ec0ea28181 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:25.300204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeca622-7e12-4ffa-b74f-e8baa40f1761 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:25.315865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6584-d5c0-4686-8e1f-16ec0ea28181 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:25.318403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeca622-7e12-4ffa-b74f-e8baa40f1761 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:25.332180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b4ec8-801d-4ac7-8988-25532a431b05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:25.333357 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b4ec8-801d-4ac7-8988-25532a431b05 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:25.334188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b4ec8-801d-4ac7-8988-25532a431b05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:25.334759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b4ec8-801d-4ac7-8988-25532a431b05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:25.342298 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ec8fe-be3e-4a14-a41b-15b5529bec3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:25.347499 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ec8fe-be3e-4a14-a41b-15b5529bec3b service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:25.347822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ec8fe-be3e-4a14-a41b-15b5529bec3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:25.348100 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ec8fe-be3e-4a14-a41b-15b5529bec3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:25.481278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:25.507401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ec8fe-be3e-4a14-a41b-15b5529bec3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:25.509132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ec8fe-be3e-4a14-a41b-15b5529bec3b service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:25.521003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b4ec8-801d-4ac7-8988-25532a431b05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:25.522786 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b4ec8-801d-4ac7-8988-25532a431b05 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:25.550946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 846/1659] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:25.577836 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 814/1660] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:25.713887 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d006106-813b-4c4f-ad88-1506012f0dd6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:25.714204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d006106-813b-4c4f-ad88-1506012f0dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:25.714461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d006106-813b-4c4f-ad88-1506012f0dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:25.811566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8d006106-813b-4c4f-ad88-1506012f0dd6 None None] MFA Rules not processed for user `3ba107a7f4244caeb2fd833c559a4697`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:25.814126 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8d006106-813b-4c4f-ad88-1506012f0dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:26.071907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 847/1661] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:28.167869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b4ec8-801d-4ac7-8988-25532a431b05 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:28.218096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebb42a-4428-4679-b125-3ed1fdf54a1b None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:28.219270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebb42a-4428-4679-b125-3ed1fdf54a1b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:28.219807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebb42a-4428-4679-b125-3ed1fdf54a1b None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:28.221809 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 848/1662] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 08:30:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:28.241069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd16b2-ec5f-4f1c-ad3d-1183c1fd18b9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:28.241595 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd16b2-ec5f-4f1c-ad3d-1183c1fd18b9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:28.242084 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd16b2-ec5f-4f1c-ad3d-1183c1fd18b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:28.297845 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-18bd16b2-ec5f-4f1c-ad3d-1183c1fd18b9 None None] MFA Rules not processed for user `b1146aa09d30458f9ab3b3bec8f94233`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:28.300177 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-18bd16b2-ec5f-4f1c-ad3d-1183c1fd18b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:28.388257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b4ec8-801d-4ac7-8988-25532a431b05 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:28.408090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e98377-e132-4fe9-9a1d-b027c7092194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:28.409233 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e98377-e132-4fe9-9a1d-b027c7092194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:28.409705 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e98377-e132-4fe9-9a1d-b027c7092194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:28.410217 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e98377-e132-4fe9-9a1d-b027c7092194 admin admin] PATH_INFO: `/v3/users/56f006a445f24d83863b5fa8cd7bcc51` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:28.412599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e98377-e132-4fe9-9a1d-b027c7092194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f006a445f24d83863b5fa8cd7bcc51)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:28.413987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: WARNING py.warnings [None req-a4e98377-e132-4fe9-9a1d-b027c7092194 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:30:28.413987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: warnings.warn(msg) Jul 21 08:30:28.413987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: Jul 21 08:30:28.415663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e98377-e132-4fe9-9a1d-b027c7092194 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:28.473897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:28.536875 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 849/1663] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 08:30:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:30:28.612264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a4e98377-e132-4fe9-9a1d-b027c7092194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f006a445f24d83863b5fa8cd7bcc51'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:28.646751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af0a99-6d6c-4e9a-8e24-047eba858cdd None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:28.647187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af0a99-6d6c-4e9a-8e24-047eba858cdd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:28.647708 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af0a99-6d6c-4e9a-8e24-047eba858cdd None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:28.649894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 850/1664] 10.222.0.64 () {54 vars in 961 bytes} [Thu Jul 21 08:30:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:28.656107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf690a-9a89-4442-bba4-f74ea8e9a33f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:28.656542 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf690a-9a89-4442-bba4-f74ea8e9a33f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:28.657056 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf690a-9a89-4442-bba4-f74ea8e9a33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:28.702789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4dcf690a-9a89-4442-bba4-f74ea8e9a33f None None] MFA Rules not processed for user `b1146aa09d30458f9ab3b3bec8f94233`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:28.704624 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4dcf690a-9a89-4442-bba4-f74ea8e9a33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:28.709786 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a4e98377-e132-4fe9-9a1d-b027c7092194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f006a445f24d83863b5fa8cd7bcc51'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:28.712594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a4e98377-e132-4fe9-9a1d-b027c7092194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f006a445f24d83863b5fa8cd7bcc51'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:28.714509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a4e98377-e132-4fe9-9a1d-b027c7092194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f006a445f24d83863b5fa8cd7bcc51'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:28.723340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 851/1665] 10.222.0.64 () {58 vars in 1058 bytes} [Thu Jul 21 08:30:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:30:28.733357 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf690a-9a89-4442-bba4-f74ea8e9a33f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:28.778113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf690a-9a89-4442-bba4-f74ea8e9a33f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:28.787621 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a4e98377-e132-4fe9-9a1d-b027c7092194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f006a445f24d83863b5fa8cd7bcc51'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:28.797717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a2299-f947-4ca8-b416-f104fc837f76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1146aa09d30458f9ab3b3bec8f94233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:28.801471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a2299-f947-4ca8-b416-f104fc837f76 service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:28.802542 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a2299-f947-4ca8-b416-f104fc837f76 service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:28.804062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a2299-f947-4ca8-b416-f104fc837f76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:28.809868 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a82a2299-f947-4ca8-b416-f104fc837f76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:28.829839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 815/1666] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:28 2022] DELETE /identity/v3/users/56f006a445f24d83863b5fa8cd7bcc51 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:28.835889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2363c8-40ff-41a4-b13c-3d00817b8f06 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:28.836465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2363c8-40ff-41a4-b13c-3d00817b8f06 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:28.836628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2363c8-40ff-41a4-b13c-3d00817b8f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:28.863923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a2299-f947-4ca8-b416-f104fc837f76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:28.865554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a2299-f947-4ca8-b416-f104fc837f76 service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:28.906982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 852/1667] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:28.920132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0f2363c8-40ff-41a4-b13c-3d00817b8f06 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:28.930205 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0f2363c8-40ff-41a4-b13c-3d00817b8f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:29.142284 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea12c5-27da-49b8-98d9-26413bcebd36 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:29.142568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea12c5-27da-49b8-98d9-26413bcebd36 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:29.142838 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea12c5-27da-49b8-98d9-26413bcebd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:29.165435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 816/1668] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:29.182553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2363c8-40ff-41a4-b13c-3d00817b8f06 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:29.185384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0f2363c8-40ff-41a4-b13c-3d00817b8f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:29.234814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fbea12c5-27da-49b8-98d9-26413bcebd36 None None] MFA Rules not processed for user `4df9cba16cec44d3ab51d8f17258db75`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:29.236236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fbea12c5-27da-49b8-98d9-26413bcebd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:29.242148 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:29.422712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2363c8-40ff-41a4-b13c-3d00817b8f06 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:29.428594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7700f-6079-469f-aa7c-350ef1f9a217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:29.429582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7700f-6079-469f-aa7c-350ef1f9a217 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:29.431591 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7700f-6079-469f-aa7c-350ef1f9a217 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:29.432132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7700f-6079-469f-aa7c-350ef1f9a217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:29.444113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 853/1669] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:30:29.463569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a313f-49fc-4d46-9f52-1bc0d8294a4c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:29.463893 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a313f-49fc-4d46-9f52-1bc0d8294a4c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:29.464330 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a313f-49fc-4d46-9f52-1bc0d8294a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:29.466041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7700f-6079-469f-aa7c-350ef1f9a217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:29.467956 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7700f-6079-469f-aa7c-350ef1f9a217 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:29.487247 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 817/1670] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:29.499325 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a47a313f-49fc-4d46-9f52-1bc0d8294a4c None None] MFA Rules not processed for user `4df9cba16cec44d3ab51d8f17258db75`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:29.501017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a47a313f-49fc-4d46-9f52-1bc0d8294a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:29.513076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 854/1671] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:29.526094 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7700f-6079-469f-aa7c-350ef1f9a217 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:29.527909 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ccb7700f-6079-469f-aa7c-350ef1f9a217 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:29.639207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7700f-6079-469f-aa7c-350ef1f9a217 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:29.654589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c4188-038d-4363-a23e-e551c37bb4dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:29.658013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c4188-038d-4363-a23e-e551c37bb4dd service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:29.658533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c4188-038d-4363-a23e-e551c37bb4dd service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:29.659541 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c4188-038d-4363-a23e-e551c37bb4dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:29.684018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c4188-038d-4363-a23e-e551c37bb4dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:29.688902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c4188-038d-4363-a23e-e551c37bb4dd service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:29.709232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 818/1672] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:30:30.134394 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a313f-49fc-4d46-9f52-1bc0d8294a4c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:30.139263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a47a313f-49fc-4d46-9f52-1bc0d8294a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:30.171341 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a313f-49fc-4d46-9f52-1bc0d8294a4c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:30.182493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df12827-c467-4df1-a2ed-7d04bb2b60c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:30.183569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df12827-c467-4df1-a2ed-7d04bb2b60c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:30.188332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df12827-c467-4df1-a2ed-7d04bb2b60c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:30.194168 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df12827-c467-4df1-a2ed-7d04bb2b60c3 admin admin] PATH_INFO: `/v3/users/2f64974821e049dd95c8cc5f17fcdf7e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:30.197672 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df12827-c467-4df1-a2ed-7d04bb2b60c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f64974821e049dd95c8cc5f17fcdf7e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:30.206440 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df12827-c467-4df1-a2ed-7d04bb2b60c3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:30.358098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5df12827-c467-4df1-a2ed-7d04bb2b60c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f64974821e049dd95c8cc5f17fcdf7e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:30.359092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5df12827-c467-4df1-a2ed-7d04bb2b60c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f64974821e049dd95c8cc5f17fcdf7e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:30.360660 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5df12827-c467-4df1-a2ed-7d04bb2b60c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f64974821e049dd95c8cc5f17fcdf7e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:30.385754 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5df12827-c467-4df1-a2ed-7d04bb2b60c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f64974821e049dd95c8cc5f17fcdf7e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:30.415274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5df12827-c467-4df1-a2ed-7d04bb2b60c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f64974821e049dd95c8cc5f17fcdf7e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:30.477269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 855/1673] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:30 2022] DELETE /identity/v3/users/2f64974821e049dd95c8cc5f17fcdf7e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:30.757232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b509f-d5cf-4d4b-a412-1fc9dd705741 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:30.757683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b509f-d5cf-4d4b-a412-1fc9dd705741 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:30.757816 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b509f-d5cf-4d4b-a412-1fc9dd705741 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:30.760215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 819/1674] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 21 08:30:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:30.772107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fd8f9-b658-423b-8cfd-34ddc7ca6cd3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:30.773982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fd8f9-b658-423b-8cfd-34ddc7ca6cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:30.774585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fd8f9-b658-423b-8cfd-34ddc7ca6cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:30.906583 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b48fd8f9-b658-423b-8cfd-34ddc7ca6cd3 None None] MFA Rules not processed for user `1d737a8a33da490db5d59ffed92bee60`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:30.914475 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b48fd8f9-b658-423b-8cfd-34ddc7ca6cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:30.952833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:30.964701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b509f-d5cf-4d4b-a412-1fc9dd705741 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:30.966574 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f73b509f-d5cf-4d4b-a412-1fc9dd705741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:31.088750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 856/1675] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 08:30:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:31.121657 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddd1fc-2904-42d8-8131-ae8006e21d70 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:31.122151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddd1fc-2904-42d8-8131-ae8006e21d70 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:31.122613 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddd1fc-2904-42d8-8131-ae8006e21d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:31.151472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b509f-d5cf-4d4b-a412-1fc9dd705741 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:31.167952 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6bddd1fc-2904-42d8-8131-ae8006e21d70 None None] MFA Rules not processed for user `4401e25f8d434f8d92875f16874b8c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:31.168281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee7144-6038-46b9-96d8-a839d4e9610f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:31.169364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee7144-6038-46b9-96d8-a839d4e9610f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:31.169788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee7144-6038-46b9-96d8-a839d4e9610f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:31.169929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6bddd1fc-2904-42d8-8131-ae8006e21d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:31.170343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee7144-6038-46b9-96d8-a839d4e9610f admin admin] PATH_INFO: `/v3/projects/29c9d8cf7a764ba1ba167908ad930bd9` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:31.175068 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee7144-6038-46b9-96d8-a839d4e9610f admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c9d8cf7a764ba1ba167908ad930bd9)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:31.177259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee7144-6038-46b9-96d8-a839d4e9610f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:31.319088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 857/1676] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:31.320534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddd1fc-2904-42d8-8131-ae8006e21d70 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:31.322550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6bddd1fc-2904-42d8-8131-ae8006e21d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:31.332404 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:31.342527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-38ee7144-6038-46b9-96d8-a839d4e9610f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c9d8cf7a764ba1ba167908ad930bd9', 'request_id': 'req-38ee7144-6038-46b9-96d8-a839d4e9610f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:31.348727 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddd1fc-2904-42d8-8131-ae8006e21d70 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:31.353811 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-38ee7144-6038-46b9-96d8-a839d4e9610f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c9d8cf7a764ba1ba167908ad930bd9', 'request_id': 'req-38ee7144-6038-46b9-96d8-a839d4e9610f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:31.366846 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-38ee7144-6038-46b9-96d8-a839d4e9610f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c9d8cf7a764ba1ba167908ad930bd9', 'request_id': 'req-38ee7144-6038-46b9-96d8-a839d4e9610f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:31.387532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-38ee7144-6038-46b9-96d8-a839d4e9610f admin admin] The token cache is being invalidate because project 29c9d8cf7a764ba1ba167908ad930bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:31.387845 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-38ee7144-6038-46b9-96d8-a839d4e9610f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:31.389027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-38ee7144-6038-46b9-96d8-a839d4e9610f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:31.394944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 820/1677] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:30 2022] DELETE /identity/v3/projects/29c9d8cf7a764ba1ba167908ad930bd9 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:31.396297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee7144-6038-46b9-96d8-a839d4e9610f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:31.397735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-38ee7144-6038-46b9-96d8-a839d4e9610f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:31.462480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae06d6-458a-43ad-b2aa-343ffc5f97e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:31.463851 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae06d6-458a-43ad-b2aa-343ffc5f97e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:31.464474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae06d6-458a-43ad-b2aa-343ffc5f97e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:31.465015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae06d6-458a-43ad-b2aa-343ffc5f97e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:31.469066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-13ae06d6-458a-43ad-b2aa-343ffc5f97e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:31.494887 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee7144-6038-46b9-96d8-a839d4e9610f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:31.501712 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae06d6-458a-43ad-b2aa-343ffc5f97e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:31.503432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae06d6-458a-43ad-b2aa-343ffc5f97e6 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:31.509486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ec803-cd11-483c-8817-a0eb8fab1fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:31.510533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ec803-cd11-483c-8817-a0eb8fab1fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:31.510870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ec803-cd11-483c-8817-a0eb8fab1fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:31.511340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ec803-cd11-483c-8817-a0eb8fab1fc2 admin admin] PATH_INFO: `/v3/projects/33d537b717724273a4d7a4d2e6a95782` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:31.513285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ec803-cd11-483c-8817-a0eb8fab1fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d537b717724273a4d7a4d2e6a95782)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:31.516083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ec803-cd11-483c-8817-a0eb8fab1fc2 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:31.540195 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 858/1678] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:31.542171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cf8e3-367d-4559-b765-174d69db1f2b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:31.546349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cf8e3-367d-4559-b765-174d69db1f2b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:31.547026 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cf8e3-367d-4559-b765-174d69db1f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:31.593839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-be9cf8e3-367d-4559-b765-174d69db1f2b None None] MFA Rules not processed for user `4401e25f8d434f8d92875f16874b8c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:31.598614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-be9cf8e3-367d-4559-b765-174d69db1f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:31.669904 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-430ec803-cd11-483c-8817-a0eb8fab1fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d537b717724273a4d7a4d2e6a95782', 'request_id': 'req-430ec803-cd11-483c-8817-a0eb8fab1fc2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:31.689860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-430ec803-cd11-483c-8817-a0eb8fab1fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d537b717724273a4d7a4d2e6a95782', 'request_id': 'req-430ec803-cd11-483c-8817-a0eb8fab1fc2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:31.716007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:31.717511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-430ec803-cd11-483c-8817-a0eb8fab1fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d537b717724273a4d7a4d2e6a95782', 'request_id': 'req-430ec803-cd11-483c-8817-a0eb8fab1fc2'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:31.735407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 859/1679] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:31.736913 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91860535-a107-4a4c-b322-94515d8ab267 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:31.738028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91860535-a107-4a4c-b322-94515d8ab267 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:31.738312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91860535-a107-4a4c-b322-94515d8ab267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:31.741142 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-430ec803-cd11-483c-8817-a0eb8fab1fc2 admin admin] The token cache is being invalidate because project 33d537b717724273a4d7a4d2e6a95782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:31.741432 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-430ec803-cd11-483c-8817-a0eb8fab1fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:31.745514 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-430ec803-cd11-483c-8817-a0eb8fab1fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:31.748780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 821/1680] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:31 2022] DELETE /identity/v3/projects/33d537b717724273a4d7a4d2e6a95782 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:31.754086 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ec803-cd11-483c-8817-a0eb8fab1fc2 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:31.755945 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-430ec803-cd11-483c-8817-a0eb8fab1fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:31.768212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-91860535-a107-4a4c-b322-94515d8ab267 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:31.770048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-91860535-a107-4a4c-b322-94515d8ab267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:31.930125 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 860/1681] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:31.951477 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91860535-a107-4a4c-b322-94515d8ab267 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:31.953984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-91860535-a107-4a4c-b322-94515d8ab267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:32.029102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ec803-cd11-483c-8817-a0eb8fab1fc2 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:32.038255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341966ac-e068-44ce-a4eb-8867496ad3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:32.039340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341966ac-e068-44ce-a4eb-8867496ad3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:32.039789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341966ac-e068-44ce-a4eb-8867496ad3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:32.040526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341966ac-e068-44ce-a4eb-8867496ad3df admin admin] PATH_INFO: `/v3/users/3ba107a7f4244caeb2fd833c559a4697` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:32.046175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341966ac-e068-44ce-a4eb-8867496ad3df admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba107a7f4244caeb2fd833c559a4697)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:32.049080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341966ac-e068-44ce-a4eb-8867496ad3df admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:32.051640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:32.205874 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-341966ac-e068-44ce-a4eb-8867496ad3df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba107a7f4244caeb2fd833c559a4697'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:32.220351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91860535-a107-4a4c-b322-94515d8ab267 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:32.266524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5047c9d-80ac-4e19-8151-23d963641844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:32.269367 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5047c9d-80ac-4e19-8151-23d963641844 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:32.269647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5047c9d-80ac-4e19-8151-23d963641844 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:32.269921 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5047c9d-80ac-4e19-8151-23d963641844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:32.274382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-341966ac-e068-44ce-a4eb-8867496ad3df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba107a7f4244caeb2fd833c559a4697'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:32.275128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-341966ac-e068-44ce-a4eb-8867496ad3df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba107a7f4244caeb2fd833c559a4697'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:32.276413 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a5047c9d-80ac-4e19-8151-23d963641844 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:32.278118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-341966ac-e068-44ce-a4eb-8867496ad3df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba107a7f4244caeb2fd833c559a4697'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:32.290130 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-341966ac-e068-44ce-a4eb-8867496ad3df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba107a7f4244caeb2fd833c559a4697'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:32.324903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 822/1682] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:31 2022] DELETE /identity/v3/users/3ba107a7f4244caeb2fd833c559a4697 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:32.330309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3a47-e6a0-4a57-8baa-a7a5b7842abc None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:32.330620 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3a47-e6a0-4a57-8baa-a7a5b7842abc None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:32.330885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3a47-e6a0-4a57-8baa-a7a5b7842abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:32.430835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-83fb3a47-e6a0-4a57-8baa-a7a5b7842abc None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:32.442000 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-83fb3a47-e6a0-4a57-8baa-a7a5b7842abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:32.544738 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5047c9d-80ac-4e19-8151-23d963641844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:32.551955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5047c9d-80ac-4e19-8151-23d963641844 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:32.583802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 861/1683] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:32.601770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 823/1684] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:32.606240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5047c9d-80ac-4e19-8151-23d963641844 service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:32.608377 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a5047c9d-80ac-4e19-8151-23d963641844 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:32.666363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5047c9d-80ac-4e19-8151-23d963641844 service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:32.678510 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369927ff-8279-4f4e-8692-63d40508cf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:32.681111 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369927ff-8279-4f4e-8692-63d40508cf08 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:32.681313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369927ff-8279-4f4e-8692-63d40508cf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:32.681402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369927ff-8279-4f4e-8692-63d40508cf08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:32.684636 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369927ff-8279-4f4e-8692-63d40508cf08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:32.685013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369927ff-8279-4f4e-8692-63d40508cf08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:32.691327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369927ff-8279-4f4e-8692-63d40508cf08 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:32.722291 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 862/1685] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:32.726869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb3a47-e6a0-4a57-8baa-a7a5b7842abc None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:32.740967 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369927ff-8279-4f4e-8692-63d40508cf08 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:32.742817 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-369927ff-8279-4f4e-8692-63d40508cf08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:32.744085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb3a47-e6a0-4a57-8baa-a7a5b7842abc None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:32.786246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf95ff-3ebc-45d7-8a11-98a12eecc455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:32.787958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf95ff-3ebc-45d7-8a11-98a12eecc455 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:32.791271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf95ff-3ebc-45d7-8a11-98a12eecc455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:32.791772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf95ff-3ebc-45d7-8a11-98a12eecc455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:32.793539 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf95ff-3ebc-45d7-8a11-98a12eecc455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:32.801556 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf95ff-3ebc-45d7-8a11-98a12eecc455 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:32.870586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:32.895360 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 824/1686] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:32 2022] POST /identity/v3/projects => generated 405 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:32.899233 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf95ff-3ebc-45d7-8a11-98a12eecc455 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:33.072417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369927ff-8279-4f4e-8692-63d40508cf08 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:33.203721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:33.225083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf95ff-3ebc-45d7-8a11-98a12eecc455 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:33.257270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91ab54-d38c-4a59-b80c-4d22ece8a1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:33.257270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91ab54-d38c-4a59-b80c-4d22ece8a1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:33.257581 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91ab54-d38c-4a59-b80c-4d22ece8a1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:33.257866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91ab54-d38c-4a59-b80c-4d22ece8a1d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:33.258583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91ab54-d38c-4a59-b80c-4d22ece8a1d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:33.273504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91ab54-d38c-4a59-b80c-4d22ece8a1d8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:33.292448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c82497-4218-4802-8ec5-4c5d056c4d1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1146aa09d30458f9ab3b3bec8f94233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:33.293561 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c82497-4218-4802-8ec5-4c5d056c4d1f service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:33.294278 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c82497-4218-4802-8ec5-4c5d056c4d1f service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:33.294752 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c82497-4218-4802-8ec5-4c5d056c4d1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:33.301071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-75c82497-4218-4802-8ec5-4c5d056c4d1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:33.376146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 825/1687] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:32 2022] POST /identity/v3/users => generated 303 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:33.377180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91ab54-d38c-4a59-b80c-4d22ece8a1d8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:33.387223 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c82497-4218-4802-8ec5-4c5d056c4d1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:33.389736 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c82497-4218-4802-8ec5-4c5d056c4d1f service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:33.423531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 863/1688] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:33.428535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91ab54-d38c-4a59-b80c-4d22ece8a1d8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:33.465774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fecaca9-4bdc-46b6-90f4-52fcec9c282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:33.465878 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecaca9-4bdc-46b6-90f4-52fcec9c282d admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:33.471382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecaca9-4bdc-46b6-90f4-52fcec9c282d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:33.471861 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecaca9-4bdc-46b6-90f4-52fcec9c282d admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:33.472568 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fecaca9-4bdc-46b6-90f4-52fcec9c282d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:33.474248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fecaca9-4bdc-46b6-90f4-52fcec9c282d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:33.568804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 826/1689] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:33.576331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c82497-4218-4802-8ec5-4c5d056c4d1f service placement] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:33.600618 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c82497-4218-4802-8ec5-4c5d056c4d1f service placement] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:33.623096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a34010-de0a-487a-8e10-5f55fa28f3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:33.630848 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a34010-de0a-487a-8e10-5f55fa28f3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:33.631201 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a34010-de0a-487a-8e10-5f55fa28f3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:33.631517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a34010-de0a-487a-8e10-5f55fa28f3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:33.635256 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a34010-de0a-487a-8e10-5f55fa28f3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:33.641501 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a34010-de0a-487a-8e10-5f55fa28f3b9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:33.696922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 864/1690] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:33.701437 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fecaca9-4bdc-46b6-90f4-52fcec9c282d admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:33.731676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fecaca9-4bdc-46b6-90f4-52fcec9c282d admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:33.733191 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bba710-2ff8-49b0-9cc7-7d84dcb1c899 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:33.734935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bba710-2ff8-49b0-9cc7-7d84dcb1c899 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:33.734935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bba710-2ff8-49b0-9cc7-7d84dcb1c899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:33.742867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ace8c-b351-4db6-92be-4097f2ffbbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:33.746291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ace8c-b351-4db6-92be-4097f2ffbbc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:33.746955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ace8c-b351-4db6-92be-4097f2ffbbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:33.747430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ace8c-b351-4db6-92be-4097f2ffbbc1 admin admin] PATH_INFO: `/v3/projects/d485184593514f55b3db88ed22d0cede/users/9cf24564935441558571d669060e7311/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:33.801834 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ace8c-b351-4db6-92be-4097f2ffbbc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d485184593514f55b3db88ed22d0cede, user_id=9cf24564935441558571d669060e7311, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:33.809037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ace8c-b351-4db6-92be-4097f2ffbbc1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:33.813472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e4bba710-2ff8-49b0-9cc7-7d84dcb1c899 None None] MFA Rules not processed for user `4df9cba16cec44d3ab51d8f17258db75`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:33.814886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e4bba710-2ff8-49b0-9cc7-7d84dcb1c899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:33.867858 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 827/1691] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:33 2022] PUT /identity/v3/projects/d485184593514f55b3db88ed22d0cede/users/9cf24564935441558571d669060e7311/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:30:33.876223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18885d65-2668-4783-bb7f-f59eeb009399 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:33.879217 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18885d65-2668-4783-bb7f-f59eeb009399 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:33.879744 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18885d65-2668-4783-bb7f-f59eeb009399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:34.036643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-18885d65-2668-4783-bb7f-f59eeb009399 None None] MFA Rules not processed for user `9cf24564935441558571d669060e7311`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:34.037935 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-18885d65-2668-4783-bb7f-f59eeb009399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:34.191722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 865/1692] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:34.198207 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bba710-2ff8-49b0-9cc7-7d84dcb1c899 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:34.201118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e4bba710-2ff8-49b0-9cc7-7d84dcb1c899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:34.236235 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bba710-2ff8-49b0-9cc7-7d84dcb1c899 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:34.438661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:34.448077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 828/1693] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 573 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:34.449837 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18885d65-2668-4783-bb7f-f59eeb009399 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:34.458078 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-18885d65-2668-4783-bb7f-f59eeb009399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:34.470080 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:34.471313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:34.473859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:34.474348 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] PATH_INFO: `/v3/projects/72a98fdda4374e08a24816e0c961083d` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:34.478768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a98fdda4374e08a24816e0c961083d)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:34.480121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: WARNING py.warnings [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:30:34.480121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: warnings.warn(msg) Jul 21 08:30:34.480121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: Jul 21 08:30:34.486909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:34.513724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18885d65-2668-4783-bb7f-f59eeb009399 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:34.538054 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46652957-4e24-42bb-9a13-34c25575a219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:34.542196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46652957-4e24-42bb-9a13-34c25575a219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:34.544884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46652957-4e24-42bb-9a13-34c25575a219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:34.545243 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46652957-4e24-42bb-9a13-34c25575a219 admin admin] PATH_INFO: `/v3/users/c95f2ee426514d89afcec7ab5ea2634c` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:34.551316 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46652957-4e24-42bb-9a13-34c25575a219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c95f2ee426514d89afcec7ab5ea2634c)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:34.563051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46652957-4e24-42bb-9a13-34c25575a219 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:34.741402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a98fdda4374e08a24816e0c961083d', 'request_id': 'req-6267c82c-4f95-491f-8905-a6061f082ee6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:34.749123 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-46652957-4e24-42bb-9a13-34c25575a219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c95f2ee426514d89afcec7ab5ea2634c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:34.764857 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a98fdda4374e08a24816e0c961083d', 'request_id': 'req-6267c82c-4f95-491f-8905-a6061f082ee6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:34.788206 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-46652957-4e24-42bb-9a13-34c25575a219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c95f2ee426514d89afcec7ab5ea2634c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:34.793576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a98fdda4374e08a24816e0c961083d', 'request_id': 'req-6267c82c-4f95-491f-8905-a6061f082ee6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:34.800221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-46652957-4e24-42bb-9a13-34c25575a219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c95f2ee426514d89afcec7ab5ea2634c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:34.800956 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-46652957-4e24-42bb-9a13-34c25575a219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c95f2ee426514d89afcec7ab5ea2634c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:34.835301 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-46652957-4e24-42bb-9a13-34c25575a219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c95f2ee426514d89afcec7ab5ea2634c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:34.869469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] The token cache is being invalidate because project 72a98fdda4374e08a24816e0c961083d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:34.869768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:34.871399 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:34.874301 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 866/1694] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:34 2022] DELETE /identity/v3/projects/72a98fdda4374e08a24816e0c961083d => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:34.875736 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:34.884776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 829/1695] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:34 2022] DELETE /identity/v3/users/c95f2ee426514d89afcec7ab5ea2634c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:34.886321 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8262-7684-43ad-a26d-ee009890144f None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:34.886614 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8262-7684-43ad-a26d-ee009890144f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:34.886897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8262-7684-43ad-a26d-ee009890144f None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:34.889961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:34.896775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 830/1696] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 21 08:30:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:34.898800 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404853e4-d77c-43cd-80ee-9a7031d8f9de None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:34.899232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404853e4-d77c-43cd-80ee-9a7031d8f9de None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:34.899808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404853e4-d77c-43cd-80ee-9a7031d8f9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:34.937382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-404853e4-d77c-43cd-80ee-9a7031d8f9de None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:34.943024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-404853e4-d77c-43cd-80ee-9a7031d8f9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:34.962436 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:35.121172 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 831/1697] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:35.124318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af8388-827c-4ee4-b924-19145f92b5a0 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:35.130158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af8388-827c-4ee4-b924-19145f92b5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:35.131080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af8388-827c-4ee4-b924-19145f92b5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:35.255012 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267c82c-4f95-491f-8905-a6061f082ee6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:35.258725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f8af8388-827c-4ee4-b924-19145f92b5a0 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:35.263151 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f8af8388-827c-4ee4-b924-19145f92b5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:35.269915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7edb2-9bad-4a5b-b782-195b77dab913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:35.272536 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7edb2-9bad-4a5b-b782-195b77dab913 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:35.274339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7edb2-9bad-4a5b-b782-195b77dab913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:35.274808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7edb2-9bad-4a5b-b782-195b77dab913 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:35.278294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7edb2-9bad-4a5b-b782-195b77dab913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:35.288152 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7edb2-9bad-4a5b-b782-195b77dab913 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:35.302325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 832/1698] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:35.304364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aefe6a-8a77-4317-8d59-a60a63e40c3b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:35.311971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aefe6a-8a77-4317-8d59-a60a63e40c3b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:35.312767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aefe6a-8a77-4317-8d59-a60a63e40c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:35.338235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-58aefe6a-8a77-4317-8d59-a60a63e40c3b None None] MFA Rules not processed for user `1d737a8a33da490db5d59ffed92bee60`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:35.339737 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-58aefe6a-8a77-4317-8d59-a60a63e40c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:35.390010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 867/1699] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:34 2022] POST /identity/v3/projects => generated 403 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:35.395443 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524808c7-bdcc-4a05-a6bf-4ba13803a503 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:35.396365 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524808c7-bdcc-4a05-a6bf-4ba13803a503 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:35.397002 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524808c7-bdcc-4a05-a6bf-4ba13803a503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:35.438666 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-524808c7-bdcc-4a05-a6bf-4ba13803a503 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:35.439952 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-524808c7-bdcc-4a05-a6bf-4ba13803a503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:35.508364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 833/1700] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 08:30:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:35.509540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aefe6a-8a77-4317-8d59-a60a63e40c3b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:35.514585 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-58aefe6a-8a77-4317-8d59-a60a63e40c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:35.541678 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aefe6a-8a77-4317-8d59-a60a63e40c3b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:35.641976 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cb8d1-790f-4cd5-b680-d420728deeb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:35.642735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cb8d1-790f-4cd5-b680-d420728deeb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:35.642897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cb8d1-790f-4cd5-b680-d420728deeb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:35.643127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cb8d1-790f-4cd5-b680-d420728deeb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:35.644089 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 868/1701] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:35.646860 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524808c7-bdcc-4a05-a6bf-4ba13803a503 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:35.669686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cb8d1-790f-4cd5-b680-d420728deeb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:35.674643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cb8d1-790f-4cd5-b680-d420728deeb2 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:35.679632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524808c7-bdcc-4a05-a6bf-4ba13803a503 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:35.693798 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b1641-84fa-4fc1-bb78-27cb7c26c23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:35.698006 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b1641-84fa-4fc1-bb78-27cb7c26c23b admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:35.698345 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b1641-84fa-4fc1-bb78-27cb7c26c23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:35.698626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b1641-84fa-4fc1-bb78-27cb7c26c23b admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:35.699389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b1641-84fa-4fc1-bb78-27cb7c26c23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:35.699860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 834/1702] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:35.703511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cb8d1-790f-4cd5-b680-d420728deeb2 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:35.703891 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b1641-84fa-4fc1-bb78-27cb7c26c23b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:35.738349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:35.742247 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cb8d1-790f-4cd5-b680-d420728deeb2 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:35.798627 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971906fa-a927-44d2-95aa-84f064397db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:35.799776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971906fa-a927-44d2-95aa-84f064397db3 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:35.811626 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971906fa-a927-44d2-95aa-84f064397db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:35.811626 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971906fa-a927-44d2-95aa-84f064397db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:35.811837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 869/1703] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:35 2022] POST /identity/v3/users => generated 308 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:35.811837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b1641-84fa-4fc1-bb78-27cb7c26c23b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:35.834809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971906fa-a927-44d2-95aa-84f064397db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:35.834809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971906fa-a927-44d2-95aa-84f064397db3 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:35.857855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b1641-84fa-4fc1-bb78-27cb7c26c23b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:35.871994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c341f9-d95e-4a59-8426-cf511159dbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:35.875250 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c341f9-d95e-4a59-8426-cf511159dbed admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:35.875610 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c341f9-d95e-4a59-8426-cf511159dbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:35.876045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c341f9-d95e-4a59-8426-cf511159dbed admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:35.879366 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c341f9-d95e-4a59-8426-cf511159dbed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:35.879722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c341f9-d95e-4a59-8426-cf511159dbed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:35.881411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c341f9-d95e-4a59-8426-cf511159dbed admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:35.890578 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 835/1704] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:35.892029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971906fa-a927-44d2-95aa-84f064397db3 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:35.933765 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 870/1705] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:35.937206 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c341f9-d95e-4a59-8426-cf511159dbed admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:35.983232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971906fa-a927-44d2-95aa-84f064397db3 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:36.007924 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c341f9-d95e-4a59-8426-cf511159dbed admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:36.012567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3757c9-d075-4410-94c1-a2dc5c785341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:36.013368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3757c9-d075-4410-94c1-a2dc5c785341 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:36.013658 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3757c9-d075-4410-94c1-a2dc5c785341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:36.013942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3757c9-d075-4410-94c1-a2dc5c785341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:36.014967 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3757c9-d075-4410-94c1-a2dc5c785341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:36.018276 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3757c9-d075-4410-94c1-a2dc5c785341 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:36.033438 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da2d1c-c55f-495f-b907-adcc8c1cf2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:36.034520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da2d1c-c55f-495f-b907-adcc8c1cf2ec admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:36.034999 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da2d1c-c55f-495f-b907-adcc8c1cf2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:36.039057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da2d1c-c55f-495f-b907-adcc8c1cf2ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:36.039496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da2d1c-c55f-495f-b907-adcc8c1cf2ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:36.051875 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da2d1c-c55f-495f-b907-adcc8c1cf2ec admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:36.080365 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 836/1706] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:36.091332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3757c9-d075-4410-94c1-a2dc5c785341 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:36.118092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 871/1707] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:35 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:36.120409 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da2d1c-c55f-495f-b907-adcc8c1cf2ec admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:36.146045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3757c9-d075-4410-94c1-a2dc5c785341 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:36.325441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:36.386793 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da2d1c-c55f-495f-b907-adcc8c1cf2ec admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:36.407583 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d019e-a502-4ad3-afe3-6fda1562f094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:36.412327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d019e-a502-4ad3-afe3-6fda1562f094 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:36.415267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d019e-a502-4ad3-afe3-6fda1562f094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:36.416586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d019e-a502-4ad3-afe3-6fda1562f094 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:36.425399 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d019e-a502-4ad3-afe3-6fda1562f094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:36.427753 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d019e-a502-4ad3-afe3-6fda1562f094 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:36.479008 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f063d-b4ad-48ef-bea7-8d1eff592b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:36.481036 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f063d-b4ad-48ef-bea7-8d1eff592b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:36.486553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f063d-b4ad-48ef-bea7-8d1eff592b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:36.486880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f063d-b4ad-48ef-bea7-8d1eff592b8e admin admin] PATH_INFO: `/v3/projects/b493933d139e4607a2f5e477e3b0db9d/users/b03ac0a5eaf94c89bd3fe993587adf21/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:36.533104 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 872/1708] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:36 2022] POST /identity/v3/users => generated 283 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:30:36.534303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d019e-a502-4ad3-afe3-6fda1562f094 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:36.536268 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-300d019e-a502-4ad3-afe3-6fda1562f094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:36.558194 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f063d-b4ad-48ef-bea7-8d1eff592b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b493933d139e4607a2f5e477e3b0db9d, user_id=b03ac0a5eaf94c89bd3fe993587adf21, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:36.574488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d019e-a502-4ad3-afe3-6fda1562f094 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:36.576615 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f063d-b4ad-48ef-bea7-8d1eff592b8e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:36.585432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d7d42-7270-453f-8a2e-c57a495f947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:36.586960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d7d42-7270-453f-8a2e-c57a495f947f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:36.587516 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d7d42-7270-453f-8a2e-c57a495f947f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:36.588279 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d7d42-7270-453f-8a2e-c57a495f947f admin admin] PATH_INFO: `/v3/users/a7ed496bc9ef4eb9b3c1da70ab5f7b89` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:36.590303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d7d42-7270-453f-8a2e-c57a495f947f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ed496bc9ef4eb9b3c1da70ab5f7b89)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:36.593032 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d7d42-7270-453f-8a2e-c57a495f947f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:36.626794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 837/1709] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:36 2022] PUT /identity/v3/projects/b493933d139e4607a2f5e477e3b0db9d/users/b03ac0a5eaf94c89bd3fe993587adf21/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:36.636550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f063d-b4ad-48ef-bea7-8d1eff592b8e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:36.756920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-812d7d42-7270-453f-8a2e-c57a495f947f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ed496bc9ef4eb9b3c1da70ab5f7b89'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:36.757616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-812d7d42-7270-453f-8a2e-c57a495f947f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ed496bc9ef4eb9b3c1da70ab5f7b89'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:36.760004 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-812d7d42-7270-453f-8a2e-c57a495f947f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ed496bc9ef4eb9b3c1da70ab5f7b89'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:36.789453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-812d7d42-7270-453f-8a2e-c57a495f947f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ed496bc9ef4eb9b3c1da70ab5f7b89'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:36.853572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-812d7d42-7270-453f-8a2e-c57a495f947f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ed496bc9ef4eb9b3c1da70ab5f7b89'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:36.858066 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f063d-b4ad-48ef-bea7-8d1eff592b8e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:36.881262 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d52663-af71-4d50-82eb-65d3d6a6a1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:36.883304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d52663-af71-4d50-82eb-65d3d6a6a1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:36.883906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d52663-af71-4d50-82eb-65d3d6a6a1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:36.884189 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d52663-af71-4d50-82eb-65d3d6a6a1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:36.888617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d52663-af71-4d50-82eb-65d3d6a6a1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:36.894297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d52663-af71-4d50-82eb-65d3d6a6a1f4 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:36.925385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 873/1710] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:36 2022] DELETE /identity/v3/users/a7ed496bc9ef4eb9b3c1da70ab5f7b89 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:36.926069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d7d42-7270-453f-8a2e-c57a495f947f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:36.927808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-812d7d42-7270-453f-8a2e-c57a495f947f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:36.931976 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 838/1711] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:36.942068 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f08c6d-3475-4afe-9a75-dfd8a014488a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:36.942871 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f08c6d-3475-4afe-9a75-dfd8a014488a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:36.943476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f08c6d-3475-4afe-9a75-dfd8a014488a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:36.993174 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e6f08c6d-3475-4afe-9a75-dfd8a014488a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:36.995232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e6f08c6d-3475-4afe-9a75-dfd8a014488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:37.029660 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:INSERT=8,keystone:SELECT=82,keystone:DELETE=10 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:37.172448 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 839/1712] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:37.173442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f08c6d-3475-4afe-9a75-dfd8a014488a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:37.180122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e6f08c6d-3475-4afe-9a75-dfd8a014488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:37.238395 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f08c6d-3475-4afe-9a75-dfd8a014488a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:37.258928 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2723a7-5d3a-4463-84d9-1d12225f12d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:37.277479 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2723a7-5d3a-4463-84d9-1d12225f12d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:37.281559 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2723a7-5d3a-4463-84d9-1d12225f12d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:37.282055 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2723a7-5d3a-4463-84d9-1d12225f12d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:37.284095 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2723a7-5d3a-4463-84d9-1d12225f12d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:37.295051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2723a7-5d3a-4463-84d9-1d12225f12d5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:37.325229 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d7d42-7270-453f-8a2e-c57a495f947f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:37.336138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bff6d-dbed-49bb-aace-3e7654311cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:37.337175 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bff6d-dbed-49bb-aace-3e7654311cac admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:37.337705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bff6d-dbed-49bb-aace-3e7654311cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:37.338083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bff6d-dbed-49bb-aace-3e7654311cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:37.339067 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bff6d-dbed-49bb-aace-3e7654311cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:37.343206 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bff6d-dbed-49bb-aace-3e7654311cac admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:37.350379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 840/1713] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:37.351408 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2723a7-5d3a-4463-84d9-1d12225f12d5 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:37.359237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 874/1714] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:37.359836 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1e2723a7-5d3a-4463-84d9-1d12225f12d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:37.360716 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bff6d-dbed-49bb-aace-3e7654311cac admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:37.364200 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-411bff6d-dbed-49bb-aace-3e7654311cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:37.388335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bff6d-dbed-49bb-aace-3e7654311cac admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:37.401216 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e813d-5f66-4618-966e-94e6ecaf9457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:37.406853 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e813d-5f66-4618-966e-94e6ecaf9457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:37.407432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e813d-5f66-4618-966e-94e6ecaf9457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:37.407953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e813d-5f66-4618-966e-94e6ecaf9457 admin admin] PATH_INFO: `/v3/projects/dbbb0cddb8c447d2bca523eed4d63144` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:37.409887 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e813d-5f66-4618-966e-94e6ecaf9457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbbb0cddb8c447d2bca523eed4d63144)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:37.412521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e813d-5f66-4618-966e-94e6ecaf9457 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:37.596794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bf3e813d-5f66-4618-966e-94e6ecaf9457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbbb0cddb8c447d2bca523eed4d63144', 'request_id': 'req-bf3e813d-5f66-4618-966e-94e6ecaf9457'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:37.629666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:37.639107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bf3e813d-5f66-4618-966e-94e6ecaf9457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbbb0cddb8c447d2bca523eed4d63144', 'request_id': 'req-bf3e813d-5f66-4618-966e-94e6ecaf9457'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:37.660086 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bf3e813d-5f66-4618-966e-94e6ecaf9457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbbb0cddb8c447d2bca523eed4d63144', 'request_id': 'req-bf3e813d-5f66-4618-966e-94e6ecaf9457'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:37.663203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2723a7-5d3a-4463-84d9-1d12225f12d5 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:37.696648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bf3e813d-5f66-4618-966e-94e6ecaf9457 admin admin] The token cache is being invalidate because project dbbb0cddb8c447d2bca523eed4d63144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:37.697017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bf3e813d-5f66-4618-966e-94e6ecaf9457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:37.697766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bf3e813d-5f66-4618-966e-94e6ecaf9457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:37.700391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 875/1715] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:37 2022] DELETE /identity/v3/projects/dbbb0cddb8c447d2bca523eed4d63144 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:37.701358 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e813d-5f66-4618-966e-94e6ecaf9457 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:37.707800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-bf3e813d-5f66-4618-966e-94e6ecaf9457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:37.847874 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afc308-c679-4f7a-90d7-684cd8eaeafa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:37.850261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afc308-c679-4f7a-90d7-684cd8eaeafa service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:37.850553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afc308-c679-4f7a-90d7-684cd8eaeafa service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:37.853231 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afc308-c679-4f7a-90d7-684cd8eaeafa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:37.869672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a4afc308-c679-4f7a-90d7-684cd8eaeafa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:37.909193 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e813d-5f66-4618-966e-94e6ecaf9457 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:37.917201 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df8b92-b788-49a1-9d62-ba94c7dd6f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:37.918190 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df8b92-b788-49a1-9d62-ba94c7dd6f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:37.918478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df8b92-b788-49a1-9d62-ba94c7dd6f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:37.918777 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df8b92-b788-49a1-9d62-ba94c7dd6f12 admin admin] PATH_INFO: `/v3/projects/697c6aec410f48ffa517c42d04f35dec/users/d3e79e6ec64e488783e7fc3a6543685f/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:37.997796 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df8b92-b788-49a1-9d62-ba94c7dd6f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697c6aec410f48ffa517c42d04f35dec, user_id=d3e79e6ec64e488783e7fc3a6543685f, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:38.021503 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df8b92-b788-49a1-9d62-ba94c7dd6f12 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:38.106614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 876/1716] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:37 2022] PUT /identity/v3/projects/697c6aec410f48ffa517c42d04f35dec/users/d3e79e6ec64e488783e7fc3a6543685f/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:38.108727 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df8b92-b788-49a1-9d62-ba94c7dd6f12 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:38.120906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-63df8b92-b788-49a1-9d62-ba94c7dd6f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:38.166342 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afc308-c679-4f7a-90d7-684cd8eaeafa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:38.169208 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afc308-c679-4f7a-90d7-684cd8eaeafa service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:38.185329 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 841/1717] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 834 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:38.187412 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92921a8-f5c0-40e2-b545-f21394f397a3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:38.188120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92921a8-f5c0-40e2-b545-f21394f397a3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:38.190437 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92921a8-f5c0-40e2-b545-f21394f397a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:38.210394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c92921a8-f5c0-40e2-b545-f21394f397a3 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:38.211814 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c92921a8-f5c0-40e2-b545-f21394f397a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:38.216529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:38.372566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df8b92-b788-49a1-9d62-ba94c7dd6f12 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:38.385406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 842/1718] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:38.389271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455cb10-cdfb-48a4-a81e-166927d20252 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:38.389446 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455cb10-cdfb-48a4-a81e-166927d20252 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:38.389666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455cb10-cdfb-48a4-a81e-166927d20252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:38.400559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1464cc1-adee-4f7d-84c4-8f87454d22be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:38.407941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1464cc1-adee-4f7d-84c4-8f87454d22be admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:38.409013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1464cc1-adee-4f7d-84c4-8f87454d22be admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:38.409822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1464cc1-adee-4f7d-84c4-8f87454d22be admin admin] PATH_INFO: `/v3/projects/b493933d139e4607a2f5e477e3b0db9d/users/b03ac0a5eaf94c89bd3fe993587adf21/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:38.423823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1464cc1-adee-4f7d-84c4-8f87454d22be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b493933d139e4607a2f5e477e3b0db9d, user_id=b03ac0a5eaf94c89bd3fe993587adf21, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:38.436716 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1464cc1-adee-4f7d-84c4-8f87454d22be admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:38.467429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1455cb10-cdfb-48a4-a81e-166927d20252 None None] MFA Rules not processed for user `d3e79e6ec64e488783e7fc3a6543685f`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:38.471874 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1455cb10-cdfb-48a4-a81e-166927d20252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:38.486083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 877/1719] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:38 2022] PUT /identity/v3/projects/b493933d139e4607a2f5e477e3b0db9d/users/b03ac0a5eaf94c89bd3fe993587adf21/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:38.490868 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3462dc8-cc4b-48ce-bc82-7df8ffd6d967 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:38.492632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3462dc8-cc4b-48ce-bc82-7df8ffd6d967 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:38.493246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3462dc8-cc4b-48ce-bc82-7df8ffd6d967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:38.605021 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b3462dc8-cc4b-48ce-bc82-7df8ffd6d967 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:38.610124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b3462dc8-cc4b-48ce-bc82-7df8ffd6d967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:38.705130 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:38.804531 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 843/1720] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:38.817814 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6e476-2c8c-49ac-ac28-e787a93182a1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:38.820659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6e476-2c8c-49ac-ac28-e787a93182a1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:38.821215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6e476-2c8c-49ac-ac28-e787a93182a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:38.910311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-52a6e476-2c8c-49ac-ac28-e787a93182a1 None None] MFA Rules not processed for user `b03ac0a5eaf94c89bd3fe993587adf21`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:38.913946 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-52a6e476-2c8c-49ac-ac28-e787a93182a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:38.922466 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 878/1721] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:38.924415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6d93e-c0cc-4ea0-8763-dae06876a825 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:38.924415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6d93e-c0cc-4ea0-8763-dae06876a825 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:38.925485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6d93e-c0cc-4ea0-8763-dae06876a825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:39.070730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a2d6d93e-c0cc-4ea0-8763-dae06876a825 None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:39.072340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a2d6d93e-c0cc-4ea0-8763-dae06876a825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:39.114739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 844/1722] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:39.115734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6e476-2c8c-49ac-ac28-e787a93182a1 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:39.140993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6e476-2c8c-49ac-ac28-e787a93182a1 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:39.154655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6d052-7681-4e3a-b3cf-8ed3247a0852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:39.155706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6d052-7681-4e3a-b3cf-8ed3247a0852 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:39.156007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6d052-7681-4e3a-b3cf-8ed3247a0852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:39.156285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6d052-7681-4e3a-b3cf-8ed3247a0852 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:39.157343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6d052-7681-4e3a-b3cf-8ed3247a0852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:39.161431 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6d052-7681-4e3a-b3cf-8ed3247a0852 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:39.246551 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 845/1723] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:39 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:39.247686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6d052-7681-4e3a-b3cf-8ed3247a0852 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:39.336319 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 879/1724] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 08:30:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:39.337674 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6d93e-c0cc-4ea0-8763-dae06876a825 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:39.339237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a2d6d93e-c0cc-4ea0-8763-dae06876a825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:39.463769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:39.507315 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6d052-7681-4e3a-b3cf-8ed3247a0852 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:39.524918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ef12d-2202-45d1-ae2f-12faa7996580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:39.525931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ef12d-2202-45d1-ae2f-12faa7996580 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:39.526373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ef12d-2202-45d1-ae2f-12faa7996580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:39.527133 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ef12d-2202-45d1-ae2f-12faa7996580 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:39.528108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ef12d-2202-45d1-ae2f-12faa7996580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:39.528581 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ef12d-2202-45d1-ae2f-12faa7996580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:39.541591 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ef12d-2202-45d1-ae2f-12faa7996580 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:39.552857 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6d93e-c0cc-4ea0-8763-dae06876a825 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:39.575792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 846/1725] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:39.580335 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ef12d-2202-45d1-ae2f-12faa7996580 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:39.603449 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ef12d-2202-45d1-ae2f-12faa7996580 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:39.616572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c2877-2a8c-40ee-a225-7e13c51b878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:39.617281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c2877-2a8c-40ee-a225-7e13c51b878e admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:39.617958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c2877-2a8c-40ee-a225-7e13c51b878e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:39.617958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c2877-2a8c-40ee-a225-7e13c51b878e admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:39.618912 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c2877-2a8c-40ee-a225-7e13c51b878e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:39.625302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c2877-2a8c-40ee-a225-7e13c51b878e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:39.674774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6bfe2-50c8-436b-94db-e7b78f69ab8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:39.675465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6bfe2-50c8-436b-94db-e7b78f69ab8e service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:39.675800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6bfe2-50c8-436b-94db-e7b78f69ab8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:39.676076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6bfe2-50c8-436b-94db-e7b78f69ab8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:39.701394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 847/1726] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:39 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:39.702089 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c2877-2a8c-40ee-a225-7e13c51b878e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:39.710061 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5b7c2877-2a8c-40ee-a225-7e13c51b878e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:39.739819 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c2877-2a8c-40ee-a225-7e13c51b878e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:39.746384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623a758-9d70-42c8-886e-e6244d0338d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:39.748363 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623a758-9d70-42c8-886e-e6244d0338d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:39.748756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623a758-9d70-42c8-886e-e6244d0338d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:39.749352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623a758-9d70-42c8-886e-e6244d0338d8 admin admin] PATH_INFO: `/v3/projects/61434fd155e34d04a5ee2b66286170dd` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:39.752029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623a758-9d70-42c8-886e-e6244d0338d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61434fd155e34d04a5ee2b66286170dd)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:39.755692 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623a758-9d70-42c8-886e-e6244d0338d8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:39.784646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:39.796161 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6bfe2-50c8-436b-94db-e7b78f69ab8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:39.797844 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6bfe2-50c8-436b-94db-e7b78f69ab8e service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:39.824306 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 880/1727] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:39 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:39.825424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6bfe2-50c8-436b-94db-e7b78f69ab8e service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:39.842689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6bfe2-50c8-436b-94db-e7b78f69ab8e service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:39.854953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d61d0-dd51-47f7-9c6f-6869d9d3476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:39.855897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d61d0-dd51-47f7-9c6f-6869d9d3476b admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:39.856276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d61d0-dd51-47f7-9c6f-6869d9d3476b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:39.856904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d61d0-dd51-47f7-9c6f-6869d9d3476b admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:39.858274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d61d0-dd51-47f7-9c6f-6869d9d3476b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:39.862227 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d61d0-dd51-47f7-9c6f-6869d9d3476b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:39.925838 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4623a758-9d70-42c8-886e-e6244d0338d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61434fd155e34d04a5ee2b66286170dd', 'request_id': 'req-4623a758-9d70-42c8-886e-e6244d0338d8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:39.930629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 881/1728] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:39 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:39.932081 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d61d0-dd51-47f7-9c6f-6869d9d3476b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:39.945640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4623a758-9d70-42c8-886e-e6244d0338d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61434fd155e34d04a5ee2b66286170dd', 'request_id': 'req-4623a758-9d70-42c8-886e-e6244d0338d8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:39.964824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4623a758-9d70-42c8-886e-e6244d0338d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61434fd155e34d04a5ee2b66286170dd', 'request_id': 'req-4623a758-9d70-42c8-886e-e6244d0338d8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:39.984573 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4623a758-9d70-42c8-886e-e6244d0338d8 admin admin] The token cache is being invalidate because project 61434fd155e34d04a5ee2b66286170dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:39.985190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4623a758-9d70-42c8-886e-e6244d0338d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:39.986246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4623a758-9d70-42c8-886e-e6244d0338d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:39.989179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 848/1729] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:39 2022] DELETE /identity/v3/projects/61434fd155e34d04a5ee2b66286170dd => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:39.990094 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623a758-9d70-42c8-886e-e6244d0338d8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:39.996061 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4623a758-9d70-42c8-886e-e6244d0338d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:40.143894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d61d0-dd51-47f7-9c6f-6869d9d3476b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:40.175347 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b9123-ee72-4811-8d41-0aa53d862aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:40.176041 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b9123-ee72-4811-8d41-0aa53d862aee admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:40.176329 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b9123-ee72-4811-8d41-0aa53d862aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:40.176605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b9123-ee72-4811-8d41-0aa53d862aee admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:40.177347 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b9123-ee72-4811-8d41-0aa53d862aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:40.188288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b9123-ee72-4811-8d41-0aa53d862aee admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:40.228901 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 882/1730] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:40.229695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b9123-ee72-4811-8d41-0aa53d862aee admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:40.241643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a11b9123-ee72-4811-8d41-0aa53d862aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:40.252165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623a758-9d70-42c8-886e-e6244d0338d8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:40.282459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:40.290667 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b9123-ee72-4811-8d41-0aa53d862aee admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:40.319742 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e382d-9ae2-4dea-a121-62a3aeb69a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:40.320538 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e382d-9ae2-4dea-a121-62a3aeb69a75 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:40.320833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e382d-9ae2-4dea-a121-62a3aeb69a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:40.321116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e382d-9ae2-4dea-a121-62a3aeb69a75 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:40.321981 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e382d-9ae2-4dea-a121-62a3aeb69a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:40.328801 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e382d-9ae2-4dea-a121-62a3aeb69a75 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:40.403514 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 883/1731] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:40 2022] POST /identity/v3/users => generated 283 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:40.406890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e382d-9ae2-4dea-a121-62a3aeb69a75 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:40.413016 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b72e382d-9ae2-4dea-a121-62a3aeb69a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:40.448850 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e382d-9ae2-4dea-a121-62a3aeb69a75 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:40.452828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc564cc-3de9-482e-a17b-c806a7feabee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:40.454573 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc564cc-3de9-482e-a17b-c806a7feabee service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:40.455647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc564cc-3de9-482e-a17b-c806a7feabee service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:40.455647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc564cc-3de9-482e-a17b-c806a7feabee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:40.459142 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bbc564cc-3de9-482e-a17b-c806a7feabee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:40.468623 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a007778-f32a-4ed9-b129-6e36ff73d26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:40.472253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a007778-f32a-4ed9-b129-6e36ff73d26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:40.474097 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a007778-f32a-4ed9-b129-6e36ff73d26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:40.476862 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a007778-f32a-4ed9-b129-6e36ff73d26b admin admin] PATH_INFO: `/v3/users/af383a0516994eccaa0cf7fc56398c35` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:40.480197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a007778-f32a-4ed9-b129-6e36ff73d26b admin admin] RBAC: Authorizing `identity:delete_user(user_id=af383a0516994eccaa0cf7fc56398c35)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:40.488114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a007778-f32a-4ed9-b129-6e36ff73d26b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:40.559709 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:40.647455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6a007778-f32a-4ed9-b129-6e36ff73d26b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af383a0516994eccaa0cf7fc56398c35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:40.654079 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6a007778-f32a-4ed9-b129-6e36ff73d26b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af383a0516994eccaa0cf7fc56398c35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:40.657120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6a007778-f32a-4ed9-b129-6e36ff73d26b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af383a0516994eccaa0cf7fc56398c35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:40.684820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc564cc-3de9-482e-a17b-c806a7feabee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:40.690637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6a007778-f32a-4ed9-b129-6e36ff73d26b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af383a0516994eccaa0cf7fc56398c35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:40.695743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc564cc-3de9-482e-a17b-c806a7feabee service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:40.720901 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6a007778-f32a-4ed9-b129-6e36ff73d26b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af383a0516994eccaa0cf7fc56398c35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:40.733443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 849/1732] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:30:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:30:40.743987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc564cc-3de9-482e-a17b-c806a7feabee service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:40.752209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bbc564cc-3de9-482e-a17b-c806a7feabee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:40.824363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 884/1733] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:40 2022] DELETE /identity/v3/users/af383a0516994eccaa0cf7fc56398c35 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:40.835157 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a007778-f32a-4ed9-b129-6e36ff73d26b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:40.836451 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6a007778-f32a-4ed9-b129-6e36ff73d26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:40.837205 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc564cc-3de9-482e-a17b-c806a7feabee service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:41.344775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8dc39-73d9-40f1-b43b-4606ab04bf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:41.345958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8dc39-73d9-40f1-b43b-4606ab04bf94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:41.346249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8dc39-73d9-40f1-b43b-4606ab04bf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:41.346690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8dc39-73d9-40f1-b43b-4606ab04bf94 admin admin] PATH_INFO: `/v3/projects/93d8530aaf7344fa97336208221d8718/users/46df99931bfa437db0e5d03e44e34756/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:41.413042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8dc39-73d9-40f1-b43b-4606ab04bf94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d8530aaf7344fa97336208221d8718, user_id=46df99931bfa437db0e5d03e44e34756, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:41.428210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8dc39-73d9-40f1-b43b-4606ab04bf94 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:41.438580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a007778-f32a-4ed9-b129-6e36ff73d26b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:41.471040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be962d8f-1d90-4af8-8832-a311e3a20a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:41.480743 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be962d8f-1d90-4af8-8832-a311e3a20a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:41.484580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be962d8f-1d90-4af8-8832-a311e3a20a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:41.486096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be962d8f-1d90-4af8-8832-a311e3a20a95 admin admin] PATH_INFO: `/v3/users/9cf24564935441558571d669060e7311` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:41.492019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be962d8f-1d90-4af8-8832-a311e3a20a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf24564935441558571d669060e7311)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:41.502604 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be962d8f-1d90-4af8-8832-a311e3a20a95 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:41.507783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 850/1734] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:40 2022] PUT /identity/v3/projects/93d8530aaf7344fa97336208221d8718/users/46df99931bfa437db0e5d03e44e34756/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:41.509188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8dc39-73d9-40f1-b43b-4606ab04bf94 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:41.512146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c0f8dc39-73d9-40f1-b43b-4606ab04bf94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:41.685481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8dc39-73d9-40f1-b43b-4606ab04bf94 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:41.704597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1fd1d-1ead-44d7-91c9-d9c639d66523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:41.705607 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1fd1d-1ead-44d7-91c9-d9c639d66523 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:41.705891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1fd1d-1ead-44d7-91c9-d9c639d66523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:41.706223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1fd1d-1ead-44d7-91c9-d9c639d66523 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:41.707148 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1fd1d-1ead-44d7-91c9-d9c639d66523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:41.711992 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1fd1d-1ead-44d7-91c9-d9c639d66523 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:41.725613 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-be962d8f-1d90-4af8-8832-a311e3a20a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf24564935441558571d669060e7311'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:41.728731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-be962d8f-1d90-4af8-8832-a311e3a20a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf24564935441558571d669060e7311'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:41.729940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 851/1735] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:41.730973 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1fd1d-1ead-44d7-91c9-d9c639d66523 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:41.736815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-be962d8f-1d90-4af8-8832-a311e3a20a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf24564935441558571d669060e7311'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:41.744389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5cf1fd1d-1ead-44d7-91c9-d9c639d66523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:41.779589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-be962d8f-1d90-4af8-8832-a311e3a20a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf24564935441558571d669060e7311'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:41.779851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1fd1d-1ead-44d7-91c9-d9c639d66523 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:41.796109 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf08b89-1207-494b-9dd5-bd4803def88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:41.796736 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf08b89-1207-494b-9dd5-bd4803def88f admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:41.797041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf08b89-1207-494b-9dd5-bd4803def88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:41.797297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf08b89-1207-494b-9dd5-bd4803def88f admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:41.798428 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf08b89-1207-494b-9dd5-bd4803def88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:41.799543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=77,keystone:INSERT=5,keystone:DELETE=18 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:41.803872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf08b89-1207-494b-9dd5-bd4803def88f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:41.826464 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-be962d8f-1d90-4af8-8832-a311e3a20a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf24564935441558571d669060e7311'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:41.826830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 852/1736] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:41.828037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf08b89-1207-494b-9dd5-bd4803def88f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:41.835032 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4cf08b89-1207-494b-9dd5-bd4803def88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:41.879406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf08b89-1207-494b-9dd5-bd4803def88f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:41.885821 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e3cc6-23c3-4ebc-8fe7-8d605eaa88b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:41.886686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e3cc6-23c3-4ebc-8fe7-8d605eaa88b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:41.886970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e3cc6-23c3-4ebc-8fe7-8d605eaa88b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:41.887248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e3cc6-23c3-4ebc-8fe7-8d605eaa88b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:41.888026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e3cc6-23c3-4ebc-8fe7-8d605eaa88b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:41.889809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e3cc6-23c3-4ebc-8fe7-8d605eaa88b6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:41.950482 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 885/1737] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:40 2022] DELETE /identity/v3/users/9cf24564935441558571d669060e7311 => generated 0 bytes in 1126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:41.962708 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be962d8f-1d90-4af8-8832-a311e3a20a95 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:41.963856 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 853/1738] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:41.964796 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e3cc6-23c3-4ebc-8fe7-8d605eaa88b6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:42.012918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e3cc6-23c3-4ebc-8fe7-8d605eaa88b6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:42.142216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:42.347328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be962d8f-1d90-4af8-8832-a311e3a20a95 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:42.367156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b243b8-3fc6-4ab9-98d3-5c7a584062c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:42.375874 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b243b8-3fc6-4ab9-98d3-5c7a584062c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:42.376184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b243b8-3fc6-4ab9-98d3-5c7a584062c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:42.376412 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b243b8-3fc6-4ab9-98d3-5c7a584062c4 admin admin] PATH_INFO: `/v3/projects/2243425dec954980b8dc6db67b881863/users/ee1d74d0fcb44935af9be10cd731afa0/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:42.390720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c894d1-ceed-4155-a5c6-10d347cab917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:42.392027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c894d1-ceed-4155-a5c6-10d347cab917 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:42.398011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c894d1-ceed-4155-a5c6-10d347cab917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:42.399426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c894d1-ceed-4155-a5c6-10d347cab917 admin admin] PATH_INFO: `/v3/projects/93d8530aaf7344fa97336208221d8718/users/46df99931bfa437db0e5d03e44e34756/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:42.417234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c894d1-ceed-4155-a5c6-10d347cab917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d8530aaf7344fa97336208221d8718, user_id=46df99931bfa437db0e5d03e44e34756, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:42.426311 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c894d1-ceed-4155-a5c6-10d347cab917 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:42.456055 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b243b8-3fc6-4ab9-98d3-5c7a584062c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2243425dec954980b8dc6db67b881863, user_id=ee1d74d0fcb44935af9be10cd731afa0, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:42.470299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b243b8-3fc6-4ab9-98d3-5c7a584062c4 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:42.471559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 886/1739] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:41 2022] PUT /identity/v3/projects/93d8530aaf7344fa97336208221d8718/users/46df99931bfa437db0e5d03e44e34756/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:42.477023 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903d325-f2af-4b7c-aa95-58c278c1151b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:42.477614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903d325-f2af-4b7c-aa95-58c278c1151b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:42.478096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903d325-f2af-4b7c-aa95-58c278c1151b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:42.523935 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 854/1740] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:41 2022] PUT /identity/v3/projects/2243425dec954980b8dc6db67b881863/users/ee1d74d0fcb44935af9be10cd731afa0/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:42.525664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98615ce8-0e8f-4bd5-9cb7-c31db6cfaba1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:42.532040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98615ce8-0e8f-4bd5-9cb7-c31db6cfaba1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:42.532498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98615ce8-0e8f-4bd5-9cb7-c31db6cfaba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:42.556020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0903d325-f2af-4b7c-aa95-58c278c1151b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:42.559404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0903d325-f2af-4b7c-aa95-58c278c1151b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:42.634244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-98615ce8-0e8f-4bd5-9cb7-c31db6cfaba1 None None] MFA Rules not processed for user `46df99931bfa437db0e5d03e44e34756`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:42.636645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-98615ce8-0e8f-4bd5-9cb7-c31db6cfaba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:42.857370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 887/1741] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:42.859529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b21c7-9060-4d67-bd95-27769281ec1a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:42.860104 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b21c7-9060-4d67-bd95-27769281ec1a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:42.863862 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b21c7-9060-4d67-bd95-27769281ec1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:42.937695 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 855/1742] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:42 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:42.953424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-cb0b21c7-9060-4d67-bd95-27769281ec1a None None] MFA Rules not processed for user `ee1d74d0fcb44935af9be10cd731afa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:42.956571 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cb0b21c7-9060-4d67-bd95-27769281ec1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:43.087837 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98615ce8-0e8f-4bd5-9cb7-c31db6cfaba1 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:43.089289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-98615ce8-0e8f-4bd5-9cb7-c31db6cfaba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:43.269273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 888/1743] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:43.388442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98615ce8-0e8f-4bd5-9cb7-c31db6cfaba1 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:43.413487 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9431ad-8326-4c43-96ce-24807f7563ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:43.416198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9431ad-8326-4c43-96ce-24807f7563ea service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:43.416198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9431ad-8326-4c43-96ce-24807f7563ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:43.416198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9431ad-8326-4c43-96ce-24807f7563ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:43.440513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b21c7-9060-4d67-bd95-27769281ec1a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:43.443390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cb0b21c7-9060-4d67-bd95-27769281ec1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:43.453555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:43.516861 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9431ad-8326-4c43-96ce-24807f7563ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:43.525639 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9431ad-8326-4c43-96ce-24807f7563ea service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:43.575203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 856/1744] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:43.676380 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b21c7-9060-4d67-bd95-27769281ec1a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:43.692233 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9431ad-8326-4c43-96ce-24807f7563ea service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:43.695027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e1339-9b48-46ed-a633-f08bad462756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:43.696980 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e1339-9b48-46ed-a633-f08bad462756 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:43.697164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e1339-9b48-46ed-a633-f08bad462756 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:43.698101 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1c9431ad-8326-4c43-96ce-24807f7563ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:43.699360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e1339-9b48-46ed-a633-f08bad462756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:43.736683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9431ad-8326-4c43-96ce-24807f7563ea service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:43.753724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e1339-9b48-46ed-a633-f08bad462756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:43.762514 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e1339-9b48-46ed-a633-f08bad462756 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:43.786657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d856777-a696-4dee-a203-6d3c3eff9f71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:43.786657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d856777-a696-4dee-a203-6d3c3eff9f71 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:43.792010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d856777-a696-4dee-a203-6d3c3eff9f71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:43.797875 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d856777-a696-4dee-a203-6d3c3eff9f71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:43.829876 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d856777-a696-4dee-a203-6d3c3eff9f71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:43.831471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 889/1745] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:43 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:30:43.834710 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d856777-a696-4dee-a203-6d3c3eff9f71 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:43.863916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865520c5-8e1e-4353-b7b2-0da735922f4a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:43.864669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865520c5-8e1e-4353-b7b2-0da735922f4a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:43.865774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865520c5-8e1e-4353-b7b2-0da735922f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:43.876878 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 857/1746] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:44.003297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-865520c5-8e1e-4353-b7b2-0da735922f4a None None] MFA Rules not processed for user `1d737a8a33da490db5d59ffed92bee60`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:44.013953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-865520c5-8e1e-4353-b7b2-0da735922f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:44.064532 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 890/1747] 10.222.0.61 () {58 vars in 1015 bytes} [Thu Jul 21 08:30:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:30:44.257179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d856777-a696-4dee-a203-6d3c3eff9f71 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:44.259613 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3d856777-a696-4dee-a203-6d3c3eff9f71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:44.329286 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d856777-a696-4dee-a203-6d3c3eff9f71 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:44.347510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dfcd3-637d-43a9-b0b4-a824864a4446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:44.348565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dfcd3-637d-43a9-b0b4-a824864a4446 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:44.349482 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dfcd3-637d-43a9-b0b4-a824864a4446 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:44.351577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dfcd3-637d-43a9-b0b4-a824864a4446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:44.370171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503dfcd3-637d-43a9-b0b4-a824864a4446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:44.375963 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503dfcd3-637d-43a9-b0b4-a824864a4446 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:44.395324 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 858/1748] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:45.101653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865520c5-8e1e-4353-b7b2-0da735922f4a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:45.161874 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865520c5-8e1e-4353-b7b2-0da735922f4a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:45.197996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281acf6-e635-4d5d-82b6-1030fb96204e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:45.202230 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281acf6-e635-4d5d-82b6-1030fb96204e service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:45.205004 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281acf6-e635-4d5d-82b6-1030fb96204e service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:45.218379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281acf6-e635-4d5d-82b6-1030fb96204e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:45.227672 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9281acf6-e635-4d5d-82b6-1030fb96204e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:45.511728 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281acf6-e635-4d5d-82b6-1030fb96204e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:45.516656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281acf6-e635-4d5d-82b6-1030fb96204e service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:45.540652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 891/1749] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:46.997255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dfcd3-637d-43a9-b0b4-a824864a4446 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:46.999532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-503dfcd3-637d-43a9-b0b4-a824864a4446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:47.043416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dfcd3-637d-43a9-b0b4-a824864a4446 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:47.056340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c344f-e816-4df6-8d42-361a33367e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:47.057241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c344f-e816-4df6-8d42-361a33367e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:47.057522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c344f-e816-4df6-8d42-361a33367e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:47.057793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c344f-e816-4df6-8d42-361a33367e61 admin admin] PATH_INFO: `/v3/projects/0e4d8800eca145ff9906d068c37e328d` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:47.069594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c344f-e816-4df6-8d42-361a33367e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4d8800eca145ff9906d068c37e328d)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:47.070793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c344f-e816-4df6-8d42-361a33367e61 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:47.093206 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:47.280203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-dc8c344f-e816-4df6-8d42-361a33367e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4d8800eca145ff9906d068c37e328d', 'request_id': 'req-dc8c344f-e816-4df6-8d42-361a33367e61'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:47.304952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-dc8c344f-e816-4df6-8d42-361a33367e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4d8800eca145ff9906d068c37e328d', 'request_id': 'req-dc8c344f-e816-4df6-8d42-361a33367e61'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:47.336038 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-dc8c344f-e816-4df6-8d42-361a33367e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4d8800eca145ff9906d068c37e328d', 'request_id': 'req-dc8c344f-e816-4df6-8d42-361a33367e61'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:47.362915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-dc8c344f-e816-4df6-8d42-361a33367e61 admin admin] The token cache is being invalidate because project 0e4d8800eca145ff9906d068c37e328d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:47.364121 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-dc8c344f-e816-4df6-8d42-361a33367e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:47.366135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-dc8c344f-e816-4df6-8d42-361a33367e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:47.371098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 859/1750] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:46 2022] DELETE /identity/v3/projects/0e4d8800eca145ff9906d068c37e328d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:47.377443 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc47acb-6c0c-4292-8b0a-c0f4fb79e95b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:47.378046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc47acb-6c0c-4292-8b0a-c0f4fb79e95b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:47.378046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc47acb-6c0c-4292-8b0a-c0f4fb79e95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:47.415210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-cfc47acb-6c0c-4292-8b0a-c0f4fb79e95b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:47.418265 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cfc47acb-6c0c-4292-8b0a-c0f4fb79e95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:47.626766 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0e39e-9c61-48e5-8712-0f2f67bbfce6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:47.627404 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0e39e-9c61-48e5-8712-0f2f67bbfce6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:47.628004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0e39e-9c61-48e5-8712-0f2f67bbfce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:47.632018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 892/1751] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:47.694387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0dc0e39e-9c61-48e5-8712-0f2f67bbfce6 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:47.698205 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0dc0e39e-9c61-48e5-8712-0f2f67bbfce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:47.736286 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 860/1752] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:47.739109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc47acb-6c0c-4292-8b0a-c0f4fb79e95b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:47.765239 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc47acb-6c0c-4292-8b0a-c0f4fb79e95b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:47.787773 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f52e34-7f40-4f34-b4b9-2a6cd253932b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:47.789851 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f52e34-7f40-4f34-b4b9-2a6cd253932b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:47.791301 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f52e34-7f40-4f34-b4b9-2a6cd253932b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:47.793484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f52e34-7f40-4f34-b4b9-2a6cd253932b admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:47.798947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f52e34-7f40-4f34-b4b9-2a6cd253932b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:47.799343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f52e34-7f40-4f34-b4b9-2a6cd253932b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:47.801369 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f52e34-7f40-4f34-b4b9-2a6cd253932b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:47.872634 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0e39e-9c61-48e5-8712-0f2f67bbfce6 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:47.886707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 893/1753] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:47.888964 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f52e34-7f40-4f34-b4b9-2a6cd253932b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:47.892295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0e39e-9c61-48e5-8712-0f2f67bbfce6 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:47.899092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-70f52e34-7f40-4f34-b4b9-2a6cd253932b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:47.917176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16424e97-cedb-47a4-a879-ba234ea0e522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:47.917955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16424e97-cedb-47a4-a879-ba234ea0e522 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:47.918219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16424e97-cedb-47a4-a879-ba234ea0e522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:47.918517 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16424e97-cedb-47a4-a879-ba234ea0e522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:47.919281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16424e97-cedb-47a4-a879-ba234ea0e522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:47.935035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16424e97-cedb-47a4-a879-ba234ea0e522 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:47.964120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f52e34-7f40-4f34-b4b9-2a6cd253932b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:48.025108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888531f-8231-476a-a188-ba521a105421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:48.026078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888531f-8231-476a-a188-ba521a105421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:48.026294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888531f-8231-476a-a188-ba521a105421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:48.026568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888531f-8231-476a-a188-ba521a105421 admin admin] PATH_INFO: `/v3/projects/d485184593514f55b3db88ed22d0cede` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:48.035892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888531f-8231-476a-a188-ba521a105421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d485184593514f55b3db88ed22d0cede)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:48.045749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888531f-8231-476a-a188-ba521a105421 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:48.095992 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 861/1754] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:47 2022] POST /identity/v3/projects => generated 381 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:48.101237 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16424e97-cedb-47a4-a879-ba234ea0e522 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:48.176651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:48.267538 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2888531f-8231-476a-a188-ba521a105421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd485184593514f55b3db88ed22d0cede', 'request_id': 'req-2888531f-8231-476a-a188-ba521a105421'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:48.316525 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2888531f-8231-476a-a188-ba521a105421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd485184593514f55b3db88ed22d0cede', 'request_id': 'req-2888531f-8231-476a-a188-ba521a105421'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:48.323570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2888531f-8231-476a-a188-ba521a105421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd485184593514f55b3db88ed22d0cede', 'request_id': 'req-2888531f-8231-476a-a188-ba521a105421'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:48.360742 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2888531f-8231-476a-a188-ba521a105421 admin admin] The token cache is being invalidate because project d485184593514f55b3db88ed22d0cede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:48.362111 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2888531f-8231-476a-a188-ba521a105421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:48.363992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2888531f-8231-476a-a188-ba521a105421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:48.369407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 894/1755] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:47 2022] DELETE /identity/v3/projects/d485184593514f55b3db88ed22d0cede => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:48.374360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888531f-8231-476a-a188-ba521a105421 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:48.380869 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2888531f-8231-476a-a188-ba521a105421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:48.393189 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16424e97-cedb-47a4-a879-ba234ea0e522 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:48.606413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59ddb0-f332-4ed3-aa5c-4a9eaba09873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:48.608017 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59ddb0-f332-4ed3-aa5c-4a9eaba09873 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:48.608762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59ddb0-f332-4ed3-aa5c-4a9eaba09873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:48.610703 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59ddb0-f332-4ed3-aa5c-4a9eaba09873 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:48.614838 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59ddb0-f332-4ed3-aa5c-4a9eaba09873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:48.629497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59ddb0-f332-4ed3-aa5c-4a9eaba09873 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:48.682838 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888531f-8231-476a-a188-ba521a105421 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:48.692686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:48.707073 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ad62c-3043-4340-a836-e708437678e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:48.713869 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ad62c-3043-4340-a836-e708437678e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:48.714523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ad62c-3043-4340-a836-e708437678e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:48.714979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ad62c-3043-4340-a836-e708437678e5 admin admin] PATH_INFO: `/v3/users/b03ac0a5eaf94c89bd3fe993587adf21` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:48.715426 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 862/1756] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:48 2022] POST /identity/v3/users => generated 291 bytes in 617 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:48.716643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59ddb0-f332-4ed3-aa5c-4a9eaba09873 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:48.724554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ad62c-3043-4340-a836-e708437678e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b03ac0a5eaf94c89bd3fe993587adf21)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:48.727335 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0b59ddb0-f332-4ed3-aa5c-4a9eaba09873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:48.728675 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ad62c-3043-4340-a836-e708437678e5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:48.760214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59ddb0-f332-4ed3-aa5c-4a9eaba09873 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:48.781782 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f1cef-4b5f-48c7-a3af-f1274b96adff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:48.783699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f1cef-4b5f-48c7-a3af-f1274b96adff admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:48.783992 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f1cef-4b5f-48c7-a3af-f1274b96adff admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:48.784386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f1cef-4b5f-48c7-a3af-f1274b96adff admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:48.785236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f1cef-4b5f-48c7-a3af-f1274b96adff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:48.790571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f1cef-4b5f-48c7-a3af-f1274b96adff admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:48.839480 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 863/1757] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:48.842301 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f1cef-4b5f-48c7-a3af-f1274b96adff admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:48.847037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d81f1cef-4b5f-48c7-a3af-f1274b96adff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:48.891524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b52ad62c-3043-4340-a836-e708437678e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b03ac0a5eaf94c89bd3fe993587adf21'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:48.893192 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b52ad62c-3043-4340-a836-e708437678e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b03ac0a5eaf94c89bd3fe993587adf21'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:48.894941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b52ad62c-3043-4340-a836-e708437678e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b03ac0a5eaf94c89bd3fe993587adf21'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:48.902806 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f1cef-4b5f-48c7-a3af-f1274b96adff admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:48.916708 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bd98b-dc73-4d04-add4-1440e8e6aeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:48.920598 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bd98b-dc73-4d04-add4-1440e8e6aeb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:48.920895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bd98b-dc73-4d04-add4-1440e8e6aeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:48.921184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bd98b-dc73-4d04-add4-1440e8e6aeb0 admin admin] PATH_INFO: `/v3/users/9a297cb26d404f4585a0e8bb4e66d4db` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:48.924664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437bd98b-dc73-4d04-add4-1440e8e6aeb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a297cb26d404f4585a0e8bb4e66d4db)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:48.925906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b52ad62c-3043-4340-a836-e708437678e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b03ac0a5eaf94c89bd3fe993587adf21'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:48.930745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437bd98b-dc73-4d04-add4-1440e8e6aeb0 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:48.943533 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b52ad62c-3043-4340-a836-e708437678e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b03ac0a5eaf94c89bd3fe993587adf21'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:49.051040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 895/1758] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:48 2022] DELETE /identity/v3/users/b03ac0a5eaf94c89bd3fe993587adf21 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:49.052069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ad62c-3043-4340-a836-e708437678e5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:49.056500 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b52ad62c-3043-4340-a836-e708437678e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:49.112117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-437bd98b-dc73-4d04-add4-1440e8e6aeb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a297cb26d404f4585a0e8bb4e66d4db'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:49.152346 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-437bd98b-dc73-4d04-add4-1440e8e6aeb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a297cb26d404f4585a0e8bb4e66d4db'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:49.154279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-437bd98b-dc73-4d04-add4-1440e8e6aeb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a297cb26d404f4585a0e8bb4e66d4db'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:49.157117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-437bd98b-dc73-4d04-add4-1440e8e6aeb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a297cb26d404f4585a0e8bb4e66d4db'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:49.171351 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-437bd98b-dc73-4d04-add4-1440e8e6aeb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a297cb26d404f4585a0e8bb4e66d4db'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:49.190450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:49.224524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 864/1759] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:48 2022] DELETE /identity/v3/users/9a297cb26d404f4585a0e8bb4e66d4db => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:49.230521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440fd89-e8da-4210-be13-dde91b608121 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:49.230521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440fd89-e8da-4210-be13-dde91b608121 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:49.230521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440fd89-e8da-4210-be13-dde91b608121 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:49.250173 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 865/1760] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 08:30:49 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:49.263328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c552b-7073-411d-bc82-409a21223e7e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:49.263328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c552b-7073-411d-bc82-409a21223e7e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:49.263328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c552b-7073-411d-bc82-409a21223e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:49.317839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ad62c-3043-4340-a836-e708437678e5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:49.322806 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b93c552b-7073-411d-bc82-409a21223e7e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:49.325554 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b93c552b-7073-411d-bc82-409a21223e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:49.488859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 866/1761] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:49.490361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d8e8b-b96c-400b-8bf3-cd9efec4dfcd None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:49.490648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d8e8b-b96c-400b-8bf3-cd9efec4dfcd None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:49.490924 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d8e8b-b96c-400b-8bf3-cd9efec4dfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:49.514889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec66e99-b624-4c90-b665-b73b65737cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:49.517006 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec66e99-b624-4c90-b665-b73b65737cac admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:49.517541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec66e99-b624-4c90-b665-b73b65737cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:49.518048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec66e99-b624-4c90-b665-b73b65737cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:49.519200 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec66e99-b624-4c90-b665-b73b65737cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:49.525837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec66e99-b624-4c90-b665-b73b65737cac admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:49.532460 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-106d8e8b-b96c-400b-8bf3-cd9efec4dfcd None None] MFA Rules not processed for user `131bb5462c8b478783a350d37caa76ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:49.539115 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-106d8e8b-b96c-400b-8bf3-cd9efec4dfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:49.558703 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 896/1762] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:49.568779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec66e99-b624-4c90-b665-b73b65737cac admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:49.574940 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5ec66e99-b624-4c90-b665-b73b65737cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:49.609564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec66e99-b624-4c90-b665-b73b65737cac admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:49.618408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2ab46-7ecb-41c0-8cf5-739b41999cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:49.620280 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2ab46-7ecb-41c0-8cf5-739b41999cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:49.620785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2ab46-7ecb-41c0-8cf5-739b41999cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:49.621524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2ab46-7ecb-41c0-8cf5-739b41999cd4 admin admin] PATH_INFO: `/v3/projects/6213fe45ed674d318a51e0ee4ee5fbff/users/703fcf7f9a8e46fa8ac0ed996b43faf5/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:49.652516 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2ab46-7ecb-41c0-8cf5-739b41999cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6213fe45ed674d318a51e0ee4ee5fbff, user_id=703fcf7f9a8e46fa8ac0ed996b43faf5, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:49.657387 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2ab46-7ecb-41c0-8cf5-739b41999cd4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:49.675515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:49.690454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 897/1763] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:49 2022] PUT /identity/v3/projects/6213fe45ed674d318a51e0ee4ee5fbff/users/703fcf7f9a8e46fa8ac0ed996b43faf5/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:49.693705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2ab46-7ecb-41c0-8cf5-739b41999cd4 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:49.702752 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-79b2ab46-7ecb-41c0-8cf5-739b41999cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:49.757224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 867/1764] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 08:30:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:49.759002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d979a-9bcc-43ce-ac45-97b888b93b68 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:49.759345 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d979a-9bcc-43ce-ac45-97b888b93b68 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:49.759719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d979a-9bcc-43ce-ac45-97b888b93b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:49.873896 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8c9d979a-9bcc-43ce-ac45-97b888b93b68 None None] MFA Rules not processed for user `703fcf7f9a8e46fa8ac0ed996b43faf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:49.878679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8c9d979a-9bcc-43ce-ac45-97b888b93b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:49.910155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2ab46-7ecb-41c0-8cf5-739b41999cd4 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:49.919148 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de12cf6-38d6-4e23-b644-70df2fe1d4a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:49.919986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de12cf6-38d6-4e23-b644-70df2fe1d4a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:49.920335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de12cf6-38d6-4e23-b644-70df2fe1d4a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:49.920679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de12cf6-38d6-4e23-b644-70df2fe1d4a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:50.059510 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:50.064021 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de12cf6-38d6-4e23-b644-70df2fe1d4a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:50.068010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de12cf6-38d6-4e23-b644-70df2fe1d4a2 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:50.109834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 898/1765] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:50.112391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c5bc8-962b-46e5-8674-2b878d41faac None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:50.113068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c5bc8-962b-46e5-8674-2b878d41faac None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:50.113068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c5bc8-962b-46e5-8674-2b878d41faac None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:50.121553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 868/1766] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:50.122478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 899/1767] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 08:30:50 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:50.124093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c5bc8-962b-46e5-8674-2b878d41faac None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:50.144574 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d979a-9bcc-43ce-ac45-97b888b93b68 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:50.157316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c5bc8-962b-46e5-8674-2b878d41faac None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:50.158580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8c9d979a-9bcc-43ce-ac45-97b888b93b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:50.168409 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8873744-0bef-462f-bcfa-4849aeb9d5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:50.169094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8873744-0bef-462f-bcfa-4849aeb9d5fb admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:50.169277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8873744-0bef-462f-bcfa-4849aeb9d5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:50.169585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8873744-0bef-462f-bcfa-4849aeb9d5fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:50.171169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8873744-0bef-462f-bcfa-4849aeb9d5fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:50.180201 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8873744-0bef-462f-bcfa-4849aeb9d5fb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:50.275701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 900/1768] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:50 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:50.277194 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cece229-4d76-42b9-beb7-34f34d38f6c0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:50.277557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cece229-4d76-42b9-beb7-34f34d38f6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:50.277756 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cece229-4d76-42b9-beb7-34f34d38f6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:50.325230 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9cece229-4d76-42b9-beb7-34f34d38f6c0 None None] MFA Rules not processed for user `131bb5462c8b478783a350d37caa76ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:50.326751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9cece229-4d76-42b9-beb7-34f34d38f6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:50.442822 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d979a-9bcc-43ce-ac45-97b888b93b68 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:50.518354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 901/1769] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 08:30:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:50.519036 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cece229-4d76-42b9-beb7-34f34d38f6c0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:50.596360 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ebfbf-63c3-44d6-9191-842a9fb213ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:50.597218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ebfbf-63c3-44d6-9191-842a9fb213ec service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:50.597618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ebfbf-63c3-44d6-9191-842a9fb213ec service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:50.598040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ebfbf-63c3-44d6-9191-842a9fb213ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:50.620394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ebfbf-63c3-44d6-9191-842a9fb213ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:50.624770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ebfbf-63c3-44d6-9191-842a9fb213ec service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:50.662615 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 869/1770] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:50.765370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cece229-4d76-42b9-beb7-34f34d38f6c0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:50.788976 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20f3bc-5872-4a92-9754-e78f01c360fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:50.791704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f3bc-5872-4a92-9754-e78f01c360fa admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:50.793589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f3bc-5872-4a92-9754-e78f01c360fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:50.794461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f3bc-5872-4a92-9754-e78f01c360fa admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:50.796022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20f3bc-5872-4a92-9754-e78f01c360fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:50.803204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20f3bc-5872-4a92-9754-e78f01c360fa admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:50.869397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ebfbf-63c3-44d6-9191-842a9fb213ec service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:50.907770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ebfbf-63c3-44d6-9191-842a9fb213ec service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:50.915096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 902/1771] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:50 2022] POST /identity/v3/users => generated 296 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:50.924317 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20f3bc-5872-4a92-9754-e78f01c360fa admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:50.935121 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c333b4-3ede-41a6-8715-5e6cf7acff85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:50.937986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c333b4-3ede-41a6-8715-5e6cf7acff85 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:50.941478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c333b4-3ede-41a6-8715-5e6cf7acff85 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:50.942553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c333b4-3ede-41a6-8715-5e6cf7acff85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:50.961946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20f3bc-5872-4a92-9754-e78f01c360fa admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:50.964643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:50.978055 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c333b4-3ede-41a6-8715-5e6cf7acff85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:50.981187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b35c91-f67d-4101-bafb-14f6cb72a0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:50.981955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b35c91-f67d-4101-bafb-14f6cb72a0ef admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:50.982723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b35c91-f67d-4101-bafb-14f6cb72a0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:50.982723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b35c91-f67d-4101-bafb-14f6cb72a0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:50.983316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b35c91-f67d-4101-bafb-14f6cb72a0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:50.984668 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c333b4-3ede-41a6-8715-5e6cf7acff85 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:50.984973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b35c91-f67d-4101-bafb-14f6cb72a0ef admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:51.023396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 870/1772] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:51.046976 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 903/1773] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:51.051443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c333b4-3ede-41a6-8715-5e6cf7acff85 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:51.093732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c333b4-3ede-41a6-8715-5e6cf7acff85 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:51.121551 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2cafa-346f-4dc2-92f9-28fe4d248458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:51.122834 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2cafa-346f-4dc2-92f9-28fe4d248458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:51.123663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2cafa-346f-4dc2-92f9-28fe4d248458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:51.124698 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2cafa-346f-4dc2-92f9-28fe4d248458 admin admin] PATH_INFO: `/v3/projects/d2b1a6dc954b4a0bad6a3cb5e2888f08/users/0f2c315e50c7452cb87006f29f0f9930/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:51.168087 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2cafa-346f-4dc2-92f9-28fe4d248458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b1a6dc954b4a0bad6a3cb5e2888f08, user_id=0f2c315e50c7452cb87006f29f0f9930, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:51.173120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2cafa-346f-4dc2-92f9-28fe4d248458 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:51.198485 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 871/1774] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:51 2022] PUT /identity/v3/projects/d2b1a6dc954b4a0bad6a3cb5e2888f08/users/0f2c315e50c7452cb87006f29f0f9930/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:51.202398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b35c91-f67d-4101-bafb-14f6cb72a0ef admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:51.226666 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b35c91-f67d-4101-bafb-14f6cb72a0ef admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:51.400600 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:51.445215 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effa80e-5130-45a7-ae4d-e578dd6502a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:51.446190 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa80e-5130-45a7-ae4d-e578dd6502a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:51.446683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa80e-5130-45a7-ae4d-e578dd6502a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:51.447833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa80e-5130-45a7-ae4d-e578dd6502a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:51.449564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effa80e-5130-45a7-ae4d-e578dd6502a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:51.452875 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effa80e-5130-45a7-ae4d-e578dd6502a4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:51.483322 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 904/1775] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:30:51.487824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2cafa-346f-4dc2-92f9-28fe4d248458 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:51.509313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2cafa-346f-4dc2-92f9-28fe4d248458 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:51.526315 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489850b7-8f9d-40d1-9a2e-ff680d8b6972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:51.527566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489850b7-8f9d-40d1-9a2e-ff680d8b6972 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:51.527867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489850b7-8f9d-40d1-9a2e-ff680d8b6972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:51.571648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489850b7-8f9d-40d1-9a2e-ff680d8b6972 admin admin] PATH_INFO: `/v3/projects/d2b1a6dc954b4a0bad6a3cb5e2888f08/users/0f2c315e50c7452cb87006f29f0f9930/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:51.587848 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489850b7-8f9d-40d1-9a2e-ff680d8b6972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b1a6dc954b4a0bad6a3cb5e2888f08, user_id=0f2c315e50c7452cb87006f29f0f9930, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:51.622884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489850b7-8f9d-40d1-9a2e-ff680d8b6972 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:51.674091 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 872/1776] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:51 2022] PUT /identity/v3/projects/d2b1a6dc954b4a0bad6a3cb5e2888f08/users/0f2c315e50c7452cb87006f29f0f9930/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:51.684312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50308c6a-6602-4a70-902c-0253dc30e6d1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:51.684877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50308c6a-6602-4a70-902c-0253dc30e6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:51.684877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50308c6a-6602-4a70-902c-0253dc30e6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:51.745418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-50308c6a-6602-4a70-902c-0253dc30e6d1 None None] MFA Rules not processed for user `0f2c315e50c7452cb87006f29f0f9930`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:51.746739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-50308c6a-6602-4a70-902c-0253dc30e6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:51.943631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 905/1777] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:52.034813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489850b7-8f9d-40d1-9a2e-ff680d8b6972 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:52.036937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-489850b7-8f9d-40d1-9a2e-ff680d8b6972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:52.053225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50308c6a-6602-4a70-902c-0253dc30e6d1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:52.054797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-50308c6a-6602-4a70-902c-0253dc30e6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:52.241687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50308c6a-6602-4a70-902c-0253dc30e6d1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:52.261593 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b70f77-3c2f-41dc-b50b-7e7bea165893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:52.264931 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b70f77-3c2f-41dc-b50b-7e7bea165893 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:52.266131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b70f77-3c2f-41dc-b50b-7e7bea165893 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:52.267280 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b70f77-3c2f-41dc-b50b-7e7bea165893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:52.301979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b70f77-3c2f-41dc-b50b-7e7bea165893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:52.304313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b70f77-3c2f-41dc-b50b-7e7bea165893 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:52.333797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489850b7-8f9d-40d1-9a2e-ff680d8b6972 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:52.356891 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 906/1778] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:52.362926 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:52.364151 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:52.364478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:52.364734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6 admin admin] PATH_INFO: `/v3/projects/182f45a6fab54a40be8b6271e9e5660f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:52.370132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=182f45a6fab54a40be8b6271e9e5660f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:52.374332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:52.393414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b70f77-3c2f-41dc-b50b-7e7bea165893 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:52.395489 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-71b70f77-3c2f-41dc-b50b-7e7bea165893 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:52.456994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b70f77-3c2f-41dc-b50b-7e7bea165893 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:52.463897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f673251-7d28-463d-9fea-eea6ddf64d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:52.465066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673251-7d28-463d-9fea-eea6ddf64d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:52.465580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673251-7d28-463d-9fea-eea6ddf64d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:52.466070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673251-7d28-463d-9fea-eea6ddf64d27 admin admin] PATH_INFO: `/v3/projects/b493933d139e4607a2f5e477e3b0db9d` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:52.468034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f673251-7d28-463d-9fea-eea6ddf64d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b493933d139e4607a2f5e477e3b0db9d)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:52.470882 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f673251-7d28-463d-9fea-eea6ddf64d27 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:52.580295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '182f45a6fab54a40be8b6271e9e5660f', 'request_id': 'req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:52.634213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '182f45a6fab54a40be8b6271e9e5660f', 'request_id': 'req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:52.661308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '182f45a6fab54a40be8b6271e9e5660f', 'request_id': 'req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:52.712332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6 admin admin] The token cache is being invalidate because project 182f45a6fab54a40be8b6271e9e5660f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:52.712663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:52.713318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:52.722569 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 873/1779] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:52 2022] DELETE /identity/v3/projects/182f45a6fab54a40be8b6271e9e5660f => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:52.723564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:52.726716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:52.733472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3f673251-7d28-463d-9fea-eea6ddf64d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b493933d139e4607a2f5e477e3b0db9d', 'request_id': 'req-3f673251-7d28-463d-9fea-eea6ddf64d27'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:52.792142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3f673251-7d28-463d-9fea-eea6ddf64d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b493933d139e4607a2f5e477e3b0db9d', 'request_id': 'req-3f673251-7d28-463d-9fea-eea6ddf64d27'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:52.829874 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:52.835989 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3f673251-7d28-463d-9fea-eea6ddf64d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b493933d139e4607a2f5e477e3b0db9d', 'request_id': 'req-3f673251-7d28-463d-9fea-eea6ddf64d27'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:52.892376 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3f673251-7d28-463d-9fea-eea6ddf64d27 admin admin] The token cache is being invalidate because project b493933d139e4607a2f5e477e3b0db9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:52.892557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3f673251-7d28-463d-9fea-eea6ddf64d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:52.893316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3f673251-7d28-463d-9fea-eea6ddf64d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:52.895487 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 907/1780] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:52 2022] DELETE /identity/v3/projects/b493933d139e4607a2f5e477e3b0db9d => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:30:52.900525 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77fb3d-9e10-4e7a-b10d-d3256fba16ed None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:52.900998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77fb3d-9e10-4e7a-b10d-d3256fba16ed None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:52.901544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77fb3d-9e10-4e7a-b10d-d3256fba16ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:52.925519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6d77fb3d-9e10-4e7a-b10d-d3256fba16ed None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:52.925692 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:52.926941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6d77fb3d-9e10-4e7a-b10d-d3256fba16ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:52.964415 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f70ff5-2ed1-4f7f-8283-43a89fb150a6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:53.019092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 908/1781] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:53.026776 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f73ac1-86aa-4031-8854-535956892fde None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:53.027075 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f73ac1-86aa-4031-8854-535956892fde None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:53.027409 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f73ac1-86aa-4031-8854-535956892fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:53.061446 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d9f73ac1-86aa-4031-8854-535956892fde None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:53.062844 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d9f73ac1-86aa-4031-8854-535956892fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:53.073694 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 909/1782] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:30:53.078154 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f73ac1-86aa-4031-8854-535956892fde None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:53.104135 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f73ac1-86aa-4031-8854-535956892fde None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:53.121622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8cba6-cff4-4c80-90ec-7cf746bafc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:53.122487 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8cba6-cff4-4c80-90ec-7cf746bafc07 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:53.123151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8cba6-cff4-4c80-90ec-7cf746bafc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:53.123633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8cba6-cff4-4c80-90ec-7cf746bafc07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:53.124458 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8cba6-cff4-4c80-90ec-7cf746bafc07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:53.124841 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8cba6-cff4-4c80-90ec-7cf746bafc07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:53.126553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8cba6-cff4-4c80-90ec-7cf746bafc07 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:53.136113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1e533-1964-48e2-996f-830d934e9d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:53.137555 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1e533-1964-48e2-996f-830d934e9d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:53.148121 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1e533-1964-48e2-996f-830d934e9d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:53.148818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1e533-1964-48e2-996f-830d934e9d8b admin admin] PATH_INFO: `/v3/users/cf9624f835f64a80b464cfa16a0491c3` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:53.151112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1e533-1964-48e2-996f-830d934e9d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf9624f835f64a80b464cfa16a0491c3)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:53.152880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1e533-1964-48e2-996f-830d934e9d8b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:53.161169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 910/1783] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:53.166033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8cba6-cff4-4c80-90ec-7cf746bafc07 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:53.197221 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8cba6-cff4-4c80-90ec-7cf746bafc07 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:53.217966 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d9030-3af8-4667-8df7-b130b9612037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:53.220017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d9030-3af8-4667-8df7-b130b9612037 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:53.220534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d9030-3af8-4667-8df7-b130b9612037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:53.221813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d9030-3af8-4667-8df7-b130b9612037 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:53.225901 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d9030-3af8-4667-8df7-b130b9612037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:53.235192 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d9030-3af8-4667-8df7-b130b9612037 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:53.318556 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-37e1e533-1964-48e2-996f-830d934e9d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf9624f835f64a80b464cfa16a0491c3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:53.333641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 911/1784] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:53 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:30:53.334939 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d9030-3af8-4667-8df7-b130b9612037 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:53.362460 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-37e1e533-1964-48e2-996f-830d934e9d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf9624f835f64a80b464cfa16a0491c3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:53.365634 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-37e1e533-1964-48e2-996f-830d934e9d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf9624f835f64a80b464cfa16a0491c3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:53.366382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-37e1e533-1964-48e2-996f-830d934e9d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf9624f835f64a80b464cfa16a0491c3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:53.381749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-37e1e533-1964-48e2-996f-830d934e9d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf9624f835f64a80b464cfa16a0491c3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:53.423979 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 874/1785] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:52 2022] DELETE /identity/v3/users/cf9624f835f64a80b464cfa16a0491c3 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:53.478208 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1e533-1964-48e2-996f-830d934e9d8b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:53.484463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-37e1e533-1964-48e2-996f-830d934e9d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:53.557388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d9030-3af8-4667-8df7-b130b9612037 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:53.605174 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1e533-1964-48e2-996f-830d934e9d8b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:53.610635 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732dec7-679b-4298-a437-df98f2adc767 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2c315e50c7452cb87006f29f0f9930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b1a6dc954b4a0bad6a3cb5e2888f08', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:53.611422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732dec7-679b-4298-a437-df98f2adc767 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:53.611775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732dec7-679b-4298-a437-df98f2adc767 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:53.612319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732dec7-679b-4298-a437-df98f2adc767 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:53.613770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732dec7-679b-4298-a437-df98f2adc767 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:53.614477 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732dec7-679b-4298-a437-df98f2adc767 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:53.616556 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732dec7-679b-4298-a437-df98f2adc767 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:53.636135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 875/1786] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:30:53.640318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732dec7-679b-4298-a437-df98f2adc767 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:53.673882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732dec7-679b-4298-a437-df98f2adc767 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:53.683890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23d62d-30f6-4314-9d41-3fa0504827a0 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2c315e50c7452cb87006f29f0f9930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b1a6dc954b4a0bad6a3cb5e2888f08', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:53.686101 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23d62d-30f6-4314-9d41-3fa0504827a0 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:53.686651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23d62d-30f6-4314-9d41-3fa0504827a0 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:53.687670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23d62d-30f6-4314-9d41-3fa0504827a0 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:53.689639 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23d62d-30f6-4314-9d41-3fa0504827a0 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:53.690138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:53.694205 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23d62d-30f6-4314-9d41-3fa0504827a0 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:53.701765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:53.702062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123679f9-a5f4-411b-9e17-9306a0ee9951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:53.707022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123679f9-a5f4-411b-9e17-9306a0ee9951 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:53.709142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123679f9-a5f4-411b-9e17-9306a0ee9951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:53.709722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123679f9-a5f4-411b-9e17-9306a0ee9951 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:53.711064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123679f9-a5f4-411b-9e17-9306a0ee9951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:53.716162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123679f9-a5f4-411b-9e17-9306a0ee9951 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:53.773659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 876/1787] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:53 2022] POST /identity/v3/projects => generated 355 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:53.781704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23d62d-30f6-4314-9d41-3fa0504827a0 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:53.797241 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 912/1788] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:53 2022] POST /identity/v3/users => generated 292 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:53.799175 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123679f9-a5f4-411b-9e17-9306a0ee9951 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:53.803820 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-123679f9-a5f4-411b-9e17-9306a0ee9951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:53.854273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123679f9-a5f4-411b-9e17-9306a0ee9951 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:54.030005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23d62d-30f6-4314-9d41-3fa0504827a0 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:54.068010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311f2cf-9bb5-4a69-8fc4-23ce9f942d19 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2c315e50c7452cb87006f29f0f9930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b1a6dc954b4a0bad6a3cb5e2888f08', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:54.081685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311f2cf-9bb5-4a69-8fc4-23ce9f942d19 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:54.082165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311f2cf-9bb5-4a69-8fc4-23ce9f942d19 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:54.084167 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311f2cf-9bb5-4a69-8fc4-23ce9f942d19 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:54.087699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311f2cf-9bb5-4a69-8fc4-23ce9f942d19 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:54.088672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311f2cf-9bb5-4a69-8fc4-23ce9f942d19 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:54.092359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311f2cf-9bb5-4a69-8fc4-23ce9f942d19 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:54.110679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d79839-0478-41c7-a813-b8d7fb919e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:54.112079 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d79839-0478-41c7-a813-b8d7fb919e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:54.112615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d79839-0478-41c7-a813-b8d7fb919e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:54.113126 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d79839-0478-41c7-a813-b8d7fb919e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:54.114960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d79839-0478-41c7-a813-b8d7fb919e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:54.117134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 877/1789] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:54.120889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d79839-0478-41c7-a813-b8d7fb919e01 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:54.189951 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 913/1790] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:30:54.190791 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311f2cf-9bb5-4a69-8fc4-23ce9f942d19 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:54.205857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311f2cf-9bb5-4a69-8fc4-23ce9f942d19 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:54.212128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efd0bf-7c9d-49d1-936f-285bf1d166a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:54.213101 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efd0bf-7c9d-49d1-936f-285bf1d166a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:54.213205 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efd0bf-7c9d-49d1-936f-285bf1d166a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:54.213465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efd0bf-7c9d-49d1-936f-285bf1d166a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:54.214441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efd0bf-7c9d-49d1-936f-285bf1d166a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:54.216552 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efd0bf-7c9d-49d1-936f-285bf1d166a1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:54.229362 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 878/1791] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:30:54.235983 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d79839-0478-41c7-a813-b8d7fb919e01 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:54.269504 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d79839-0478-41c7-a813-b8d7fb919e01 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:54.288762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29186847-4856-412e-83c3-2ca432951397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:54.293512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29186847-4856-412e-83c3-2ca432951397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:54.294039 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29186847-4856-412e-83c3-2ca432951397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:54.297488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29186847-4856-412e-83c3-2ca432951397 admin admin] PATH_INFO: `/v3/projects/6e97423858004593a721614659e5fbf2/users/936f0bc3d5fa48769bfaf3371fecb6ae/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:54.379043 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29186847-4856-412e-83c3-2ca432951397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e97423858004593a721614659e5fbf2, user_id=936f0bc3d5fa48769bfaf3371fecb6ae, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:54.385256 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29186847-4856-412e-83c3-2ca432951397 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:54.410410 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efd0bf-7c9d-49d1-936f-285bf1d166a1 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:54.445071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 914/1792] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:54 2022] PUT /identity/v3/projects/6e97423858004593a721614659e5fbf2/users/936f0bc3d5fa48769bfaf3371fecb6ae/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:54.459011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53327f8-f532-4a74-a5cd-dedf1776078f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:54.461973 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efd0bf-7c9d-49d1-936f-285bf1d166a1 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:54.462537 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53327f8-f532-4a74-a5cd-dedf1776078f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:54.467083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53327f8-f532-4a74-a5cd-dedf1776078f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:54.546273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f53327f8-f532-4a74-a5cd-dedf1776078f None None] MFA Rules not processed for user `936f0bc3d5fa48769bfaf3371fecb6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:54.549567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f53327f8-f532-4a74-a5cd-dedf1776078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:54.637398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b9111-41a3-4968-9635-ccee0e484e71 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2c315e50c7452cb87006f29f0f9930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b1a6dc954b4a0bad6a3cb5e2888f08', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:54.638345 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b9111-41a3-4968-9635-ccee0e484e71 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:54.638676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b9111-41a3-4968-9635-ccee0e484e71 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:54.638957 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b9111-41a3-4968-9635-ccee0e484e71 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] PATH_INFO: `/v3/projects/b9322bbb91b943f29223b588e62fbb5b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:54.642718 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b9111-41a3-4968-9635-ccee0e484e71 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b9322bbb91b943f29223b588e62fbb5b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:54.647790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b9111-41a3-4968-9635-ccee0e484e71 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:54.784452 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 915/1793] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:54.789862 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53327f8-f532-4a74-a5cd-dedf1776078f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:54.809098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-924b9111-41a3-4968-9635-ccee0e484e71 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9322bbb91b943f29223b588e62fbb5b', 'request_id': 'req-924b9111-41a3-4968-9635-ccee0e484e71'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:54.836276 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-924b9111-41a3-4968-9635-ccee0e484e71 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9322bbb91b943f29223b588e62fbb5b', 'request_id': 'req-924b9111-41a3-4968-9635-ccee0e484e71'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:54.854263 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-924b9111-41a3-4968-9635-ccee0e484e71 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9322bbb91b943f29223b588e62fbb5b', 'request_id': 'req-924b9111-41a3-4968-9635-ccee0e484e71'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:54.874683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:54.906021 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-924b9111-41a3-4968-9635-ccee0e484e71 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] The token cache is being invalidate because project b9322bbb91b943f29223b588e62fbb5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:54.906440 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-924b9111-41a3-4968-9635-ccee0e484e71 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:54.909140 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-924b9111-41a3-4968-9635-ccee0e484e71 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:54.919004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 879/1794] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:54 2022] DELETE /identity/v3/projects/b9322bbb91b943f29223b588e62fbb5b => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:54.949800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:54.985285 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53327f8-f532-4a74-a5cd-dedf1776078f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:55.148108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e5e9a-9810-4b30-ab01-abb334eaa218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:55.148863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e5e9a-9810-4b30-ab01-abb334eaa218 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:55.149153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e5e9a-9810-4b30-ab01-abb334eaa218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:55.149839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e5e9a-9810-4b30-ab01-abb334eaa218 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:55.150559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e5e9a-9810-4b30-ab01-abb334eaa218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:55.152711 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e5e9a-9810-4b30-ab01-abb334eaa218 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:55.220414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 916/1795] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:54 2022] POST /identity/v3/projects => generated 383 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:55.221731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b9111-41a3-4968-9635-ccee0e484e71 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:55.222753 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-924b9111-41a3-4968-9635-ccee0e484e71 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:55.261502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b9111-41a3-4968-9635-ccee0e484e71 tempest-VolumeQuotaClassesTest-626407284 tempest-VolumeQuotaClassesTest-626407284-project-admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:55.383460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e5e9a-9810-4b30-ab01-abb334eaa218 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:55.385383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e32e5e9a-9810-4b30-ab01-abb334eaa218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:55.442679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00ae13-d0ac-4553-a3f6-a7c5c5438cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:55.443272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00ae13-d0ac-4553-a3f6-a7c5c5438cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:55.443272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00ae13-d0ac-4553-a3f6-a7c5c5438cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:55.443422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00ae13-d0ac-4553-a3f6-a7c5c5438cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:55.447664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00ae13-d0ac-4553-a3f6-a7c5c5438cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:55.451994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00ae13-d0ac-4553-a3f6-a7c5c5438cf0 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:55.516116 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 880/1796] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:55 2022] POST /identity/v3/users => generated 298 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:30:55.516689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00ae13-d0ac-4553-a3f6-a7c5c5438cf0 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:55.519754 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fd00ae13-d0ac-4553-a3f6-a7c5c5438cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:55.532996 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00ae13-d0ac-4553-a3f6-a7c5c5438cf0 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:55.538860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9608c-d161-437d-a5a4-bf0f60c5eb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:55.540005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9608c-d161-437d-a5a4-bf0f60c5eb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:55.540437 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9608c-d161-437d-a5a4-bf0f60c5eb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:55.540869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9608c-d161-437d-a5a4-bf0f60c5eb28 admin admin] PATH_INFO: `/v3/users/703fcf7f9a8e46fa8ac0ed996b43faf5` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:55.543866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9608c-d161-437d-a5a4-bf0f60c5eb28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=703fcf7f9a8e46fa8ac0ed996b43faf5)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:55.546717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9608c-d161-437d-a5a4-bf0f60c5eb28 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:55.594847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e5e9a-9810-4b30-ab01-abb334eaa218 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:55.610363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb003d-27bf-4451-8d24-2d9cab8e3bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:55.611379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb003d-27bf-4451-8d24-2d9cab8e3bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:55.611686 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb003d-27bf-4451-8d24-2d9cab8e3bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:55.611965 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb003d-27bf-4451-8d24-2d9cab8e3bce admin admin] PATH_INFO: `/v3/projects/7f6599cdc2264777bde841129001ff0f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:55.619787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb003d-27bf-4451-8d24-2d9cab8e3bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f6599cdc2264777bde841129001ff0f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:55.626316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb003d-27bf-4451-8d24-2d9cab8e3bce admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:55.644651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bfa9608c-d161-437d-a5a4-bf0f60c5eb28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '703fcf7f9a8e46fa8ac0ed996b43faf5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:55.660741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bfa9608c-d161-437d-a5a4-bf0f60c5eb28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '703fcf7f9a8e46fa8ac0ed996b43faf5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:55.662160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bfa9608c-d161-437d-a5a4-bf0f60c5eb28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '703fcf7f9a8e46fa8ac0ed996b43faf5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:55.663210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bfa9608c-d161-437d-a5a4-bf0f60c5eb28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '703fcf7f9a8e46fa8ac0ed996b43faf5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:55.673724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bfa9608c-d161-437d-a5a4-bf0f60c5eb28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '703fcf7f9a8e46fa8ac0ed996b43faf5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:55.693095 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 881/1797] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:55 2022] DELETE /identity/v3/users/703fcf7f9a8e46fa8ac0ed996b43faf5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:55.694114 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9608c-d161-437d-a5a4-bf0f60c5eb28 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:55.695816 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bfa9608c-d161-437d-a5a4-bf0f60c5eb28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:55.707117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bdbb003d-27bf-4451-8d24-2d9cab8e3bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f6599cdc2264777bde841129001ff0f', 'request_id': 'req-bdbb003d-27bf-4451-8d24-2d9cab8e3bce'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:55.721457 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bdbb003d-27bf-4451-8d24-2d9cab8e3bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f6599cdc2264777bde841129001ff0f', 'request_id': 'req-bdbb003d-27bf-4451-8d24-2d9cab8e3bce'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:55.729383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bdbb003d-27bf-4451-8d24-2d9cab8e3bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f6599cdc2264777bde841129001ff0f', 'request_id': 'req-bdbb003d-27bf-4451-8d24-2d9cab8e3bce'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:55.743822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bdbb003d-27bf-4451-8d24-2d9cab8e3bce admin admin] The token cache is being invalidate because project 7f6599cdc2264777bde841129001ff0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:55.744208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bdbb003d-27bf-4451-8d24-2d9cab8e3bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:55.745237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bdbb003d-27bf-4451-8d24-2d9cab8e3bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:55.746820 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 917/1798] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:55 2022] DELETE /identity/v3/projects/7f6599cdc2264777bde841129001ff0f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:30:55.748379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1ddd3-62c5-47f8-bac8-32e4522e689f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:55.748784 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1ddd3-62c5-47f8-bac8-32e4522e689f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:55.749063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1ddd3-62c5-47f8-bac8-32e4522e689f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:55.772829 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2ff1ddd3-62c5-47f8-bac8-32e4522e689f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:55.774085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2ff1ddd3-62c5-47f8-bac8-32e4522e689f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:55.779946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:55.793671 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9608c-d161-437d-a5a4-bf0f60c5eb28 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:55.799770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaa673-a777-4a41-869c-19120b481c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:55.800266 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaa673-a777-4a41-869c-19120b481c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:55.800542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaa673-a777-4a41-869c-19120b481c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:55.800814 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaa673-a777-4a41-869c-19120b481c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:55.801552 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaa673-a777-4a41-869c-19120b481c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:55.803775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaa673-a777-4a41-869c-19120b481c73 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:55.804985 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:55.820200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 882/1799] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:55.820200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e6b35-8560-44da-be29-6035bac436f2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:55.820200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e6b35-8560-44da-be29-6035bac436f2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:55.820200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e6b35-8560-44da-be29-6035bac436f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:55.845983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-fb3e6b35-8560-44da-be29-6035bac436f2 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:55.847216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fb3e6b35-8560-44da-be29-6035bac436f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:55.860176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 883/1800] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:55.861599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e6b35-8560-44da-be29-6035bac436f2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:55.863033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fb3e6b35-8560-44da-be29-6035bac436f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:55.879248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e6b35-8560-44da-be29-6035bac436f2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:55.889688 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 918/1801] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:55.889815 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb335b32-440d-4138-abfc-8e8a9c441a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:55.890660 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb335b32-440d-4138-abfc-8e8a9c441a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:55.890766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1ddd3-62c5-47f8-bac8-32e4522e689f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:55.890929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb335b32-440d-4138-abfc-8e8a9c441a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:55.891307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb335b32-440d-4138-abfc-8e8a9c441a4e admin admin] PATH_INFO: `/v3/users/d3e79e6ec64e488783e7fc3a6543685f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:55.892371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2ff1ddd3-62c5-47f8-bac8-32e4522e689f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:55.892741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb335b32-440d-4138-abfc-8e8a9c441a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3e79e6ec64e488783e7fc3a6543685f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:55.898355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb335b32-440d-4138-abfc-8e8a9c441a4e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:55.912270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1ddd3-62c5-47f8-bac8-32e4522e689f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:55.921555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fac482-23fa-466c-b38c-8d61b5468612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:55.922796 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fac482-23fa-466c-b38c-8d61b5468612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:55.923070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fac482-23fa-466c-b38c-8d61b5468612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:55.923370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fac482-23fa-466c-b38c-8d61b5468612 admin admin] PATH_INFO: `/v3/projects/fc57fd2084654e4396814c0ca1d1b1e8/users/96a6a7f753dc484d83f3829ac1f92a87/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:55.970912 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fac482-23fa-466c-b38c-8d61b5468612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc57fd2084654e4396814c0ca1d1b1e8, user_id=96a6a7f753dc484d83f3829ac1f92a87, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:55.973984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fac482-23fa-466c-b38c-8d61b5468612 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:55.984928 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fb335b32-440d-4138-abfc-8e8a9c441a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3e79e6ec64e488783e7fc3a6543685f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:55.989947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 919/1802] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:55 2022] PUT /identity/v3/projects/fc57fd2084654e4396814c0ca1d1b1e8/users/96a6a7f753dc484d83f3829ac1f92a87/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:56.002136 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fb335b32-440d-4138-abfc-8e8a9c441a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3e79e6ec64e488783e7fc3a6543685f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:56.003192 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fb335b32-440d-4138-abfc-8e8a9c441a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3e79e6ec64e488783e7fc3a6543685f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:56.003916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fb335b32-440d-4138-abfc-8e8a9c441a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3e79e6ec64e488783e7fc3a6543685f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:56.005065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931aa45d-4115-435b-8de6-91d96ed063d4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.005694 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931aa45d-4115-435b-8de6-91d96ed063d4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.006575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931aa45d-4115-435b-8de6-91d96ed063d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.011671 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-fb335b32-440d-4138-abfc-8e8a9c441a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3e79e6ec64e488783e7fc3a6543685f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:56.028089 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-931aa45d-4115-435b-8de6-91d96ed063d4 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:56.029216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 884/1803] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:55 2022] DELETE /identity/v3/users/d3e79e6ec64e488783e7fc3a6543685f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:56.030004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb335b32-440d-4138-abfc-8e8a9c441a4e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:56.031449 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fb335b32-440d-4138-abfc-8e8a9c441a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:56.033151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-931aa45d-4115-435b-8de6-91d96ed063d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:56.099724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb335b32-440d-4138-abfc-8e8a9c441a4e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:56.103391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5587dcb-3284-407c-b1f8-64bd798aa2ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:56.104759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5587dcb-3284-407c-b1f8-64bd798aa2ce service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.104759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5587dcb-3284-407c-b1f8-64bd798aa2ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.104759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5587dcb-3284-407c-b1f8-64bd798aa2ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.105410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 920/1804] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:56.107388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931aa45d-4115-435b-8de6-91d96ed063d4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:56.109585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-931aa45d-4115-435b-8de6-91d96ed063d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:56.110389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a5587dcb-3284-407c-b1f8-64bd798aa2ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:56.124211 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931aa45d-4115-435b-8de6-91d96ed063d4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:56.130435 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2882-803f-4d4c-b1e5-d1cc82744e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:56.131294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2882-803f-4d4c-b1e5-d1cc82744e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.131671 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2882-803f-4d4c-b1e5-d1cc82744e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.131856 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5587dcb-3284-407c-b1f8-64bd798aa2ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:56.131955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2882-803f-4d4c-b1e5-d1cc82744e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.132681 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d2882-803f-4d4c-b1e5-d1cc82744e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:56.134587 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5587dcb-3284-407c-b1f8-64bd798aa2ce service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:56.135381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d2882-803f-4d4c-b1e5-d1cc82744e0b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:56.150054 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 885/1805] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:56.151487 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9166f-a029-4735-a011-34a6ee856733 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.151744 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9166f-a029-4735-a011-34a6ee856733 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.152030 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9166f-a029-4735-a011-34a6ee856733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.153307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 921/1806] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:56.154450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2882-803f-4d4c-b1e5-d1cc82744e0b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:56.168867 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2882-803f-4d4c-b1e5-d1cc82744e0b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:56.177170 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-45d9166f-a029-4735-a011-34a6ee856733 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:56.177562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa6dbd-ea15-4bae-9943-a5ce9fb9b043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:56.178285 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa6dbd-ea15-4bae-9943-a5ce9fb9b043 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.178595 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa6dbd-ea15-4bae-9943-a5ce9fb9b043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.178973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa6dbd-ea15-4bae-9943-a5ce9fb9b043 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.179332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-45d9166f-a029-4735-a011-34a6ee856733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:56.179760 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa6dbd-ea15-4bae-9943-a5ce9fb9b043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:56.180731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa6dbd-ea15-4bae-9943-a5ce9fb9b043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:56.182498 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa6dbd-ea15-4bae-9943-a5ce9fb9b043 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:56.192112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 886/1807] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:56.193059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9166f-a029-4735-a011-34a6ee856733 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:56.203456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 922/1808] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:56.204704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9166f-a029-4735-a011-34a6ee856733 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:56.208911 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa6dbd-ea15-4bae-9943-a5ce9fb9b043 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:56.209953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ab6c2-3cd5-421f-a9d0-59ee4a8dd1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:56.210998 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ab6c2-3cd5-421f-a9d0-59ee4a8dd1e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.211285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ab6c2-3cd5-421f-a9d0-59ee4a8dd1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.211696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ab6c2-3cd5-421f-a9d0-59ee4a8dd1e7 admin admin] PATH_INFO: `/v3/projects/fc57fd2084654e4396814c0ca1d1b1e8/users/96a6a7f753dc484d83f3829ac1f92a87/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.213890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ab6c2-3cd5-421f-a9d0-59ee4a8dd1e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc57fd2084654e4396814c0ca1d1b1e8, user_id=96a6a7f753dc484d83f3829ac1f92a87, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:56.216901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ab6c2-3cd5-421f-a9d0-59ee4a8dd1e7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:56.223855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa6dbd-ea15-4bae-9943-a5ce9fb9b043 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:56.237713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 887/1809] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:56 2022] PUT /identity/v3/projects/fc57fd2084654e4396814c0ca1d1b1e8/users/96a6a7f753dc484d83f3829ac1f92a87/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:56.237713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ab6c2-3cd5-421f-a9d0-59ee4a8dd1e7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:56.285110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:56.301629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd409469-f9eb-436a-a0d2-e4379d11e03b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:56.302332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd409469-f9eb-436a-a0d2-e4379d11e03b service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.302620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd409469-f9eb-436a-a0d2-e4379d11e03b service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.302906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd409469-f9eb-436a-a0d2-e4379d11e03b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.304364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ab6c2-3cd5-421f-a9d0-59ee4a8dd1e7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:56.309369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bf08a-1449-4ee6-9207-51cf063a486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:56.310085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bf08a-1449-4ee6-9207-51cf063a486f admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.310371 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bf08a-1449-4ee6-9207-51cf063a486f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.310647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bf08a-1449-4ee6-9207-51cf063a486f admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.311467 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bf08a-1449-4ee6-9207-51cf063a486f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:56.313432 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bf08a-1449-4ee6-9207-51cf063a486f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:56.314716 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd409469-f9eb-436a-a0d2-e4379d11e03b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:56.316224 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd409469-f9eb-436a-a0d2-e4379d11e03b service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:56.326941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 923/1810] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:56.328288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fbdb3-c826-480d-84b1-275ca60479c4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.328577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fbdb3-c826-480d-84b1-275ca60479c4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.328858 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fbdb3-c826-480d-84b1-275ca60479c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.341158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:56.346654 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 888/1811] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:56 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:56.347536 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bf08a-1449-4ee6-9207-51cf063a486f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:56.362763 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-918fbdb3-c826-480d-84b1-275ca60479c4 None None] MFA Rules not processed for user `96a6a7f753dc484d83f3829ac1f92a87`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:56.366683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-918fbdb3-c826-480d-84b1-275ca60479c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:56.445883 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bf08a-1449-4ee6-9207-51cf063a486f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:56.457205 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615def6d-78dc-4c04-a529-d73f52d0dea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:56.457976 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615def6d-78dc-4c04-a529-d73f52d0dea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.458345 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615def6d-78dc-4c04-a529-d73f52d0dea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.458689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615def6d-78dc-4c04-a529-d73f52d0dea0 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.459469 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615def6d-78dc-4c04-a529-d73f52d0dea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:56.461594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615def6d-78dc-4c04-a529-d73f52d0dea0 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:56.471232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 924/1812] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:56.480765 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fbdb3-c826-480d-84b1-275ca60479c4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:56.483111 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-918fbdb3-c826-480d-84b1-275ca60479c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:56.486852 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 889/1813] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:56 2022] POST /identity/v3/users => generated 285 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:56.490980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615def6d-78dc-4c04-a529-d73f52d0dea0 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:56.507791 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615def6d-78dc-4c04-a529-d73f52d0dea0 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:56.515509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc1e4b-fce6-4187-83d0-0abde1003fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:56.517033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc1e4b-fce6-4187-83d0-0abde1003fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.517339 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc1e4b-fce6-4187-83d0-0abde1003fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.517622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc1e4b-fce6-4187-83d0-0abde1003fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.518871 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc1e4b-fce6-4187-83d0-0abde1003fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:56.521576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc1e4b-fce6-4187-83d0-0abde1003fd0 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:56.550670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 890/1814] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:56.556095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fbdb3-c826-480d-84b1-275ca60479c4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:56.556357 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc1e4b-fce6-4187-83d0-0abde1003fd0 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:56.560155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f37e9d-5585-485c-8df7-817e41d62c35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:56.560922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f37e9d-5585-485c-8df7-817e41d62c35 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.561712 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f37e9d-5585-485c-8df7-817e41d62c35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.561712 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f37e9d-5585-485c-8df7-817e41d62c35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.571957 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc1e4b-fce6-4187-83d0-0abde1003fd0 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:56.573513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f37e9d-5585-485c-8df7-817e41d62c35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:56.575427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f37e9d-5585-485c-8df7-817e41d62c35 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:56.590074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 925/1815] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:30:56.596421 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd64d59-d700-4b37-b7de-7e8a199a7092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:56.599138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd64d59-d700-4b37-b7de-7e8a199a7092 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.599891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd64d59-d700-4b37-b7de-7e8a199a7092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.600433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd64d59-d700-4b37-b7de-7e8a199a7092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.601620 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd64d59-d700-4b37-b7de-7e8a199a7092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:56.603995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd64d59-d700-4b37-b7de-7e8a199a7092 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:56.621376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 891/1816] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:56.626723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f37e9d-5585-485c-8df7-817e41d62c35 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:56.627856 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd64d59-d700-4b37-b7de-7e8a199a7092 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:56.630772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ddd64d59-d700-4b37-b7de-7e8a199a7092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:56.658724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd64d59-d700-4b37-b7de-7e8a199a7092 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:56.664828 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f37e9d-5585-485c-8df7-817e41d62c35 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:56.677284 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac25e7-75cd-461e-a9b2-68c644b2ea1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:56.678398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac25e7-75cd-461e-a9b2-68c644b2ea1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.678740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac25e7-75cd-461e-a9b2-68c644b2ea1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.679093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac25e7-75cd-461e-a9b2-68c644b2ea1d admin admin] PATH_INFO: `/v3/projects/e58f113584fe4783b18d9207e473b411/users/624328faa6164bb89bb1417d73a5ce62/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.679991 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7c7b9-586a-4225-9736-f93b3e550f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:56.681258 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7c7b9-586a-4225-9736-f93b3e550f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.681597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7c7b9-586a-4225-9736-f93b3e550f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.681986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7c7b9-586a-4225-9736-f93b3e550f04 admin admin] PATH_INFO: `/v3/projects/6213fe45ed674d318a51e0ee4ee5fbff` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.683260 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7c7b9-586a-4225-9736-f93b3e550f04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6213fe45ed674d318a51e0ee4ee5fbff)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:56.688392 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7c7b9-586a-4225-9736-f93b3e550f04 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:56.718917 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac25e7-75cd-461e-a9b2-68c644b2ea1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58f113584fe4783b18d9207e473b411, user_id=624328faa6164bb89bb1417d73a5ce62, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:56.722208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac25e7-75cd-461e-a9b2-68c644b2ea1d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:56.769351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 926/1817] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:56 2022] PUT /identity/v3/projects/e58f113584fe4783b18d9207e473b411/users/624328faa6164bb89bb1417d73a5ce62/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:56.780201 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfd5f8-4c63-4612-989a-3ac258b6c4cd None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.780488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfd5f8-4c63-4612-989a-3ac258b6c4cd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.780772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfd5f8-4c63-4612-989a-3ac258b6c4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.824112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7b7c7b9-586a-4225-9736-f93b3e550f04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6213fe45ed674d318a51e0ee4ee5fbff', 'request_id': 'req-b7b7c7b9-586a-4225-9736-f93b3e550f04'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:56.835467 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0fcfd5f8-4c63-4612-989a-3ac258b6c4cd None None] MFA Rules not processed for user `624328faa6164bb89bb1417d73a5ce62`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:56.835860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7b7c7b9-586a-4225-9736-f93b3e550f04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6213fe45ed674d318a51e0ee4ee5fbff', 'request_id': 'req-b7b7c7b9-586a-4225-9736-f93b3e550f04'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:56.836773 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0fcfd5f8-4c63-4612-989a-3ac258b6c4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:56.857626 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7b7c7b9-586a-4225-9736-f93b3e550f04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6213fe45ed674d318a51e0ee4ee5fbff', 'request_id': 'req-b7b7c7b9-586a-4225-9736-f93b3e550f04'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:56.879071 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7b7c7b9-586a-4225-9736-f93b3e550f04 admin admin] The token cache is being invalidate because project 6213fe45ed674d318a51e0ee4ee5fbff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:56.879371 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7b7c7b9-586a-4225-9736-f93b3e550f04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:56.880102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7b7c7b9-586a-4225-9736-f93b3e550f04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:56.881767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 892/1818] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:56 2022] DELETE /identity/v3/projects/6213fe45ed674d318a51e0ee4ee5fbff => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:56.882560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7c7b9-586a-4225-9736-f93b3e550f04 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:56.884215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b7b7c7b9-586a-4225-9736-f93b3e550f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:56.912271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:56.914060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:56.922865 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 927/1819] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:56.922865 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfd5f8-4c63-4612-989a-3ac258b6c4cd None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:56.923855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0fcfd5f8-4c63-4612-989a-3ac258b6c4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:56.967041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7c7b9-586a-4225-9736-f93b3e550f04 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:56.974931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960552d6-14c3-432f-80c7-814dbc8c4852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:56.976003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960552d6-14c3-432f-80c7-814dbc8c4852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.976357 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960552d6-14c3-432f-80c7-814dbc8c4852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.976704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960552d6-14c3-432f-80c7-814dbc8c4852 admin admin] PATH_INFO: `/v3/projects/697c6aec410f48ffa517c42d04f35dec` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.978089 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960552d6-14c3-432f-80c7-814dbc8c4852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=697c6aec410f48ffa517c42d04f35dec)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:56.980361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960552d6-14c3-432f-80c7-814dbc8c4852 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:56.999939 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfd5f8-4c63-4612-989a-3ac258b6c4cd None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:57.007773 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc116f20-35df-46b3-a1f0-20899caead7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:57.008634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc116f20-35df-46b3-a1f0-20899caead7e service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:57.009215 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc116f20-35df-46b3-a1f0-20899caead7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:57.009215 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc116f20-35df-46b3-a1f0-20899caead7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:57.011409 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-dc116f20-35df-46b3-a1f0-20899caead7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:57.082315 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-960552d6-14c3-432f-80c7-814dbc8c4852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697c6aec410f48ffa517c42d04f35dec', 'request_id': 'req-960552d6-14c3-432f-80c7-814dbc8c4852'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.089661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-960552d6-14c3-432f-80c7-814dbc8c4852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697c6aec410f48ffa517c42d04f35dec', 'request_id': 'req-960552d6-14c3-432f-80c7-814dbc8c4852'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.100881 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-960552d6-14c3-432f-80c7-814dbc8c4852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697c6aec410f48ffa517c42d04f35dec', 'request_id': 'req-960552d6-14c3-432f-80c7-814dbc8c4852'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.116584 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc116f20-35df-46b3-a1f0-20899caead7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:57.119322 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc116f20-35df-46b3-a1f0-20899caead7e service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:57.123376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-960552d6-14c3-432f-80c7-814dbc8c4852 admin admin] The token cache is being invalidate because project 697c6aec410f48ffa517c42d04f35dec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:57.124105 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-960552d6-14c3-432f-80c7-814dbc8c4852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.125304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-960552d6-14c3-432f-80c7-814dbc8c4852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.132368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 893/1820] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:56 2022] DELETE /identity/v3/projects/697c6aec410f48ffa517c42d04f35dec => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:57.134107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960552d6-14c3-432f-80c7-814dbc8c4852 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:57.134412 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 928/1821] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:57.135235 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc116f20-35df-46b3-a1f0-20899caead7e service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:57.137878 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-dc116f20-35df-46b3-a1f0-20899caead7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:57.138610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-960552d6-14c3-432f-80c7-814dbc8c4852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:57.152704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc116f20-35df-46b3-a1f0-20899caead7e service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:57.237580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960552d6-14c3-432f-80c7-814dbc8c4852 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:57.242265 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3a024-2eff-4888-b2b4-642cefb36a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:57.243528 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3a024-2eff-4888-b2b4-642cefb36a2e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:57.243860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a2325-a3d4-41c2-ac00-b181ddd92d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:57.244955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3a024-2eff-4888-b2b4-642cefb36a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:57.245256 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3a024-2eff-4888-b2b4-642cefb36a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:57.245659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a2325-a3d4-41c2-ac00-b181ddd92d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:57.246031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3a024-2eff-4888-b2b4-642cefb36a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:57.246275 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a2325-a3d4-41c2-ac00-b181ddd92d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:57.246560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a2325-a3d4-41c2-ac00-b181ddd92d99 admin admin] PATH_INFO: `/v3/users/0f2c315e50c7452cb87006f29f0f9930` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:57.248005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a2325-a3d4-41c2-ac00-b181ddd92d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f2c315e50c7452cb87006f29f0f9930)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:57.248663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3a024-2eff-4888-b2b4-642cefb36a2e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:57.250343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a2325-a3d4-41c2-ac00-b181ddd92d99 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:57.279390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 929/1822] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:57 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:57.280635 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3a024-2eff-4888-b2b4-642cefb36a2e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:57.282258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8ab3a024-2eff-4888-b2b4-642cefb36a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:57.312815 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b18a2325-a3d4-41c2-ac00-b181ddd92d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f2c315e50c7452cb87006f29f0f9930'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.317903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:57.330851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b18a2325-a3d4-41c2-ac00-b181ddd92d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f2c315e50c7452cb87006f29f0f9930'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.331866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b18a2325-a3d4-41c2-ac00-b181ddd92d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f2c315e50c7452cb87006f29f0f9930'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.332818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b18a2325-a3d4-41c2-ac00-b181ddd92d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f2c315e50c7452cb87006f29f0f9930'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.340995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b18a2325-a3d4-41c2-ac00-b181ddd92d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f2c315e50c7452cb87006f29f0f9930'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.342043 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:57.357912 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 894/1823] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:57 2022] DELETE /identity/v3/users/0f2c315e50c7452cb87006f29f0f9930 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:57.359043 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a2325-a3d4-41c2-ac00-b181ddd92d99 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:57.361085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b18a2325-a3d4-41c2-ac00-b181ddd92d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:57.379301 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3a024-2eff-4888-b2b4-642cefb36a2e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:57.464320 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b511fc4-56af-48e4-a125-35bd9b508d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:57.465275 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b511fc4-56af-48e4-a125-35bd9b508d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:57.465560 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b511fc4-56af-48e4-a125-35bd9b508d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:57.465863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b511fc4-56af-48e4-a125-35bd9b508d37 admin admin] PATH_INFO: `/v3/users/46df99931bfa437db0e5d03e44e34756` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:57.467293 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b511fc4-56af-48e4-a125-35bd9b508d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46df99931bfa437db0e5d03e44e34756)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:57.469616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b511fc4-56af-48e4-a125-35bd9b508d37 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:57.478986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a2325-a3d4-41c2-ac00-b181ddd92d99 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:57.485411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22839ee-5668-4f9e-87df-06e413f8006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:57.486102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22839ee-5668-4f9e-87df-06e413f8006b admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:57.486432 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22839ee-5668-4f9e-87df-06e413f8006b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:57.486709 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22839ee-5668-4f9e-87df-06e413f8006b admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:57.487452 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22839ee-5668-4f9e-87df-06e413f8006b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:57.489545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22839ee-5668-4f9e-87df-06e413f8006b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:57.524221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 895/1824] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:57 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:57.529568 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22839ee-5668-4f9e-87df-06e413f8006b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:57.552199 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22839ee-5668-4f9e-87df-06e413f8006b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:57.562423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6b511fc4-56af-48e4-a125-35bd9b508d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46df99931bfa437db0e5d03e44e34756'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.563557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6b511fc4-56af-48e4-a125-35bd9b508d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46df99931bfa437db0e5d03e44e34756'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.565286 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6b511fc4-56af-48e4-a125-35bd9b508d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46df99931bfa437db0e5d03e44e34756'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.567093 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc05a5-041d-4f34-b3c5-41cabc65222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:57.567861 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc05a5-041d-4f34-b3c5-41cabc65222f admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:57.568147 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc05a5-041d-4f34-b3c5-41cabc65222f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:57.568413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc05a5-041d-4f34-b3c5-41cabc65222f admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:57.569333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc05a5-041d-4f34-b3c5-41cabc65222f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:57.571876 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc05a5-041d-4f34-b3c5-41cabc65222f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:57.588475 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6b511fc4-56af-48e4-a125-35bd9b508d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46df99931bfa437db0e5d03e44e34756'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.596578 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 896/1825] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:57.600969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc05a5-041d-4f34-b3c5-41cabc65222f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:57.603585 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b5bc05a5-041d-4f34-b3c5-41cabc65222f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:57.604327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6b511fc4-56af-48e4-a125-35bd9b508d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46df99931bfa437db0e5d03e44e34756'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.618830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc05a5-041d-4f34-b3c5-41cabc65222f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:57.624249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70470c03-e033-4af4-8307-c36f092ae043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:57.625157 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70470c03-e033-4af4-8307-c36f092ae043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:57.625519 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70470c03-e033-4af4-8307-c36f092ae043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:57.625711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70470c03-e033-4af4-8307-c36f092ae043 admin admin] PATH_INFO: `/v3/projects/f17dc520cb7a4971a5b799cf77311006/users/7da2defc7e184c6082a9ac4851a2e291/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:57.632517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 930/1826] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:57 2022] DELETE /identity/v3/users/46df99931bfa437db0e5d03e44e34756 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:57.652470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70470c03-e033-4af4-8307-c36f092ae043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17dc520cb7a4971a5b799cf77311006, user_id=7da2defc7e184c6082a9ac4851a2e291, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:57.655076 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70470c03-e033-4af4-8307-c36f092ae043 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:57.672245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 897/1827] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:57 2022] PUT /identity/v3/projects/f17dc520cb7a4971a5b799cf77311006/users/7da2defc7e184c6082a9ac4851a2e291/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:30:57.676132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b511fc4-56af-48e4-a125-35bd9b508d37 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:57.750084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70470c03-e033-4af4-8307-c36f092ae043 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:57.751847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-70470c03-e033-4af4-8307-c36f092ae043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:57.758542 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b511fc4-56af-48e4-a125-35bd9b508d37 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:57.776275 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:57.851801 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70470c03-e033-4af4-8307-c36f092ae043 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:57.858020 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a1df5-3773-4608-bbd2-ed731b3e5a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:57.859051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a1df5-3773-4608-bbd2-ed731b3e5a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:57.859369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a1df5-3773-4608-bbd2-ed731b3e5a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:57.859656 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a1df5-3773-4608-bbd2-ed731b3e5a69 admin admin] PATH_INFO: `/v3/projects/d2b1a6dc954b4a0bad6a3cb5e2888f08` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:57.860885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a1df5-3773-4608-bbd2-ed731b3e5a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b1a6dc954b4a0bad6a3cb5e2888f08)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:57.862809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a1df5-3773-4608-bbd2-ed731b3e5a69 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:57.866173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cae09f-9cff-47ea-8c26-02e941aa1c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:57.867420 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cae09f-9cff-47ea-8c26-02e941aa1c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:57.868104 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cae09f-9cff-47ea-8c26-02e941aa1c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:57.868378 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cae09f-9cff-47ea-8c26-02e941aa1c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:57.869161 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cae09f-9cff-47ea-8c26-02e941aa1c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:57.872439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cae09f-9cff-47ea-8c26-02e941aa1c69 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:57.899311 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 931/1828] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:57.903320 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cae09f-9cff-47ea-8c26-02e941aa1c69 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:57.910336 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:57.919708 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cae09f-9cff-47ea-8c26-02e941aa1c69 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:57.937218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-171a1df5-3773-4608-bbd2-ed731b3e5a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b1a6dc954b4a0bad6a3cb5e2888f08', 'request_id': 'req-171a1df5-3773-4608-bbd2-ed731b3e5a69'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.948117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-171a1df5-3773-4608-bbd2-ed731b3e5a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b1a6dc954b4a0bad6a3cb5e2888f08', 'request_id': 'req-171a1df5-3773-4608-bbd2-ed731b3e5a69'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.959915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-171a1df5-3773-4608-bbd2-ed731b3e5a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b1a6dc954b4a0bad6a3cb5e2888f08', 'request_id': 'req-171a1df5-3773-4608-bbd2-ed731b3e5a69'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.981604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-171a1df5-3773-4608-bbd2-ed731b3e5a69 admin admin] The token cache is being invalidate because project d2b1a6dc954b4a0bad6a3cb5e2888f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:57.981958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-171a1df5-3773-4608-bbd2-ed731b3e5a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.982961 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-171a1df5-3773-4608-bbd2-ed731b3e5a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:57.984759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 898/1829] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:57 2022] DELETE /identity/v3/projects/d2b1a6dc954b4a0bad6a3cb5e2888f08 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:57.989464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d837fb-d3aa-47b7-afb5-84f57a456b8e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:57.989763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d837fb-d3aa-47b7-afb5-84f57a456b8e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:57.990049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d837fb-d3aa-47b7-afb5-84f57a456b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:58.010202 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b08a9-4b9b-4469-a320-1f31f23776c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:58.011017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b08a9-4b9b-4469-a320-1f31f23776c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:58.011298 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b08a9-4b9b-4469-a320-1f31f23776c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:58.011580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b08a9-4b9b-4469-a320-1f31f23776c4 admin admin] PATH_INFO: `/v3/projects/f17dc520cb7a4971a5b799cf77311006/users/7da2defc7e184c6082a9ac4851a2e291/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:58.012799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-45d837fb-d3aa-47b7-afb5-84f57a456b8e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:58.014786 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-45d837fb-d3aa-47b7-afb5-84f57a456b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:58.017907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b08a9-4b9b-4469-a320-1f31f23776c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17dc520cb7a4971a5b799cf77311006, user_id=7da2defc7e184c6082a9ac4851a2e291, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:58.023337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b08a9-4b9b-4469-a320-1f31f23776c4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:58.036015 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 899/1830] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:30:58.037255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d837fb-d3aa-47b7-afb5-84f57a456b8e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:58.038658 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-45d837fb-d3aa-47b7-afb5-84f57a456b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:58.049174 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 932/1831] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:57 2022] PUT /identity/v3/projects/f17dc520cb7a4971a5b799cf77311006/users/7da2defc7e184c6082a9ac4851a2e291/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:30:58.050759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffb62b-1003-4ccd-8836-7ded683ff54b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:58.051056 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffb62b-1003-4ccd-8836-7ded683ff54b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:58.051869 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffb62b-1003-4ccd-8836-7ded683ff54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:58.064883 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d837fb-d3aa-47b7-afb5-84f57a456b8e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:58.077229 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-beffb62b-1003-4ccd-8836-7ded683ff54b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:58.078359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-beffb62b-1003-4ccd-8836-7ded683ff54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:58.158223 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 933/1832] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:58.159566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d5fbe-96b3-45bf-914d-1553ffeaf00f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:58.159873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d5fbe-96b3-45bf-914d-1553ffeaf00f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:58.160146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d5fbe-96b3-45bf-914d-1553ffeaf00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:58.175012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2787028-7392-45b4-9f3b-bffe704dce7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:58.176705 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2787028-7392-45b4-9f3b-bffe704dce7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:58.178291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2787028-7392-45b4-9f3b-bffe704dce7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:58.178591 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2787028-7392-45b4-9f3b-bffe704dce7b admin admin] PATH_INFO: `/v3/projects/93d8530aaf7344fa97336208221d8718` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:58.180776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2787028-7392-45b4-9f3b-bffe704dce7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d8530aaf7344fa97336208221d8718)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:58.185278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2787028-7392-45b4-9f3b-bffe704dce7b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:58.194695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2e2d5fbe-96b3-45bf-914d-1553ffeaf00f None None] MFA Rules not processed for user `7da2defc7e184c6082a9ac4851a2e291`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:58.195972 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2e2d5fbe-96b3-45bf-914d-1553ffeaf00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:58.245326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:58.258617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e2787028-7392-45b4-9f3b-bffe704dce7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d8530aaf7344fa97336208221d8718', 'request_id': 'req-e2787028-7392-45b4-9f3b-bffe704dce7b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:58.269367 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e2787028-7392-45b4-9f3b-bffe704dce7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d8530aaf7344fa97336208221d8718', 'request_id': 'req-e2787028-7392-45b4-9f3b-bffe704dce7b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:58.289334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e2787028-7392-45b4-9f3b-bffe704dce7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d8530aaf7344fa97336208221d8718', 'request_id': 'req-e2787028-7392-45b4-9f3b-bffe704dce7b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:58.302269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e2787028-7392-45b4-9f3b-bffe704dce7b admin admin] The token cache is being invalidate because project 93d8530aaf7344fa97336208221d8718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:58.302939 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e2787028-7392-45b4-9f3b-bffe704dce7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:58.303255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e2787028-7392-45b4-9f3b-bffe704dce7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:58.313450 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 900/1834] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:58 2022] DELETE /identity/v3/projects/93d8530aaf7344fa97336208221d8718 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:58.313732 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 934/1834] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:58.313887 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2787028-7392-45b4-9f3b-bffe704dce7b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:58.314020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d5fbe-96b3-45bf-914d-1553ffeaf00f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:58.314020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2e2d5fbe-96b3-45bf-914d-1553ffeaf00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:58.314238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e2787028-7392-45b4-9f3b-bffe704dce7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:58.329458 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d5fbe-96b3-45bf-914d-1553ffeaf00f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:58.384018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:58.424026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2787028-7392-45b4-9f3b-bffe704dce7b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:58.440030 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80331196-f3f6-4c10-b387-e8bb5e80fb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:58.440285 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53867c5b-0d6c-4f8d-b3de-35ef7d44d4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:58.441234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80331196-f3f6-4c10-b387-e8bb5e80fb54 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:58.441538 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53867c5b-0d6c-4f8d-b3de-35ef7d44d4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:58.441804 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80331196-f3f6-4c10-b387-e8bb5e80fb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:58.441939 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53867c5b-0d6c-4f8d-b3de-35ef7d44d4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:58.442305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53867c5b-0d6c-4f8d-b3de-35ef7d44d4e7 admin admin] PATH_INFO: `/v3/users/ee1d74d0fcb44935af9be10cd731afa0` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:58.442497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80331196-f3f6-4c10-b387-e8bb5e80fb54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:58.443561 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80331196-f3f6-4c10-b387-e8bb5e80fb54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:58.444073 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53867c5b-0d6c-4f8d-b3de-35ef7d44d4e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee1d74d0fcb44935af9be10cd731afa0)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:58.444225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80331196-f3f6-4c10-b387-e8bb5e80fb54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:58.446060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80331196-f3f6-4c10-b387-e8bb5e80fb54 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:58.446335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53867c5b-0d6c-4f8d-b3de-35ef7d44d4e7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:58.475210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 901/1835] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:58.476628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3121f-0e09-4df8-a205-a02b2677ca88 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:58.476929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3121f-0e09-4df8-a205-a02b2677ca88 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:58.477266 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3121f-0e09-4df8-a205-a02b2677ca88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:58.507358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e4e3121f-0e09-4df8-a205-a02b2677ca88 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:58.509663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e4e3121f-0e09-4df8-a205-a02b2677ca88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:58.514292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-53867c5b-0d6c-4f8d-b3de-35ef7d44d4e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee1d74d0fcb44935af9be10cd731afa0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:58.515002 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-53867c5b-0d6c-4f8d-b3de-35ef7d44d4e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee1d74d0fcb44935af9be10cd731afa0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:58.515617 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-53867c5b-0d6c-4f8d-b3de-35ef7d44d4e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee1d74d0fcb44935af9be10cd731afa0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:58.530842 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-53867c5b-0d6c-4f8d-b3de-35ef7d44d4e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee1d74d0fcb44935af9be10cd731afa0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:58.543890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 902/1836] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:58.544508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3121f-0e09-4df8-a205-a02b2677ca88 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:58.547380 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-53867c5b-0d6c-4f8d-b3de-35ef7d44d4e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee1d74d0fcb44935af9be10cd731afa0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:58.547628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e4e3121f-0e09-4df8-a205-a02b2677ca88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:58.583391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 935/1837] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:58 2022] DELETE /identity/v3/users/ee1d74d0fcb44935af9be10cd731afa0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:58.584618 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53867c5b-0d6c-4f8d-b3de-35ef7d44d4e7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:58.588644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-53867c5b-0d6c-4f8d-b3de-35ef7d44d4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:58.652106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3121f-0e09-4df8-a205-a02b2677ca88 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:58.670654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:58.702758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53867c5b-0d6c-4f8d-b3de-35ef7d44d4e7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:58.718869 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4f476-491f-474c-b680-9ce5229bdfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:58.730488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4f476-491f-474c-b680-9ce5229bdfe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:58.730488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4f476-491f-474c-b680-9ce5229bdfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:58.730488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4f476-491f-474c-b680-9ce5229bdfe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:58.730488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4f476-491f-474c-b680-9ce5229bdfe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:58.730488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4f476-491f-474c-b680-9ce5229bdfe9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:58.755899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed738c0c-678b-4b39-a5ef-983f30053f6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:58.757157 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed738c0c-678b-4b39-a5ef-983f30053f6d service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:58.759734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed738c0c-678b-4b39-a5ef-983f30053f6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:58.760246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed738c0c-678b-4b39-a5ef-983f30053f6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:58.765306 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ed738c0c-678b-4b39-a5ef-983f30053f6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:58.773671 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 936/1838] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:58 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:58.775329 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ea4a3-00bd-4c91-a4b5-1a764504afc1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:58.775798 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ea4a3-00bd-4c91-a4b5-1a764504afc1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:58.776258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ea4a3-00bd-4c91-a4b5-1a764504afc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:58.804152 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a38ea4a3-00bd-4c91-a4b5-1a764504afc1 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:58.805774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a38ea4a3-00bd-4c91-a4b5-1a764504afc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:58.868058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed738c0c-678b-4b39-a5ef-983f30053f6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:58.869068 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed738c0c-678b-4b39-a5ef-983f30053f6d service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:58.884376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 903/1839] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:58 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:58.885941 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe67b0a-5f23-4d2f-b688-a7feaf260056 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:58.886306 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe67b0a-5f23-4d2f-b688-a7feaf260056 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:58.886683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe67b0a-5f23-4d2f-b688-a7feaf260056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:58.915011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0fe67b0a-5f23-4d2f-b688-a7feaf260056 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:58.916782 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0fe67b0a-5f23-4d2f-b688-a7feaf260056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:58.925800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 937/1840] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:58.927131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ea4a3-00bd-4c91-a4b5-1a764504afc1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:58.938748 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 904/1841] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:58.940168 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe67b0a-5f23-4d2f-b688-a7feaf260056 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:58.961668 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ea4a3-00bd-4c91-a4b5-1a764504afc1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:58.967813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190c4ca-aa0a-4e3c-9d65-679ba91bef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:58.967813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190c4ca-aa0a-4e3c-9d65-679ba91bef60 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:58.968114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190c4ca-aa0a-4e3c-9d65-679ba91bef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:58.968391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190c4ca-aa0a-4e3c-9d65-679ba91bef60 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:58.968829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe67b0a-5f23-4d2f-b688-a7feaf260056 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:58.969315 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190c4ca-aa0a-4e3c-9d65-679ba91bef60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:58.972116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190c4ca-aa0a-4e3c-9d65-679ba91bef60 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:58.981646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd44a8f-abf4-442f-824f-7189359f5dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:58.986002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd44a8f-abf4-442f-824f-7189359f5dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:58.986695 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd44a8f-abf4-442f-824f-7189359f5dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:58.987023 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd44a8f-abf4-442f-824f-7189359f5dfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:58.988235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd44a8f-abf4-442f-824f-7189359f5dfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:30:58.989225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd44a8f-abf4-442f-824f-7189359f5dfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:58.991988 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd44a8f-abf4-442f-824f-7189359f5dfa admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:59.007995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 938/1842] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:58 2022] POST /identity/v3/users => generated 289 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:59.008750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190c4ca-aa0a-4e3c-9d65-679ba91bef60 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:59.015792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d190c4ca-aa0a-4e3c-9d65-679ba91bef60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:59.036106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 905/1843] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:30:59.037182 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd44a8f-abf4-442f-824f-7189359f5dfa admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:59.059036 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd44a8f-abf4-442f-824f-7189359f5dfa admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:59.066374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823b2a6-f3ce-4fc9-a7ed-f99f47cc3b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:59.067135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823b2a6-f3ce-4fc9-a7ed-f99f47cc3b1e admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:59.067422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823b2a6-f3ce-4fc9-a7ed-f99f47cc3b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:59.067798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823b2a6-f3ce-4fc9-a7ed-f99f47cc3b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:59.068616 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823b2a6-f3ce-4fc9-a7ed-f99f47cc3b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:59.071788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823b2a6-f3ce-4fc9-a7ed-f99f47cc3b1e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:59.079835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:59.098869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 906/1844] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:59.100056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823b2a6-f3ce-4fc9-a7ed-f99f47cc3b1e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:59.130502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823b2a6-f3ce-4fc9-a7ed-f99f47cc3b1e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:59.145657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbe425-c4b1-4eeb-abe4-9867fbbb5dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:59.147507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbe425-c4b1-4eeb-abe4-9867fbbb5dbc admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:59.149538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbe425-c4b1-4eeb-abe4-9867fbbb5dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:59.150294 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbe425-c4b1-4eeb-abe4-9867fbbb5dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:59.152240 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbe425-c4b1-4eeb-abe4-9867fbbb5dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:59.158681 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbe425-c4b1-4eeb-abe4-9867fbbb5dbc admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:59.179489 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190c4ca-aa0a-4e3c-9d65-679ba91bef60 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:59.193729 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68774656-8bbd-4732-ae49-d14704fec2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:59.194269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68774656-8bbd-4732-ae49-d14704fec2ae service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:59.194569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68774656-8bbd-4732-ae49-d14704fec2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:59.196000 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68774656-8bbd-4732-ae49-d14704fec2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:59.217810 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68774656-8bbd-4732-ae49-d14704fec2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:59.222454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68774656-8bbd-4732-ae49-d14704fec2ae service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:59.234517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 939/1845] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:59.235655 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68774656-8bbd-4732-ae49-d14704fec2ae service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:59.243064 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 907/1846] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:30:59 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:59.245277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbe425-c4b1-4eeb-abe4-9867fbbb5dbc admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:59.249796 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68774656-8bbd-4732-ae49-d14704fec2ae service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:59.381819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1183e-c3c7-4b93-b6d0-68a79404a97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:59.382580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1183e-c3c7-4b93-b6d0-68a79404a97b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:59.383587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1183e-c3c7-4b93-b6d0-68a79404a97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:59.384022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1183e-c3c7-4b93-b6d0-68a79404a97b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:59.385017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1183e-c3c7-4b93-b6d0-68a79404a97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:59.392147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1183e-c3c7-4b93-b6d0-68a79404a97b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:59.392147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:59.419145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 940/1847] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:59.421605 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbe425-c4b1-4eeb-abe4-9867fbbb5dbc admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:59.426843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1183e-c3c7-4b93-b6d0-68a79404a97b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:59.435295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b18a8-ae3c-49c7-9923-7566c6f33e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:59.436028 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b18a8-ae3c-49c7-9923-7566c6f33e19 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:59.436301 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b18a8-ae3c-49c7-9923-7566c6f33e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:59.436586 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b18a8-ae3c-49c7-9923-7566c6f33e19 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:59.437298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b18a8-ae3c-49c7-9923-7566c6f33e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:59.439265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b18a8-ae3c-49c7-9923-7566c6f33e19 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:59.447146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1183e-c3c7-4b93-b6d0-68a79404a97b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:59.465469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179267cd-5f00-4201-a0e6-2aa364997185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:59.469588 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179267cd-5f00-4201-a0e6-2aa364997185 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:59.470836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179267cd-5f00-4201-a0e6-2aa364997185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:59.471329 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179267cd-5f00-4201-a0e6-2aa364997185 admin admin] PATH_INFO: `/v3/projects/a041cdb28e3b4d66837b873bed9ae661/users/4513bb6051814408a40a71f314bd9ff4/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:59.482832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 908/1848] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:30:59 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:30:59.484020 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b18a8-ae3c-49c7-9923-7566c6f33e19 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:59.499283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179267cd-5f00-4201-a0e6-2aa364997185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a041cdb28e3b4d66837b873bed9ae661, user_id=4513bb6051814408a40a71f314bd9ff4, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:59.502569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179267cd-5f00-4201-a0e6-2aa364997185 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:59.516840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b18a8-ae3c-49c7-9923-7566c6f33e19 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:59.525704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 941/1849] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:59 2022] PUT /identity/v3/projects/a041cdb28e3b4d66837b873bed9ae661/users/4513bb6051814408a40a71f314bd9ff4/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:59.537866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557895b-aa1c-499e-924f-40bdeacfaf43 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:59.538346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557895b-aa1c-499e-924f-40bdeacfaf43 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:59.538792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557895b-aa1c-499e-924f-40bdeacfaf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:59.589357 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e557895b-aa1c-499e-924f-40bdeacfaf43 None None] MFA Rules not processed for user `4513bb6051814408a40a71f314bd9ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:59.590587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e557895b-aa1c-499e-924f-40bdeacfaf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:59.644485 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d01e5-6b74-45fa-bc59-bc60af8a4e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:59.645458 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d01e5-6b74-45fa-bc59-bc60af8a4e8e admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:59.645949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d01e5-6b74-45fa-bc59-bc60af8a4e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:59.646345 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d01e5-6b74-45fa-bc59-bc60af8a4e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:59.647434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d01e5-6b74-45fa-bc59-bc60af8a4e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:59.650776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d01e5-6b74-45fa-bc59-bc60af8a4e8e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:59.666520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 909/1850] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:30:59.676277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d01e5-6b74-45fa-bc59-bc60af8a4e8e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:59.708442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d01e5-6b74-45fa-bc59-bc60af8a4e8e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:59.722002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab35fb0-9b0f-4db0-8118-50535b1f470e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:59.723083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab35fb0-9b0f-4db0-8118-50535b1f470e admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:59.723374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab35fb0-9b0f-4db0-8118-50535b1f470e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:59.723676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab35fb0-9b0f-4db0-8118-50535b1f470e admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:59.724851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab35fb0-9b0f-4db0-8118-50535b1f470e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:59.732309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab35fb0-9b0f-4db0-8118-50535b1f470e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:59.752960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 910/1851] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:30:59.765493 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab35fb0-9b0f-4db0-8118-50535b1f470e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:59.776302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 942/1852] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:30:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:30:59.790340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557895b-aa1c-499e-924f-40bdeacfaf43 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:59.790818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab35fb0-9b0f-4db0-8118-50535b1f470e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:59.792196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e557895b-aa1c-499e-924f-40bdeacfaf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:59.800911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4eb08-062a-4416-b333-c35c2bbda48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:59.801844 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4eb08-062a-4416-b333-c35c2bbda48c admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:59.802130 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4eb08-062a-4416-b333-c35c2bbda48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:59.802406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4eb08-062a-4416-b333-c35c2bbda48c admin admin] PATH_INFO: `/v3/projects/896b7e14985640a49010cebb84f51cfe/users/8a8512f9c69d4456aafbea9e4a38a557/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:59.830140 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4eb08-062a-4416-b333-c35c2bbda48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=896b7e14985640a49010cebb84f51cfe, user_id=8a8512f9c69d4456aafbea9e4a38a557, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:59.833332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4eb08-062a-4416-b333-c35c2bbda48c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:59.879141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 911/1853] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:30:59 2022] PUT /identity/v3/projects/896b7e14985640a49010cebb84f51cfe/users/8a8512f9c69d4456aafbea9e4a38a557/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:59.883124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4eb08-062a-4416-b333-c35c2bbda48c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:59.885806 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7fa4eb08-062a-4416-b333-c35c2bbda48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:59.970657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:00.004642 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557895b-aa1c-499e-924f-40bdeacfaf43 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:00.042147 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4eb08-062a-4416-b333-c35c2bbda48c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:00.047681 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca9cdb-32e3-4021-97a1-b8babea52038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:00.049031 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca9cdb-32e3-4021-97a1-b8babea52038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:00.053410 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca9cdb-32e3-4021-97a1-b8babea52038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:00.053848 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca9cdb-32e3-4021-97a1-b8babea52038 admin admin] PATH_INFO: `/v3/projects/2243425dec954980b8dc6db67b881863` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:00.056735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca9cdb-32e3-4021-97a1-b8babea52038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2243425dec954980b8dc6db67b881863)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:00.059455 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca9cdb-32e3-4021-97a1-b8babea52038 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:00.113078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750df0ae-9af3-4036-bc6c-d7859993da4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a57dc68aeb5482a86d5983b466d933d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:00.113752 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750df0ae-9af3-4036-bc6c-d7859993da4a service glance] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:00.114506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750df0ae-9af3-4036-bc6c-d7859993da4a service glance] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:00.114883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750df0ae-9af3-4036-bc6c-d7859993da4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:00.127970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:00.149845 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e5ca9cdb-32e3-4021-97a1-b8babea52038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2243425dec954980b8dc6db67b881863', 'request_id': 'req-e5ca9cdb-32e3-4021-97a1-b8babea52038'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:00.164571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e5ca9cdb-32e3-4021-97a1-b8babea52038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2243425dec954980b8dc6db67b881863', 'request_id': 'req-e5ca9cdb-32e3-4021-97a1-b8babea52038'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:00.190496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e5ca9cdb-32e3-4021-97a1-b8babea52038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2243425dec954980b8dc6db67b881863', 'request_id': 'req-e5ca9cdb-32e3-4021-97a1-b8babea52038'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:00.205973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750df0ae-9af3-4036-bc6c-d7859993da4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:00.207830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750df0ae-9af3-4036-bc6c-d7859993da4a service glance] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:00.210401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e5ca9cdb-32e3-4021-97a1-b8babea52038 admin admin] The token cache is being invalidate because project 2243425dec954980b8dc6db67b881863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:00.210696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e5ca9cdb-32e3-4021-97a1-b8babea52038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:00.211381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e5ca9cdb-32e3-4021-97a1-b8babea52038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:00.213029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 912/1854] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:59 2022] DELETE /identity/v3/projects/2243425dec954980b8dc6db67b881863 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:31:00.218156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d60a0-fc4a-45cb-83ab-df702e03bcfe None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:00.218468 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d60a0-fc4a-45cb-83ab-df702e03bcfe None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:00.218811 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d60a0-fc4a-45cb-83ab-df702e03bcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:00.226358 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 943/1855] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:00.228163 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fbc56-d438-491f-9283-50fef0155c2c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:00.228724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fbc56-d438-491f-9283-50fef0155c2c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:00.229000 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fbc56-d438-491f-9283-50fef0155c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:00.248917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2f1d60a0-fc4a-45cb-83ab-df702e03bcfe None None] MFA Rules not processed for user `8a8512f9c69d4456aafbea9e4a38a557`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:00.251318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2f1d60a0-fc4a-45cb-83ab-df702e03bcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:00.251484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-781fbc56-d438-491f-9283-50fef0155c2c None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:00.252723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-781fbc56-d438-491f-9283-50fef0155c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:00.363958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 944/1856] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:00.366064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fbc56-d438-491f-9283-50fef0155c2c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:00.371698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-781fbc56-d438-491f-9283-50fef0155c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:00.383188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 913/1857] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:00.383188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02216e07-3458-4d4a-b732-120715700e26 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:00.383188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02216e07-3458-4d4a-b732-120715700e26 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:00.383188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02216e07-3458-4d4a-b732-120715700e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:00.396013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fbc56-d438-491f-9283-50fef0155c2c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:00.400954 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c4299-769b-4e12-b23f-dfddbe5aa9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:00.402066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c4299-769b-4e12-b23f-dfddbe5aa9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:00.402263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c4299-769b-4e12-b23f-dfddbe5aa9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:00.402546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c4299-769b-4e12-b23f-dfddbe5aa9da admin admin] PATH_INFO: `/v3/users/936f0bc3d5fa48769bfaf3371fecb6ae` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:00.403891 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c4299-769b-4e12-b23f-dfddbe5aa9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=936f0bc3d5fa48769bfaf3371fecb6ae)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:00.406633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c4299-769b-4e12-b23f-dfddbe5aa9da admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:00.412671 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-02216e07-3458-4d4a-b732-120715700e26 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:00.414275 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-02216e07-3458-4d4a-b732-120715700e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:00.426051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 914/1858] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:00.426918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02216e07-3458-4d4a-b732-120715700e26 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:00.429621 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-02216e07-3458-4d4a-b732-120715700e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:00.444413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02216e07-3458-4d4a-b732-120715700e26 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:00.450209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5e195-0528-46b5-8b44-16b46638c4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:00.451039 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5e195-0528-46b5-8b44-16b46638c4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:00.451501 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5e195-0528-46b5-8b44-16b46638c4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:00.452073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5e195-0528-46b5-8b44-16b46638c4d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:00.452797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5e195-0528-46b5-8b44-16b46638c4d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:00.454750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5e195-0528-46b5-8b44-16b46638c4d2 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:00.499339 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 915/1859] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:00 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:00.499339 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5e195-0528-46b5-8b44-16b46638c4d2 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:00.499539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-989c4299-769b-4e12-b23f-dfddbe5aa9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936f0bc3d5fa48769bfaf3371fecb6ae'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:00.499539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-989c4299-769b-4e12-b23f-dfddbe5aa9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936f0bc3d5fa48769bfaf3371fecb6ae'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:00.499539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-989c4299-769b-4e12-b23f-dfddbe5aa9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936f0bc3d5fa48769bfaf3371fecb6ae'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:00.513860 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-989c4299-769b-4e12-b23f-dfddbe5aa9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936f0bc3d5fa48769bfaf3371fecb6ae'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:00.533042 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-989c4299-769b-4e12-b23f-dfddbe5aa9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936f0bc3d5fa48769bfaf3371fecb6ae'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:00.542716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:00.569473 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 945/1860] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:00 2022] DELETE /identity/v3/users/936f0bc3d5fa48769bfaf3371fecb6ae => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:00.572455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c4299-769b-4e12-b23f-dfddbe5aa9da admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:00.576857 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-989c4299-769b-4e12-b23f-dfddbe5aa9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:00.627987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5e195-0528-46b5-8b44-16b46638c4d2 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:00.634127 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:00.712405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c4299-769b-4e12-b23f-dfddbe5aa9da admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:00.713578 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55437ab2-b42b-4edf-b9a2-80e0fcdeb1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:00.714896 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437ab2-b42b-4edf-b9a2-80e0fcdeb1db admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:00.716249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437ab2-b42b-4edf-b9a2-80e0fcdeb1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:00.716802 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437ab2-b42b-4edf-b9a2-80e0fcdeb1db admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:00.717820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55437ab2-b42b-4edf-b9a2-80e0fcdeb1db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:00.718322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55437ab2-b42b-4edf-b9a2-80e0fcdeb1db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:00.721523 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55437ab2-b42b-4edf-b9a2-80e0fcdeb1db admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:00.727177 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd049b89-d753-43d0-9e11-92422c797a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:00.727918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd049b89-d753-43d0-9e11-92422c797a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:00.728207 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd049b89-d753-43d0-9e11-92422c797a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:00.728513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd049b89-d753-43d0-9e11-92422c797a99 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:00.729270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd049b89-d753-43d0-9e11-92422c797a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:00.732524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd049b89-d753-43d0-9e11-92422c797a99 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:00.741588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 916/1861] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:00.741588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa216e8-d5cf-4cef-bba3-8d9ab64aebb1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:00.741588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa216e8-d5cf-4cef-bba3-8d9ab64aebb1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:00.741588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa216e8-d5cf-4cef-bba3-8d9ab64aebb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:00.763669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 946/1862] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:00 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:00.764602 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd049b89-d753-43d0-9e11-92422c797a99 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:00.766854 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cd049b89-d753-43d0-9e11-92422c797a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:00.768588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9fa216e8-d5cf-4cef-bba3-8d9ab64aebb1 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:00.769829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9fa216e8-d5cf-4cef-bba3-8d9ab64aebb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:00.793354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 917/1863] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:00.793354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa216e8-d5cf-4cef-bba3-8d9ab64aebb1 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:00.799512 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa216e8-d5cf-4cef-bba3-8d9ab64aebb1 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:00.802060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd049b89-d753-43d0-9e11-92422c797a99 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:00.806183 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995e6e3-f0cd-4a6c-a3eb-1cd3e68fdb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:00.807215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995e6e3-f0cd-4a6c-a3eb-1cd3e68fdb0e admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:00.807701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995e6e3-f0cd-4a6c-a3eb-1cd3e68fdb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:00.808150 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995e6e3-f0cd-4a6c-a3eb-1cd3e68fdb0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:00.808605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e61c77-22e2-4997-b7d3-fe9fb0a59b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:00.809884 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e61c77-22e2-4997-b7d3-fe9fb0a59b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:00.810137 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995e6e3-f0cd-4a6c-a3eb-1cd3e68fdb0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:00.810406 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e61c77-22e2-4997-b7d3-fe9fb0a59b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:00.810688 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e61c77-22e2-4997-b7d3-fe9fb0a59b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:00.811500 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e61c77-22e2-4997-b7d3-fe9fb0a59b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:00.813750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995e6e3-f0cd-4a6c-a3eb-1cd3e68fdb0e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:00.813859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e61c77-22e2-4997-b7d3-fe9fb0a59b7c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:00.830407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 918/1864] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:00.831564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995e6e3-f0cd-4a6c-a3eb-1cd3e68fdb0e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:00.833775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e995e6e3-f0cd-4a6c-a3eb-1cd3e68fdb0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:00.866502 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 947/1865] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:00 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:00.866502 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e61c77-22e2-4997-b7d3-fe9fb0a59b7c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:00.953444 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995e6e3-f0cd-4a6c-a3eb-1cd3e68fdb0e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:00.988243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e61c77-22e2-4997-b7d3-fe9fb0a59b7c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:00.996431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67763fe6-df0e-4238-bac5-ee9713f66a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:00.998058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67763fe6-df0e-4238-bac5-ee9713f66a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:00.998403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67763fe6-df0e-4238-bac5-ee9713f66a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:00.998760 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67763fe6-df0e-4238-bac5-ee9713f66a58 admin admin] PATH_INFO: `/v3/projects/651a8634db694fc1a63aa11da53ddc6f/users/d5fb92f204d34e29b9c19b633c853694/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:01.022819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67763fe6-df0e-4238-bac5-ee9713f66a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=651a8634db694fc1a63aa11da53ddc6f, user_id=d5fb92f204d34e29b9c19b633c853694, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:01.026048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67763fe6-df0e-4238-bac5-ee9713f66a58 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:01.027917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a75062-ec07-4015-b930-8bfcdfcf7d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:01.028834 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a75062-ec07-4015-b930-8bfcdfcf7d8e service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:01.029273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a75062-ec07-4015-b930-8bfcdfcf7d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:01.029622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a75062-ec07-4015-b930-8bfcdfcf7d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:01.042282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a75062-ec07-4015-b930-8bfcdfcf7d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:01.044492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a75062-ec07-4015-b930-8bfcdfcf7d8e service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:01.046832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 948/1866] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:00 2022] PUT /identity/v3/projects/651a8634db694fc1a63aa11da53ddc6f/users/d5fb92f204d34e29b9c19b633c853694/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:01.049844 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67763fe6-df0e-4238-bac5-ee9713f66a58 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:01.059551 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 919/1867] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:01.060590 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a75062-ec07-4015-b930-8bfcdfcf7d8e service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:01.066591 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:01.077036 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a75062-ec07-4015-b930-8bfcdfcf7d8e service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:01.186550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67763fe6-df0e-4238-bac5-ee9713f66a58 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:01.196453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb1383-d546-4703-9b6d-058aaa4d1c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:01.196800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb1383-d546-4703-9b6d-058aaa4d1c52 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:01.197071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb1383-d546-4703-9b6d-058aaa4d1c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:01.197374 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb1383-d546-4703-9b6d-058aaa4d1c52 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:01.198231 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb1383-d546-4703-9b6d-058aaa4d1c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:01.200309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb1383-d546-4703-9b6d-058aaa4d1c52 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:01.215117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aef36f-11fa-42fe-af35-681dbb2c641d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:01.216437 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef36f-11fa-42fe-af35-681dbb2c641d admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:01.217063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef36f-11fa-42fe-af35-681dbb2c641d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:01.217702 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef36f-11fa-42fe-af35-681dbb2c641d admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:01.218993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aef36f-11fa-42fe-af35-681dbb2c641d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:01.223178 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aef36f-11fa-42fe-af35-681dbb2c641d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:01.232343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 949/1868] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:01 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:01.236280 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb1383-d546-4703-9b6d-058aaa4d1c52 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:01.244555 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 920/1869] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:01.245733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aef36f-11fa-42fe-af35-681dbb2c641d admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:01.252956 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:01.258389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb1383-d546-4703-9b6d-058aaa4d1c52 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:01.262383 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aef36f-11fa-42fe-af35-681dbb2c641d admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:01.270546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709cbd7-feda-4d99-82ee-91b2db2fcc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:01.271183 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c79abd-247e-4788-bb0d-60db58dd9126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:01.271920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c79abd-247e-4788-bb0d-60db58dd9126 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:01.272098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709cbd7-feda-4d99-82ee-91b2db2fcc2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:01.272219 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c79abd-247e-4788-bb0d-60db58dd9126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:01.272450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c79abd-247e-4788-bb0d-60db58dd9126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:01.272609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709cbd7-feda-4d99-82ee-91b2db2fcc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:01.272973 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709cbd7-feda-4d99-82ee-91b2db2fcc2d admin admin] PATH_INFO: `/v3/projects/651a8634db694fc1a63aa11da53ddc6f/users/d5fb92f204d34e29b9c19b633c853694/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:01.273236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c79abd-247e-4788-bb0d-60db58dd9126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:01.275460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c79abd-247e-4788-bb0d-60db58dd9126 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:01.275589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709cbd7-feda-4d99-82ee-91b2db2fcc2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=651a8634db694fc1a63aa11da53ddc6f, user_id=d5fb92f204d34e29b9c19b633c853694, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:01.279366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709cbd7-feda-4d99-82ee-91b2db2fcc2d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:01.294748 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 921/1870] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:01 2022] PUT /identity/v3/projects/651a8634db694fc1a63aa11da53ddc6f/users/d5fb92f204d34e29b9c19b633c853694/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:01.311639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 950/1871] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:01.318332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c79abd-247e-4788-bb0d-60db58dd9126 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:01.318465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40222cd2-c7d0-467b-b549-53427512cf4a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:01.318809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40222cd2-c7d0-467b-b549-53427512cf4a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:01.319087 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40222cd2-c7d0-467b-b549-53427512cf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:01.335614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c79abd-247e-4788-bb0d-60db58dd9126 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:01.395576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-40222cd2-c7d0-467b-b549-53427512cf4a None None] MFA Rules not processed for user `d5fb92f204d34e29b9c19b633c853694`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:01.397096 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-40222cd2-c7d0-467b-b549-53427512cf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:01.405221 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f560aff-6d11-410d-a07f-c7da24c1a7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:01.406453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f560aff-6d11-410d-a07f-c7da24c1a7aa admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:01.406754 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f560aff-6d11-410d-a07f-c7da24c1a7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:01.407032 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f560aff-6d11-410d-a07f-c7da24c1a7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:01.407967 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f560aff-6d11-410d-a07f-c7da24c1a7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:01.409611 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f560aff-6d11-410d-a07f-c7da24c1a7aa admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:01.424072 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 951/1872] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:01.425384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f560aff-6d11-410d-a07f-c7da24c1a7aa admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:01.428578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3f560aff-6d11-410d-a07f-c7da24c1a7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:01.454113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f560aff-6d11-410d-a07f-c7da24c1a7aa admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:01.465981 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5071b-9da5-4ca9-a956-7e54ee995029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:01.466957 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5071b-9da5-4ca9-a956-7e54ee995029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:01.467238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5071b-9da5-4ca9-a956-7e54ee995029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:01.467527 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5071b-9da5-4ca9-a956-7e54ee995029 admin admin] PATH_INFO: `/v3/users/624328faa6164bb89bb1417d73a5ce62` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:01.469991 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5071b-9da5-4ca9-a956-7e54ee995029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=624328faa6164bb89bb1417d73a5ce62)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:01.471998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5071b-9da5-4ca9-a956-7e54ee995029 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:01.550389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 922/1873] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:01.551416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40222cd2-c7d0-467b-b549-53427512cf4a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:01.554080 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-48e5071b-9da5-4ca9-a956-7e54ee995029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624328faa6164bb89bb1417d73a5ce62'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:01.554916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-48e5071b-9da5-4ca9-a956-7e54ee995029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624328faa6164bb89bb1417d73a5ce62'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:01.555974 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-48e5071b-9da5-4ca9-a956-7e54ee995029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624328faa6164bb89bb1417d73a5ce62'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:01.569384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-48e5071b-9da5-4ca9-a956-7e54ee995029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624328faa6164bb89bb1417d73a5ce62'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:01.581701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40222cd2-c7d0-467b-b549-53427512cf4a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:01.593404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-48e5071b-9da5-4ca9-a956-7e54ee995029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624328faa6164bb89bb1417d73a5ce62'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:01.615097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b478a-f558-4dae-8ea9-37f2a661346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:01.616190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b478a-f558-4dae-8ea9-37f2a661346b admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:01.616585 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b478a-f558-4dae-8ea9-37f2a661346b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:01.616971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b478a-f558-4dae-8ea9-37f2a661346b admin admin] PATH_INFO: `/v3/projects/f6d0b4fbe0a14593a26f72f38ee37433/users/50adbfefe2034aca81707252107ca8a6/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:01.640146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 952/1874] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:01 2022] DELETE /identity/v3/users/624328faa6164bb89bb1417d73a5ce62 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:01.641259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5071b-9da5-4ca9-a956-7e54ee995029 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:01.643047 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-48e5071b-9da5-4ca9-a956-7e54ee995029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:01.667584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b478a-f558-4dae-8ea9-37f2a661346b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d0b4fbe0a14593a26f72f38ee37433, user_id=50adbfefe2034aca81707252107ca8a6, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:01.670879 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b478a-f558-4dae-8ea9-37f2a661346b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:01.704003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 923/1875] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:01 2022] PUT /identity/v3/projects/f6d0b4fbe0a14593a26f72f38ee37433/users/50adbfefe2034aca81707252107ca8a6/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:01.708527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110d8c9-16c4-4752-8bca-7f1b249af2b2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:01.709442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110d8c9-16c4-4752-8bca-7f1b249af2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:01.709442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110d8c9-16c4-4752-8bca-7f1b249af2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:01.748316 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-7110d8c9-16c4-4752-8bca-7f1b249af2b2 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:01.749929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7110d8c9-16c4-4752-8bca-7f1b249af2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:01.784505 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5071b-9da5-4ca9-a956-7e54ee995029 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:01.813795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:01.843512 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:01.904414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cc1ed-7598-41f7-bc30-b3bf86ea76b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:01.905432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cc1ed-7598-41f7-bc30-b3bf86ea76b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:01.905723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cc1ed-7598-41f7-bc30-b3bf86ea76b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:01.906004 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cc1ed-7598-41f7-bc30-b3bf86ea76b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:01.908482 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 924/1876] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:01.910071 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110d8c9-16c4-4752-8bca-7f1b249af2b2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:01.910371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6a9cc1ed-7598-41f7-bc30-b3bf86ea76b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:01.913337 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7110d8c9-16c4-4752-8bca-7f1b249af2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:01.935688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110d8c9-16c4-4752-8bca-7f1b249af2b2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:01.954924 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf597d-96df-4c70-bbf9-74505ff87525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:01.956910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf597d-96df-4c70-bbf9-74505ff87525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:01.957569 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf597d-96df-4c70-bbf9-74505ff87525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:01.957971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf597d-96df-4c70-bbf9-74505ff87525 admin admin] PATH_INFO: `/v3/projects/6e97423858004593a721614659e5fbf2` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:01.960739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf597d-96df-4c70-bbf9-74505ff87525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e97423858004593a721614659e5fbf2)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:01.964296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf597d-96df-4c70-bbf9-74505ff87525 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:02.007076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cc1ed-7598-41f7-bc30-b3bf86ea76b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:02.007076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cc1ed-7598-41f7-bc30-b3bf86ea76b8 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:02.023925 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 953/1877] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:02.032383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975db830-8911-4eb0-9b4c-8079ddc3cd95 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.033028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975db830-8911-4eb0-9b4c-8079ddc3cd95 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.033809 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975db830-8911-4eb0-9b4c-8079ddc3cd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.056385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a6bf597d-96df-4c70-bbf9-74505ff87525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e97423858004593a721614659e5fbf2', 'request_id': 'req-a6bf597d-96df-4c70-bbf9-74505ff87525'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.065428 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a6bf597d-96df-4c70-bbf9-74505ff87525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e97423858004593a721614659e5fbf2', 'request_id': 'req-a6bf597d-96df-4c70-bbf9-74505ff87525'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.082068 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a6bf597d-96df-4c70-bbf9-74505ff87525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e97423858004593a721614659e5fbf2', 'request_id': 'req-a6bf597d-96df-4c70-bbf9-74505ff87525'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.099786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-975db830-8911-4eb0-9b4c-8079ddc3cd95 None None] MFA Rules not processed for user `50adbfefe2034aca81707252107ca8a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:02.101059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-975db830-8911-4eb0-9b4c-8079ddc3cd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.104230 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a6bf597d-96df-4c70-bbf9-74505ff87525 admin admin] The token cache is being invalidate because project 6e97423858004593a721614659e5fbf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:02.104626 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a6bf597d-96df-4c70-bbf9-74505ff87525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.105724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a6bf597d-96df-4c70-bbf9-74505ff87525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.111324 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 925/1878] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:01 2022] DELETE /identity/v3/projects/6e97423858004593a721614659e5fbf2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:02.113102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81300f3d-2dc5-485a-b7a3-0a652b94ae6b None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.113225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81300f3d-2dc5-485a-b7a3-0a652b94ae6b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.113525 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81300f3d-2dc5-485a-b7a3-0a652b94ae6b None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.117986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 926/1879] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 08:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:02.117986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81300f3d-2dc5-485a-b7a3-0a652b94ae6b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:02.119982 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-81300f3d-2dc5-485a-b7a3-0a652b94ae6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.200845 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81300f3d-2dc5-485a-b7a3-0a652b94ae6b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:02.208724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e3f80-1917-4110-abb3-8033ad95a645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:02.209695 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e3f80-1917-4110-abb3-8033ad95a645 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.209979 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e3f80-1917-4110-abb3-8033ad95a645 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.210254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e3f80-1917-4110-abb3-8033ad95a645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.212699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ef0e3f80-1917-4110-abb3-8033ad95a645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.218078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 954/1880] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:02.218973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975db830-8911-4eb0-9b4c-8079ddc3cd95 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:02.220336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-975db830-8911-4eb0-9b4c-8079ddc3cd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.305756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e3f80-1917-4110-abb3-8033ad95a645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:02.308105 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e3f80-1917-4110-abb3-8033ad95a645 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:02.321333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 927/1881] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:02.323264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c40548-a297-4595-b7fc-ce5b52e04e7d None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.324688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c40548-a297-4595-b7fc-ce5b52e04e7d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.324948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c40548-a297-4595-b7fc-ce5b52e04e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.363714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-34c40548-a297-4595-b7fc-ce5b52e04e7d None None] MFA Rules not processed for user `131bb5462c8b478783a350d37caa76ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:02.364955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-34c40548-a297-4595-b7fc-ce5b52e04e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.388567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975db830-8911-4eb0-9b4c-8079ddc3cd95 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:02.390307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:02.396879 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d390bc1-0084-4d21-93e6-8f0d0a8a7ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:02.399122 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d390bc1-0084-4d21-93e6-8f0d0a8a7ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.399263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d390bc1-0084-4d21-93e6-8f0d0a8a7ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.399541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d390bc1-0084-4d21-93e6-8f0d0a8a7ed9 admin admin] PATH_INFO: `/v3/users/96a6a7f753dc484d83f3829ac1f92a87` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.400982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d390bc1-0084-4d21-93e6-8f0d0a8a7ed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a6a7f753dc484d83f3829ac1f92a87)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:02.403313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d390bc1-0084-4d21-93e6-8f0d0a8a7ed9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:02.408798 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:02.495662 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 928/1882] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 08:31:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:02.496876 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c40548-a297-4595-b7fc-ce5b52e04e7d None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:02.504453 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-34c40548-a297-4595-b7fc-ce5b52e04e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.521472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6d390bc1-0084-4d21-93e6-8f0d0a8a7ed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a6a7f753dc484d83f3829ac1f92a87'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.523028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6d390bc1-0084-4d21-93e6-8f0d0a8a7ed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a6a7f753dc484d83f3829ac1f92a87'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.523733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6d390bc1-0084-4d21-93e6-8f0d0a8a7ed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a6a7f753dc484d83f3829ac1f92a87'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.538245 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6d390bc1-0084-4d21-93e6-8f0d0a8a7ed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a6a7f753dc484d83f3829ac1f92a87'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.541975 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c40548-a297-4595-b7fc-ce5b52e04e7d None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:02.554383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6d390bc1-0084-4d21-93e6-8f0d0a8a7ed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a6a7f753dc484d83f3829ac1f92a87'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.561470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527cc58-e5ee-43da-bdc8-3ca8ebf50d35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:02.562286 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527cc58-e5ee-43da-bdc8-3ca8ebf50d35 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.562579 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527cc58-e5ee-43da-bdc8-3ca8ebf50d35 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.562847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527cc58-e5ee-43da-bdc8-3ca8ebf50d35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.567910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b527cc58-e5ee-43da-bdc8-3ca8ebf50d35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.582467 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 955/1883] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:02 2022] DELETE /identity/v3/users/96a6a7f753dc484d83f3829ac1f92a87 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:02.583160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d390bc1-0084-4d21-93e6-8f0d0a8a7ed9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:02.586199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6d390bc1-0084-4d21-93e6-8f0d0a8a7ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.594219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527cc58-e5ee-43da-bdc8-3ca8ebf50d35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:02.596390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527cc58-e5ee-43da-bdc8-3ca8ebf50d35 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:02.625433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 929/1884] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:02.765109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d390bc1-0084-4d21-93e6-8f0d0a8a7ed9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:02.771946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b1650-6922-4751-8314-5626b072503a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:02.772796 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b1650-6922-4751-8314-5626b072503a service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.773131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b1650-6922-4751-8314-5626b072503a service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.773416 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b1650-6922-4751-8314-5626b072503a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.776009 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-da3b1650-6922-4751-8314-5626b072503a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.781050 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527cc58-e5ee-43da-bdc8-3ca8ebf50d35 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:02.783095 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b527cc58-e5ee-43da-bdc8-3ca8ebf50d35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.808588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527cc58-e5ee-43da-bdc8-3ca8ebf50d35 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:02.824045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b1650-6922-4751-8314-5626b072503a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:02.827194 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b1650-6922-4751-8314-5626b072503a service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:02.859370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 956/1885] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:02.930731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:02.931779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.932515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.932515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8 admin admin] PATH_INFO: `/v3/projects/e58f113584fe4783b18d9207e473b411` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.934970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58f113584fe4783b18d9207e473b411)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:02.937015 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:02.974196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b1650-6922-4751-8314-5626b072503a service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:02.976441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-da3b1650-6922-4751-8314-5626b072503a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:03.008155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b1650-6922-4751-8314-5626b072503a service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:03.021410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42395cdb-79e8-4055-8232-999ed6e6222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:03.023179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42395cdb-79e8-4055-8232-999ed6e6222b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:03.024919 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42395cdb-79e8-4055-8232-999ed6e6222b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:03.025509 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42395cdb-79e8-4055-8232-999ed6e6222b admin admin] PATH_INFO: `/v3/users/50adbfefe2034aca81707252107ca8a6` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:03.031704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42395cdb-79e8-4055-8232-999ed6e6222b admin admin] RBAC: Authorizing `identity:delete_user(user_id=50adbfefe2034aca81707252107ca8a6)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:03.035932 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42395cdb-79e8-4055-8232-999ed6e6222b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:03.066677 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58f113584fe4783b18d9207e473b411', 'request_id': 'req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.085788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58f113584fe4783b18d9207e473b411', 'request_id': 'req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.101051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58f113584fe4783b18d9207e473b411', 'request_id': 'req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.128197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8 admin admin] The token cache is being invalidate because project e58f113584fe4783b18d9207e473b411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:03.128491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.129652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.136583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 930/1886] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:02 2022] DELETE /identity/v3/projects/e58f113584fe4783b18d9207e473b411 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:03.140854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:03.142055 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:03.157620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-42395cdb-79e8-4055-8232-999ed6e6222b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50adbfefe2034aca81707252107ca8a6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.158359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-42395cdb-79e8-4055-8232-999ed6e6222b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50adbfefe2034aca81707252107ca8a6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.159547 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-42395cdb-79e8-4055-8232-999ed6e6222b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50adbfefe2034aca81707252107ca8a6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.179528 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-42395cdb-79e8-4055-8232-999ed6e6222b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50adbfefe2034aca81707252107ca8a6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.187769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:03.196677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-42395cdb-79e8-4055-8232-999ed6e6222b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50adbfefe2034aca81707252107ca8a6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.216796 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:03.233830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 957/1887] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:02 2022] DELETE /identity/v3/users/50adbfefe2034aca81707252107ca8a6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:31:03.235697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42395cdb-79e8-4055-8232-999ed6e6222b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:03.237977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-42395cdb-79e8-4055-8232-999ed6e6222b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:03.274904 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0786c0d-c95f-4d28-b212-5ded25f6d5b8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:03.343450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42395cdb-79e8-4055-8232-999ed6e6222b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:03.354642 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733f059-8be2-49f9-a09c-ba60cc31f315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:03.355854 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733f059-8be2-49f9-a09c-ba60cc31f315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:03.355975 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733f059-8be2-49f9-a09c-ba60cc31f315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:03.356246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733f059-8be2-49f9-a09c-ba60cc31f315 admin admin] PATH_INFO: `/v3/projects/fc57fd2084654e4396814c0ca1d1b1e8` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:03.357867 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733f059-8be2-49f9-a09c-ba60cc31f315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc57fd2084654e4396814c0ca1d1b1e8)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:03.360048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733f059-8be2-49f9-a09c-ba60cc31f315 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:03.369819 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a677e-0862-4339-9fbe-37871dffe9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:03.370362 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a677e-0862-4339-9fbe-37871dffe9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:03.370649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a677e-0862-4339-9fbe-37871dffe9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:03.370926 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a677e-0862-4339-9fbe-37871dffe9ca admin admin] PATH_INFO: `/v3/users/7da2defc7e184c6082a9ac4851a2e291` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:03.376319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a677e-0862-4339-9fbe-37871dffe9ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=7da2defc7e184c6082a9ac4851a2e291)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:03.381741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a677e-0862-4339-9fbe-37871dffe9ca admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:03.442252 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6733f059-8be2-49f9-a09c-ba60cc31f315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc57fd2084654e4396814c0ca1d1b1e8', 'request_id': 'req-6733f059-8be2-49f9-a09c-ba60cc31f315'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.465950 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6733f059-8be2-49f9-a09c-ba60cc31f315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc57fd2084654e4396814c0ca1d1b1e8', 'request_id': 'req-6733f059-8be2-49f9-a09c-ba60cc31f315'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.488395 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d94a677e-0862-4339-9fbe-37871dffe9ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7da2defc7e184c6082a9ac4851a2e291'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.497817 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6733f059-8be2-49f9-a09c-ba60cc31f315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc57fd2084654e4396814c0ca1d1b1e8', 'request_id': 'req-6733f059-8be2-49f9-a09c-ba60cc31f315'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.511786 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d94a677e-0862-4339-9fbe-37871dffe9ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7da2defc7e184c6082a9ac4851a2e291'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.519175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d94a677e-0862-4339-9fbe-37871dffe9ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7da2defc7e184c6082a9ac4851a2e291'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.520560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d94a677e-0862-4339-9fbe-37871dffe9ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7da2defc7e184c6082a9ac4851a2e291'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.529589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6733f059-8be2-49f9-a09c-ba60cc31f315 admin admin] The token cache is being invalidate because project fc57fd2084654e4396814c0ca1d1b1e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:03.530140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6733f059-8be2-49f9-a09c-ba60cc31f315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.531362 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6733f059-8be2-49f9-a09c-ba60cc31f315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.534704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 958/1888] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:03 2022] DELETE /identity/v3/projects/fc57fd2084654e4396814c0ca1d1b1e8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:03.535250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d94a677e-0862-4339-9fbe-37871dffe9ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7da2defc7e184c6082a9ac4851a2e291'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:03.537399 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7b6cf-50f1-4a66-96e2-9c5a8f215809 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:03.537815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7b6cf-50f1-4a66-96e2-9c5a8f215809 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:03.538306 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7b6cf-50f1-4a66-96e2-9c5a8f215809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:03.579172 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-70a7b6cf-50f1-4a66-96e2-9c5a8f215809 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:03.585798 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-70a7b6cf-50f1-4a66-96e2-9c5a8f215809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:03.587033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 931/1889] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:03 2022] DELETE /identity/v3/users/7da2defc7e184c6082a9ac4851a2e291 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:03.588573 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786862a4-0833-417c-b42d-181fedc7a74f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:03.592176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786862a4-0833-417c-b42d-181fedc7a74f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:03.592380 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786862a4-0833-417c-b42d-181fedc7a74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:03.638420 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-786862a4-0833-417c-b42d-181fedc7a74f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:03.643889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-786862a4-0833-417c-b42d-181fedc7a74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:03.715480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 959/1890] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:03.732238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7b6cf-50f1-4a66-96e2-9c5a8f215809 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:03.734706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-70a7b6cf-50f1-4a66-96e2-9c5a8f215809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:03.751877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:03.779151 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:03.807863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 932/1891] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:03.817797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723661f-c709-4cfa-8966-d9eb289bc071 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:03.818157 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723661f-c709-4cfa-8966-d9eb289bc071 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:03.818484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723661f-c709-4cfa-8966-d9eb289bc071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:03.861384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e723661f-c709-4cfa-8966-d9eb289bc071 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:03.862519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7b6cf-50f1-4a66-96e2-9c5a8f215809 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:03.864284 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e723661f-c709-4cfa-8966-d9eb289bc071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:03.868942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c522f7-6c7b-40de-bceb-faefaa238da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:03.870309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c522f7-6c7b-40de-bceb-faefaa238da4 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:03.870756 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c522f7-6c7b-40de-bceb-faefaa238da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:03.871167 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c522f7-6c7b-40de-bceb-faefaa238da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:03.888758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c522f7-6c7b-40de-bceb-faefaa238da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:03.890715 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c522f7-6c7b-40de-bceb-faefaa238da4 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:03.894115 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 933/1892] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:03.899107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723661f-c709-4cfa-8966-d9eb289bc071 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:03.923159 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 960/1893] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:03.927215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723661f-c709-4cfa-8966-d9eb289bc071 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:03.940407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb63e2-14f8-401a-b2d6-46c8cf9f2634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:03.941143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb63e2-14f8-401a-b2d6-46c8cf9f2634 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:03.941431 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb63e2-14f8-401a-b2d6-46c8cf9f2634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:03.941704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb63e2-14f8-401a-b2d6-46c8cf9f2634 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:03.942466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb63e2-14f8-401a-b2d6-46c8cf9f2634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:03.942784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb63e2-14f8-401a-b2d6-46c8cf9f2634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:03.945113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb63e2-14f8-401a-b2d6-46c8cf9f2634 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:03.964487 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 934/1894] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:03.969515 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c522f7-6c7b-40de-bceb-faefaa238da4 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:03.982075 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c522f7-6c7b-40de-bceb-faefaa238da4 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:03.995516 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d921489-5ec0-4e81-84d8-58f1e3e4e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:03.997493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d921489-5ec0-4e81-84d8-58f1e3e4e91b admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:03.997929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d921489-5ec0-4e81-84d8-58f1e3e4e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:03.998462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d921489-5ec0-4e81-84d8-58f1e3e4e91b admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:03.999699 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d921489-5ec0-4e81-84d8-58f1e3e4e91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:04.001790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d921489-5ec0-4e81-84d8-58f1e3e4e91b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:04.046599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 961/1895] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:03 2022] POST /identity/v3/projects => generated 409 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:04.051309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb63e2-14f8-401a-b2d6-46c8cf9f2634 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:04.063406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb63e2-14f8-401a-b2d6-46c8cf9f2634 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:04.167972 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea91e8-1b72-4c90-8243-c7d774f0aa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:04.168744 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea91e8-1b72-4c90-8243-c7d774f0aa7b admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:04.169105 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea91e8-1b72-4c90-8243-c7d774f0aa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:04.169399 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea91e8-1b72-4c90-8243-c7d774f0aa7b admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:04.170809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea91e8-1b72-4c90-8243-c7d774f0aa7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:04.172874 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea91e8-1b72-4c90-8243-c7d774f0aa7b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:04.181665 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d921489-5ec0-4e81-84d8-58f1e3e4e91b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:04.184449 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6d921489-5ec0-4e81-84d8-58f1e3e4e91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:04.206780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d921489-5ec0-4e81-84d8-58f1e3e4e91b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:04.217876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73518d4-262c-471d-b76f-43a29d78a43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:04.218971 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73518d4-262c-471d-b76f-43a29d78a43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:04.219262 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73518d4-262c-471d-b76f-43a29d78a43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:04.219632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73518d4-262c-471d-b76f-43a29d78a43d admin admin] PATH_INFO: `/v3/projects/f17dc520cb7a4971a5b799cf77311006` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:04.221753 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73518d4-262c-471d-b76f-43a29d78a43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17dc520cb7a4971a5b799cf77311006)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:04.225033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 935/1896] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:04 2022] POST /identity/v3/users => generated 305 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:04.225403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73518d4-262c-471d-b76f-43a29d78a43d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:04.226334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea91e8-1b72-4c90-8243-c7d774f0aa7b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:04.246527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea91e8-1b72-4c90-8243-c7d774f0aa7b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:04.253467 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ab88a-0d4b-45eb-9d5c-c13936b81c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:04.254665 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ab88a-0d4b-45eb-9d5c-c13936b81c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:04.255127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ab88a-0d4b-45eb-9d5c-c13936b81c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:04.255496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ab88a-0d4b-45eb-9d5c-c13936b81c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:04.256931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ab88a-0d4b-45eb-9d5c-c13936b81c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:04.259890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ab88a-0d4b-45eb-9d5c-c13936b81c32 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:04.275403 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 936/1897] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:04.280572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ab88a-0d4b-45eb-9d5c-c13936b81c32 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:04.293121 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ab88a-0d4b-45eb-9d5c-c13936b81c32 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:04.298323 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef75248-8569-413d-a444-024b43a224d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:04.299119 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef75248-8569-413d-a444-024b43a224d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:04.299837 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef75248-8569-413d-a444-024b43a224d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:04.300225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef75248-8569-413d-a444-024b43a224d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:04.301369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef75248-8569-413d-a444-024b43a224d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:04.303182 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef75248-8569-413d-a444-024b43a224d9 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:04.317611 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 937/1898] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:04.323058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef75248-8569-413d-a444-024b43a224d9 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:04.339491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef75248-8569-413d-a444-024b43a224d9 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:04.349483 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7efb9a-157e-466f-8b0b-68e5b80f1297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:04.349483 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7efb9a-157e-466f-8b0b-68e5b80f1297 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:04.350173 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7efb9a-157e-466f-8b0b-68e5b80f1297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:04.350540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7efb9a-157e-466f-8b0b-68e5b80f1297 admin admin] PATH_INFO: `/v3/projects/40603b39ff2b4bb4865db6e16adee110/users/e24bb41ae0ae4c4fb51a2cc23782b6e5/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:04.357882 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b73518d4-262c-471d-b76f-43a29d78a43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17dc520cb7a4971a5b799cf77311006', 'request_id': 'req-b73518d4-262c-471d-b76f-43a29d78a43d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:04.374137 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7efb9a-157e-466f-8b0b-68e5b80f1297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40603b39ff2b4bb4865db6e16adee110, user_id=e24bb41ae0ae4c4fb51a2cc23782b6e5, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:04.374650 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b73518d4-262c-471d-b76f-43a29d78a43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17dc520cb7a4971a5b799cf77311006', 'request_id': 'req-b73518d4-262c-471d-b76f-43a29d78a43d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:04.377729 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7efb9a-157e-466f-8b0b-68e5b80f1297 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:04.382154 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b73518d4-262c-471d-b76f-43a29d78a43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17dc520cb7a4971a5b799cf77311006', 'request_id': 'req-b73518d4-262c-471d-b76f-43a29d78a43d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:04.396506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b73518d4-262c-471d-b76f-43a29d78a43d admin admin] The token cache is being invalidate because project f17dc520cb7a4971a5b799cf77311006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:04.396844 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b73518d4-262c-471d-b76f-43a29d78a43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:04.399165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b73518d4-262c-471d-b76f-43a29d78a43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:04.401004 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 962/1899] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:04 2022] DELETE /identity/v3/projects/f17dc520cb7a4971a5b799cf77311006 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:04.406187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7383f-84e7-4f86-8874-0a8bfae342ec None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:04.406919 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7383f-84e7-4f86-8874-0a8bfae342ec None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:04.407277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 938/1900] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:04 2022] PUT /identity/v3/projects/40603b39ff2b4bb4865db6e16adee110/users/e24bb41ae0ae4c4fb51a2cc23782b6e5/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:04.407565 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7383f-84e7-4f86-8874-0a8bfae342ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:04.436842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb341e37-07bb-463a-b7b8-44687133c4da None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:04.437112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb341e37-07bb-463a-b7b8-44687133c4da None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:04.438155 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb341e37-07bb-463a-b7b8-44687133c4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:04.449063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-30d7383f-84e7-4f86-8874-0a8bfae342ec None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:04.450602 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-30d7383f-84e7-4f86-8874-0a8bfae342ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:04.485524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-bb341e37-07bb-463a-b7b8-44687133c4da None None] MFA Rules not processed for user `e24bb41ae0ae4c4fb51a2cc23782b6e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:04.486919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bb341e37-07bb-463a-b7b8-44687133c4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:04.536670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 963/1901] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:31:04.543204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7383f-84e7-4f86-8874-0a8bfae342ec None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:04.543204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-30d7383f-84e7-4f86-8874-0a8bfae342ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:04.553654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7383f-84e7-4f86-8874-0a8bfae342ec None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:04.559966 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06955e5c-3ea2-44ab-98c7-c4f50deb9888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:04.561199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06955e5c-3ea2-44ab-98c7-c4f50deb9888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:04.561485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06955e5c-3ea2-44ab-98c7-c4f50deb9888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:04.561766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06955e5c-3ea2-44ab-98c7-c4f50deb9888 admin admin] PATH_INFO: `/v3/projects/f6d0b4fbe0a14593a26f72f38ee37433` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:04.563455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06955e5c-3ea2-44ab-98c7-c4f50deb9888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d0b4fbe0a14593a26f72f38ee37433)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:04.566845 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06955e5c-3ea2-44ab-98c7-c4f50deb9888 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:04.594803 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 939/1902] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:04 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:04.596557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:04.597696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a3e45-e95b-443c-a698-617917876896 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:04.598328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a3e45-e95b-443c-a698-617917876896 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:04.600592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a3e45-e95b-443c-a698-617917876896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:04.622717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e45a3e45-e95b-443c-a698-617917876896 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:04.624708 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e45a3e45-e95b-443c-a698-617917876896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:04.638657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 940/1903] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:04.643324 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a3e45-e95b-443c-a698-617917876896 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:04.644707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e45a3e45-e95b-443c-a698-617917876896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:04.652687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:04.653181 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-06955e5c-3ea2-44ab-98c7-c4f50deb9888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d0b4fbe0a14593a26f72f38ee37433', 'request_id': 'req-06955e5c-3ea2-44ab-98c7-c4f50deb9888'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:04.658446 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a3e45-e95b-443c-a698-617917876896 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:04.667100 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-06955e5c-3ea2-44ab-98c7-c4f50deb9888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d0b4fbe0a14593a26f72f38ee37433', 'request_id': 'req-06955e5c-3ea2-44ab-98c7-c4f50deb9888'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:04.673973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-06955e5c-3ea2-44ab-98c7-c4f50deb9888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d0b4fbe0a14593a26f72f38ee37433', 'request_id': 'req-06955e5c-3ea2-44ab-98c7-c4f50deb9888'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:04.698253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-06955e5c-3ea2-44ab-98c7-c4f50deb9888 admin admin] The token cache is being invalidate because project f6d0b4fbe0a14593a26f72f38ee37433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:04.698619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-06955e5c-3ea2-44ab-98c7-c4f50deb9888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:04.699394 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-06955e5c-3ea2-44ab-98c7-c4f50deb9888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:04.701589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 964/1904] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:04 2022] DELETE /identity/v3/projects/f6d0b4fbe0a14593a26f72f38ee37433 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:04.702597 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06955e5c-3ea2-44ab-98c7-c4f50deb9888 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:04.704092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-06955e5c-3ea2-44ab-98c7-c4f50deb9888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:04.758043 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2f845-c5b8-45a1-9749-1e2c98eb7a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:04.758772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2f845-c5b8-45a1-9749-1e2c98eb7a47 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:04.759059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2f845-c5b8-45a1-9749-1e2c98eb7a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:04.759334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2f845-c5b8-45a1-9749-1e2c98eb7a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:04.760397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2f845-c5b8-45a1-9749-1e2c98eb7a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:04.762535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2f845-c5b8-45a1-9749-1e2c98eb7a47 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:04.804772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06955e5c-3ea2-44ab-98c7-c4f50deb9888 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:04.811686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 941/1905] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:04 2022] POST /identity/v3/projects => generated 407 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:04.813032 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd4138-11a1-410f-98d5-20d48ed29ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:04.813302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f5797-851a-4d36-b2ea-36d7edf35009 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:04.813779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f5797-851a-4d36-b2ea-36d7edf35009 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:04.813895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd4138-11a1-410f-98d5-20d48ed29ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:04.814060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd4138-11a1-410f-98d5-20d48ed29ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:04.814336 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f5797-851a-4d36-b2ea-36d7edf35009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:04.814448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd4138-11a1-410f-98d5-20d48ed29ba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:04.815180 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd4138-11a1-410f-98d5-20d48ed29ba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:04.815784 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd4138-11a1-410f-98d5-20d48ed29ba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:04.819471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd4138-11a1-410f-98d5-20d48ed29ba8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:04.842760 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-d75f5797-851a-4d36-b2ea-36d7edf35009 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:04.844050 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d75f5797-851a-4d36-b2ea-36d7edf35009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:04.848121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 965/1906] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:04.853727 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd4138-11a1-410f-98d5-20d48ed29ba8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:04.856324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e8dd4138-11a1-410f-98d5-20d48ed29ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:04.872417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd4138-11a1-410f-98d5-20d48ed29ba8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:04.943589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 942/1907] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:04.944584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f5797-851a-4d36-b2ea-36d7edf35009 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:04.954413 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f25a33-a246-4ec5-a89f-323a0938409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:04.955511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f25a33-a246-4ec5-a89f-323a0938409c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:04.955998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f25a33-a246-4ec5-a89f-323a0938409c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:04.956470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f5797-851a-4d36-b2ea-36d7edf35009 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:04.957045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f25a33-a246-4ec5-a89f-323a0938409c admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:04.958368 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f25a33-a246-4ec5-a89f-323a0938409c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:04.960626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f25a33-a246-4ec5-a89f-323a0938409c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:04.963415 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e4249-614c-46d2-9ced-8923d12b20cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:04.964182 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e4249-614c-46d2-9ced-8923d12b20cb admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:04.964522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e4249-614c-46d2-9ced-8923d12b20cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:04.964859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e4249-614c-46d2-9ced-8923d12b20cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:04.965716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e4249-614c-46d2-9ced-8923d12b20cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:04.968294 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e4249-614c-46d2-9ced-8923d12b20cb admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:04.993841 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 966/1908] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:04 2022] POST /identity/v3/users => generated 310 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:04.996328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f443d4a-f855-4067-8a5f-31eb639cb127 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:04.996869 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f443d4a-f855-4067-8a5f-31eb639cb127 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:04.996869 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f443d4a-f855-4067-8a5f-31eb639cb127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.019899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 943/1909] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:04 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:05.020762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e4249-614c-46d2-9ced-8923d12b20cb admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:05.044616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3f443d4a-f855-4067-8a5f-31eb639cb127 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:05.045885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3f443d4a-f855-4067-8a5f-31eb639cb127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:05.079009 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:05.137704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e4249-614c-46d2-9ced-8923d12b20cb admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:05.149305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba47133-23e0-4879-87d0-aeb1e1ac766c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:05.150784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba47133-23e0-4879-87d0-aeb1e1ac766c admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.151589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba47133-23e0-4879-87d0-aeb1e1ac766c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.152085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba47133-23e0-4879-87d0-aeb1e1ac766c admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.153048 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba47133-23e0-4879-87d0-aeb1e1ac766c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:05.156105 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba47133-23e0-4879-87d0-aeb1e1ac766c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:05.156271 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 967/1910] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:05.160714 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f443d4a-f855-4067-8a5f-31eb639cb127 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:05.172328 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f443d4a-f855-4067-8a5f-31eb639cb127 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:05.178915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 944/1911] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:05.180097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba47133-23e0-4879-87d0-aeb1e1ac766c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:05.182344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8ba47133-23e0-4879-87d0-aeb1e1ac766c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:05.183113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116b15d-0d5e-475b-b1e7-2761fc9aed3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:05.183962 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116b15d-0d5e-475b-b1e7-2761fc9aed3d admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.184601 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116b15d-0d5e-475b-b1e7-2761fc9aed3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.185933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116b15d-0d5e-475b-b1e7-2761fc9aed3d admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.188534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116b15d-0d5e-475b-b1e7-2761fc9aed3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:05.192171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116b15d-0d5e-475b-b1e7-2761fc9aed3d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:05.194128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:05.237225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 968/1912] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:05 2022] POST /identity/v3/users => generated 294 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:05.238418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116b15d-0d5e-475b-b1e7-2761fc9aed3d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:05.257054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116b15d-0d5e-475b-b1e7-2761fc9aed3d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:05.264715 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cb95a-bf36-4f91-bbda-7c78948bbae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:05.266224 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cb95a-bf36-4f91-bbda-7c78948bbae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.266224 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cb95a-bf36-4f91-bbda-7c78948bbae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.266224 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cb95a-bf36-4f91-bbda-7c78948bbae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.267587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cb95a-bf36-4f91-bbda-7c78948bbae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:05.268022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cb95a-bf36-4f91-bbda-7c78948bbae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:05.271249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cb95a-bf36-4f91-bbda-7c78948bbae9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:05.290618 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 969/1913] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:05.291677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cb95a-bf36-4f91-bbda-7c78948bbae9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:05.302357 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba47133-23e0-4879-87d0-aeb1e1ac766c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:05.303854 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cb95a-bf36-4f91-bbda-7c78948bbae9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:05.308678 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b48bfb-b5b1-44fc-b77e-2acda258cac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:05.309662 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5c3c9-4955-4633-a0b2-aadf495ad3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:05.309982 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b48bfb-b5b1-44fc-b77e-2acda258cac3 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.310459 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b48bfb-b5b1-44fc-b77e-2acda258cac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.311190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b48bfb-b5b1-44fc-b77e-2acda258cac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.311304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5c3c9-4955-4633-a0b2-aadf495ad3b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.311401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5c3c9-4955-4633-a0b2-aadf495ad3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.315669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5c3c9-4955-4633-a0b2-aadf495ad3b0 admin admin] PATH_INFO: `/v3/projects/1a17ca648b904206a6fcd48d03d2b883/users/31598f99c88443c093e6309665c46d5a/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.321987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-87b48bfb-b5b1-44fc-b77e-2acda258cac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:05.344473 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5c3c9-4955-4633-a0b2-aadf495ad3b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a17ca648b904206a6fcd48d03d2b883, user_id=31598f99c88443c093e6309665c46d5a, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:05.347562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5c3c9-4955-4633-a0b2-aadf495ad3b0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:05.365810 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 970/1914] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:05 2022] PUT /identity/v3/projects/1a17ca648b904206a6fcd48d03d2b883/users/31598f99c88443c093e6309665c46d5a/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:05.366883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5c3c9-4955-4633-a0b2-aadf495ad3b0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:05.418666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b48bfb-b5b1-44fc-b77e-2acda258cac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:05.420466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b48bfb-b5b1-44fc-b77e-2acda258cac3 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:05.430456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 945/1915] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:05.431322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b48bfb-b5b1-44fc-b77e-2acda258cac3 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:05.443244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b48bfb-b5b1-44fc-b77e-2acda258cac3 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:05.445431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5c3c9-4955-4633-a0b2-aadf495ad3b0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:05.455030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d10ce-95cd-4656-9bb8-775d3de51b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:05.455266 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c95e4-7c2e-4e74-a91c-195b0c60797c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:05.455787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d10ce-95cd-4656-9bb8-775d3de51b83 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.455970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c95e4-7c2e-4e74-a91c-195b0c60797c admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.456078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d10ce-95cd-4656-9bb8-775d3de51b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.456252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c95e4-7c2e-4e74-a91c-195b0c60797c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.456529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c95e4-7c2e-4e74-a91c-195b0c60797c admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.456630 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d10ce-95cd-4656-9bb8-775d3de51b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.457777 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c95e4-7c2e-4e74-a91c-195b0c60797c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:05.457869 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d10ce-95cd-4656-9bb8-775d3de51b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:05.459072 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d10ce-95cd-4656-9bb8-775d3de51b83 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:05.459217 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c95e4-7c2e-4e74-a91c-195b0c60797c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:05.470867 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 971/1916] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:05.475705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d10ce-95cd-4656-9bb8-775d3de51b83 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:05.481098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eb6d10ce-95cd-4656-9bb8-775d3de51b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:05.493716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 946/1917] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:05 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:05.493716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c95e4-7c2e-4e74-a91c-195b0c60797c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:05.496613 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d10ce-95cd-4656-9bb8-775d3de51b83 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:05.571209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c95e4-7c2e-4e74-a91c-195b0c60797c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:05.572217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2b4ab-c204-494b-838a-0f4b0dc65e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:05.573251 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2b4ab-c204-494b-838a-0f4b0dc65e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.573571 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2b4ab-c204-494b-838a-0f4b0dc65e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.573885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2b4ab-c204-494b-838a-0f4b0dc65e57 admin admin] PATH_INFO: `/v3/users/2478d1c197744d58b267cd27980d1df9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.575225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2b4ab-c204-494b-838a-0f4b0dc65e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2478d1c197744d58b267cd27980d1df9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:05.577004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac6ffe-ad32-4114-8087-186462beaf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:05.577352 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2b4ab-c204-494b-838a-0f4b0dc65e57 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:05.577683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac6ffe-ad32-4114-8087-186462beaf7a admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.577968 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac6ffe-ad32-4114-8087-186462beaf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.578261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac6ffe-ad32-4114-8087-186462beaf7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.579011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac6ffe-ad32-4114-8087-186462beaf7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:05.580310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:05.581333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac6ffe-ad32-4114-8087-186462beaf7a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:05.598584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 947/1918] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:05.598584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac6ffe-ad32-4114-8087-186462beaf7a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:05.607471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac6ffe-ad32-4114-8087-186462beaf7a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:05.613170 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb9084-dac0-4c72-8c98-f293919c7e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:05.613815 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb9084-dac0-4c72-8c98-f293919c7e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.614097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb9084-dac0-4c72-8c98-f293919c7e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.614398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb9084-dac0-4c72-8c98-f293919c7e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.615185 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb9084-dac0-4c72-8c98-f293919c7e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:05.616852 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb9084-dac0-4c72-8c98-f293919c7e17 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:05.637620 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 948/1919] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:05.637620 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb9084-dac0-4c72-8c98-f293919c7e17 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:05.642630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb9084-dac0-4c72-8c98-f293919c7e17 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:05.647323 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36587f21-b812-4f74-8985-8159ce231344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:05.648033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36587f21-b812-4f74-8985-8159ce231344 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.648313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36587f21-b812-4f74-8985-8159ce231344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.648587 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36587f21-b812-4f74-8985-8159ce231344 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.648894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-70e2b4ab-c204-494b-838a-0f4b0dc65e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2478d1c197744d58b267cd27980d1df9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:05.649276 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36587f21-b812-4f74-8985-8159ce231344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:05.649563 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-70e2b4ab-c204-494b-838a-0f4b0dc65e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2478d1c197744d58b267cd27980d1df9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:05.650183 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-70e2b4ab-c204-494b-838a-0f4b0dc65e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2478d1c197744d58b267cd27980d1df9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:05.651207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36587f21-b812-4f74-8985-8159ce231344 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:05.663273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-70e2b4ab-c204-494b-838a-0f4b0dc65e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2478d1c197744d58b267cd27980d1df9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:05.669200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:05.673464 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-70e2b4ab-c204-494b-838a-0f4b0dc65e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2478d1c197744d58b267cd27980d1df9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:05.682086 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 949/1920] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:05 2022] POST /identity/v3/users => generated 287 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:05.682086 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36587f21-b812-4f74-8985-8159ce231344 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:05.682593 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-36587f21-b812-4f74-8985-8159ce231344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:05.696607 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36587f21-b812-4f74-8985-8159ce231344 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:05.697482 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 972/1921] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:05 2022] DELETE /identity/v3/users/2478d1c197744d58b267cd27980d1df9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:05.698169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2b4ab-c204-494b-838a-0f4b0dc65e57 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:05.699510 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-70e2b4ab-c204-494b-838a-0f4b0dc65e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:05.774808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac051f-18bc-4f59-b9b1-24c927001a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:05.775826 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac051f-18bc-4f59-b9b1-24c927001a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.776140 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac051f-18bc-4f59-b9b1-24c927001a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.776461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac051f-18bc-4f59-b9b1-24c927001a0d admin admin] PATH_INFO: `/v3/projects/1a17ca648b904206a6fcd48d03d2b883/users/31598f99c88443c093e6309665c46d5a/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.778864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac051f-18bc-4f59-b9b1-24c927001a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a17ca648b904206a6fcd48d03d2b883, user_id=31598f99c88443c093e6309665c46d5a, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:05.781550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac051f-18bc-4f59-b9b1-24c927001a0d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:05.789807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2b4ab-c204-494b-838a-0f4b0dc65e57 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:05.798277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 950/1922] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:05 2022] PUT /identity/v3/projects/1a17ca648b904206a6fcd48d03d2b883/users/31598f99c88443c093e6309665c46d5a/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:05.799160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac051f-18bc-4f59-b9b1-24c927001a0d admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:05.800843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-caac051f-18bc-4f59-b9b1-24c927001a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:05.876255 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e29f2c-5e12-4389-8ad0-6d3a0d7e71e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:05.880116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e29f2c-5e12-4389-8ad0-6d3a0d7e71e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.880116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e29f2c-5e12-4389-8ad0-6d3a0d7e71e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.880116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e29f2c-5e12-4389-8ad0-6d3a0d7e71e3 admin admin] PATH_INFO: `/v3/projects/d00386350b6e493f997561c2914a6806/users/fff39fc8b272458ea55d299a90d1f94b/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.898159 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e29f2c-5e12-4389-8ad0-6d3a0d7e71e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00386350b6e493f997561c2914a6806, user_id=fff39fc8b272458ea55d299a90d1f94b, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:05.901430 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e29f2c-5e12-4389-8ad0-6d3a0d7e71e3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:05.904015 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac051f-18bc-4f59-b9b1-24c927001a0d admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:05.911799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835717b-48db-4ac0-8615-876dff3917f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:05.912914 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835717b-48db-4ac0-8615-876dff3917f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.913851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835717b-48db-4ac0-8615-876dff3917f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.913851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835717b-48db-4ac0-8615-876dff3917f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.914196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835717b-48db-4ac0-8615-876dff3917f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:05.915824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835717b-48db-4ac0-8615-876dff3917f6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:05.932004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 951/1924] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:05.933387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5875a4-03b3-4c60-b7e4-9f45e1c4b3ec None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.933675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5875a4-03b3-4c60-b7e4-9f45e1c4b3ec None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.933946 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5875a4-03b3-4c60-b7e4-9f45e1c4b3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.943686 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 973/1924] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:05 2022] PUT /identity/v3/projects/d00386350b6e493f997561c2914a6806/users/fff39fc8b272458ea55d299a90d1f94b/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:05.945313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41c96d-2d84-4ef4-9045-a29691f5dc48 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.945603 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41c96d-2d84-4ef4-9045-a29691f5dc48 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.946198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41c96d-2d84-4ef4-9045-a29691f5dc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.953130 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-7c5875a4-03b3-4c60-b7e4-9f45e1c4b3ec None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:05.954375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7c5875a4-03b3-4c60-b7e4-9f45e1c4b3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:05.973008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:05.982651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4c41c96d-2d84-4ef4-9045-a29691f5dc48 None None] MFA Rules not processed for user `31598f99c88443c093e6309665c46d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:05.985051 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4c41c96d-2d84-4ef4-9045-a29691f5dc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:06.032300 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 952/1925] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:06.034010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5875a4-03b3-4c60-b7e4-9f45e1c4b3ec None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:06.058180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5875a4-03b3-4c60-b7e4-9f45e1c4b3ec None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:06.067509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d798250-ceca-4b5f-9784-fd2bda6e1826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:06.068288 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d798250-ceca-4b5f-9784-fd2bda6e1826 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:06.068524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d798250-ceca-4b5f-9784-fd2bda6e1826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:06.068942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d798250-ceca-4b5f-9784-fd2bda6e1826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:06.071078 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d798250-ceca-4b5f-9784-fd2bda6e1826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:06.073502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d798250-ceca-4b5f-9784-fd2bda6e1826 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:06.086936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 953/1926] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:06.088127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600bc41-4dcc-4c8c-b059-a9b3e19fa415 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:06.088412 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600bc41-4dcc-4c8c-b059-a9b3e19fa415 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:06.089060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600bc41-4dcc-4c8c-b059-a9b3e19fa415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:06.098741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 974/1927] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:05 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:06.104025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41c96d-2d84-4ef4-9045-a29691f5dc48 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:06.105690 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4c41c96d-2d84-4ef4-9045-a29691f5dc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:06.130481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6600bc41-4dcc-4c8c-b059-a9b3e19fa415 None None] MFA Rules not processed for user `fff39fc8b272458ea55d299a90d1f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:06.132070 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6600bc41-4dcc-4c8c-b059-a9b3e19fa415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:06.141679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:06.193614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41c96d-2d84-4ef4-9045-a29691f5dc48 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:06.197359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f32ae-52d7-4e75-be1b-5066f4818bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:06.198105 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f32ae-52d7-4e75-be1b-5066f4818bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:06.198461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f32ae-52d7-4e75-be1b-5066f4818bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:06.198808 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f32ae-52d7-4e75-be1b-5066f4818bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:06.209022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f32ae-52d7-4e75-be1b-5066f4818bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:06.210557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f32ae-52d7-4e75-be1b-5066f4818bb2 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:06.215403 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 954/1928] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:06.219830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600bc41-4dcc-4c8c-b059-a9b3e19fa415 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:06.221296 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 975/1929] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:06.222003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f32ae-52d7-4e75-be1b-5066f4818bb2 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:06.223364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f91f32ae-52d7-4e75-be1b-5066f4818bb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:06.232197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600bc41-4dcc-4c8c-b059-a9b3e19fa415 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:06.240403 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744f781-6801-4ca7-8644-d06b676557ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:06.241461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744f781-6801-4ca7-8644-d06b676557ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:06.241745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744f781-6801-4ca7-8644-d06b676557ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:06.242046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744f781-6801-4ca7-8644-d06b676557ad admin admin] PATH_INFO: `/v3/projects/ce0780dc9849461fa06a33d1d164f17b/users/4dd69bb00903432898d0867da99d664a/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:06.259282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744f781-6801-4ca7-8644-d06b676557ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0780dc9849461fa06a33d1d164f17b, user_id=4dd69bb00903432898d0867da99d664a, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:06.262394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744f781-6801-4ca7-8644-d06b676557ad admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:06.281769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 955/1930] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:06 2022] PUT /identity/v3/projects/ce0780dc9849461fa06a33d1d164f17b/users/4dd69bb00903432898d0867da99d664a/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:06.281769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744f781-6801-4ca7-8644-d06b676557ad admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:06.319962 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f32ae-52d7-4e75-be1b-5066f4818bb2 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:06.365879 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744f781-6801-4ca7-8644-d06b676557ad admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:06.375083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ff891-1fd8-498e-be0a-688588ee3ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:06.375824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ff891-1fd8-498e-be0a-688588ee3ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:06.376154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ff891-1fd8-498e-be0a-688588ee3ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:06.376438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ff891-1fd8-498e-be0a-688588ee3ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:06.377603 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ff891-1fd8-498e-be0a-688588ee3ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:06.389227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ff891-1fd8-498e-be0a-688588ee3ed0 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:06.390534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d836fcc-f125-4c05-813a-9d070f1e3cfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:06.391324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d836fcc-f125-4c05-813a-9d070f1e3cfb service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:06.391710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d836fcc-f125-4c05-813a-9d070f1e3cfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:06.392058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d836fcc-f125-4c05-813a-9d070f1e3cfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:06.401455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:06.423070 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 956/1931] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:06 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:06.424965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c757ce1-a17a-4507-9155-f9bc9f0a2fb7 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:06.425255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c757ce1-a17a-4507-9155-f9bc9f0a2fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:06.426300 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c757ce1-a17a-4507-9155-f9bc9f0a2fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:06.470756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2c757ce1-a17a-4507-9155-f9bc9f0a2fb7 None None] MFA Rules not processed for user `4dd69bb00903432898d0867da99d664a`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:06.472253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2c757ce1-a17a-4507-9155-f9bc9f0a2fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:06.479527 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d836fcc-f125-4c05-813a-9d070f1e3cfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:06.481031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d836fcc-f125-4c05-813a-9d070f1e3cfb service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:06.493232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 976/1932] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:06 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:06.494082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d836fcc-f125-4c05-813a-9d070f1e3cfb service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:06.509993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d836fcc-f125-4c05-813a-9d070f1e3cfb service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:06.582978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:06.591636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 957/1933] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:06.596234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c757ce1-a17a-4507-9155-f9bc9f0a2fb7 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:06.637692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf13fd1-b677-4d91-a00e-d0ba3424bde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:06.638860 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf13fd1-b677-4d91-a00e-d0ba3424bde1 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:06.639108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf13fd1-b677-4d91-a00e-d0ba3424bde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:06.639447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf13fd1-b677-4d91-a00e-d0ba3424bde1 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:06.640233 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf13fd1-b677-4d91-a00e-d0ba3424bde1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:06.642223 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf13fd1-b677-4d91-a00e-d0ba3424bde1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:06.670669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 977/1934] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:06 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:06.671771 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf13fd1-b677-4d91-a00e-d0ba3424bde1 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:06.673411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0cf13fd1-b677-4d91-a00e-d0ba3424bde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:06.688598 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf13fd1-b677-4d91-a00e-d0ba3424bde1 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:06.692654 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c757ce1-a17a-4507-9155-f9bc9f0a2fb7 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:06.700121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:06.701174 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:06.701660 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:06.701861 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd13b4-5eb4-4979-bd09-28d36d0c8135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:06.702031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319 admin admin] PATH_INFO: `/v3/projects/f33ad73ca971454fa0a41fa8e645c79c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:06.702546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd13b4-5eb4-4979-bd09-28d36d0c8135 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:06.702849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd13b4-5eb4-4979-bd09-28d36d0c8135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:06.703165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd13b4-5eb4-4979-bd09-28d36d0c8135 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:06.703450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33ad73ca971454fa0a41fa8e645c79c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:06.704057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd13b4-5eb4-4979-bd09-28d36d0c8135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:06.706455 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd13b4-5eb4-4979-bd09-28d36d0c8135 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:06.706572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:06.737431 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 958/1935] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:06 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:06.738123 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd13b4-5eb4-4979-bd09-28d36d0c8135 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:06.767178 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33ad73ca971454fa0a41fa8e645c79c', 'request_id': 'req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:06.775994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33ad73ca971454fa0a41fa8e645c79c', 'request_id': 'req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:06.782887 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33ad73ca971454fa0a41fa8e645c79c', 'request_id': 'req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:06.795680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319 admin admin] The token cache is being invalidate because project f33ad73ca971454fa0a41fa8e645c79c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:06.796058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:06.796627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:06.798900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 978/1936] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:06 2022] DELETE /identity/v3/projects/f33ad73ca971454fa0a41fa8e645c79c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:06.799738 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:06.801108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:06.813040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd13b4-5eb4-4979-bd09-28d36d0c8135 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:06.822976 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:06.878653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbaccb8-a8d0-445e-9123-f5dfdb89e319 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:06.883673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3c608-a6d0-4f99-9c52-328f30bd0c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:06.884364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3c608-a6d0-4f99-9c52-328f30bd0c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:06.884643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3c608-a6d0-4f99-9c52-328f30bd0c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:06.884916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3c608-a6d0-4f99-9c52-328f30bd0c9c admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:06.885619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3c608-a6d0-4f99-9c52-328f30bd0c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:06.887585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3c608-a6d0-4f99-9c52-328f30bd0c9c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:06.899806 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5db88-3c5b-4786-8e14-0289b6f10283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:06.900682 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5db88-3c5b-4786-8e14-0289b6f10283 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:06.901138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5db88-3c5b-4786-8e14-0289b6f10283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:06.901384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5db88-3c5b-4786-8e14-0289b6f10283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:06.902175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5db88-3c5b-4786-8e14-0289b6f10283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:06.904190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5db88-3c5b-4786-8e14-0289b6f10283 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:06.912414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 979/1937] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:06 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:06.912414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3c608-a6d0-4f99-9c52-328f30bd0c9c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:06.914633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c2a3c608-a6d0-4f99-9c52-328f30bd0c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:06.919813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 959/1938] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:06.919813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5db88-3c5b-4786-8e14-0289b6f10283 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:06.922382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-17c5db88-3c5b-4786-8e14-0289b6f10283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:06.936128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5db88-3c5b-4786-8e14-0289b6f10283 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:06.940817 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e54949-d023-4bac-9549-4117c4406e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:06.941830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e54949-d023-4bac-9549-4117c4406e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:06.942118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e54949-d023-4bac-9549-4117c4406e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:06.942398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e54949-d023-4bac-9549-4117c4406e76 admin admin] PATH_INFO: `/v3/users/b86fe28a6e17455998bafad8da62b8a0` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:06.943645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e54949-d023-4bac-9549-4117c4406e76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86fe28a6e17455998bafad8da62b8a0)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:06.945610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e54949-d023-4bac-9549-4117c4406e76 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:06.980877 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:06.987171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3c608-a6d0-4f99-9c52-328f30bd0c9c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:06.991413 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebdd55-9cb4-49b4-af28-cde62ba39ee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:06.992628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebdd55-9cb4-49b4-af28-cde62ba39ee7 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:06.992941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebdd55-9cb4-49b4-af28-cde62ba39ee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:06.993186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebdd55-9cb4-49b4-af28-cde62ba39ee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:06.995122 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-35ebdd55-9cb4-49b4-af28-cde62ba39ee7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:07.025713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-97e54949-d023-4bac-9549-4117c4406e76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86fe28a6e17455998bafad8da62b8a0'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:07.041558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-97e54949-d023-4bac-9549-4117c4406e76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86fe28a6e17455998bafad8da62b8a0'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:07.042394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-97e54949-d023-4bac-9549-4117c4406e76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86fe28a6e17455998bafad8da62b8a0'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:07.043036 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-97e54949-d023-4bac-9549-4117c4406e76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86fe28a6e17455998bafad8da62b8a0'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:07.052023 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-97e54949-d023-4bac-9549-4117c4406e76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86fe28a6e17455998bafad8da62b8a0'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:07.088340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 960/1939] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:06 2022] DELETE /identity/v3/users/b86fe28a6e17455998bafad8da62b8a0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:07.088340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e54949-d023-4bac-9549-4117c4406e76 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:07.102644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-97e54949-d023-4bac-9549-4117c4406e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:07.114492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebdd55-9cb4-49b4-af28-cde62ba39ee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:07.117069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebdd55-9cb4-49b4-af28-cde62ba39ee7 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:07.132209 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 980/1940] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:07.133528 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebdd55-9cb4-49b4-af28-cde62ba39ee7 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:07.136175 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-35ebdd55-9cb4-49b4-af28-cde62ba39ee7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:07.163641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebdd55-9cb4-49b4-af28-cde62ba39ee7 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:07.228536 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e54949-d023-4bac-9549-4117c4406e76 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:07.235362 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d544b-ec34-429d-acda-22bffab5916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:07.237937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d544b-ec34-429d-acda-22bffab5916b admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.237937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d544b-ec34-429d-acda-22bffab5916b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.237937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d544b-ec34-429d-acda-22bffab5916b admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.238527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d544b-ec34-429d-acda-22bffab5916b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:07.240873 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d544b-ec34-429d-acda-22bffab5916b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:07.246987 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de705cd-389b-4d6c-bb3a-68d8c54f49a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:07.248422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de705cd-389b-4d6c-bb3a-68d8c54f49a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.248890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de705cd-389b-4d6c-bb3a-68d8c54f49a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.249358 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de705cd-389b-4d6c-bb3a-68d8c54f49a9 admin admin] PATH_INFO: `/v3/projects/bc67de00bbb64f98b193e3e78798c232/users/c6f8110fb4ee404c9d84416041bce4f6/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.254768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:07.262082 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 961/1941] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:07.268072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d544b-ec34-429d-acda-22bffab5916b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:07.283222 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d544b-ec34-429d-acda-22bffab5916b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:07.284304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de705cd-389b-4d6c-bb3a-68d8c54f49a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc67de00bbb64f98b193e3e78798c232, user_id=c6f8110fb4ee404c9d84416041bce4f6, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:07.288614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de705cd-389b-4d6c-bb3a-68d8c54f49a9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:07.290076 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6732bf3-730d-4e82-8111-9caaedd40c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:07.291293 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6732bf3-730d-4e82-8111-9caaedd40c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.291659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6732bf3-730d-4e82-8111-9caaedd40c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.292001 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6732bf3-730d-4e82-8111-9caaedd40c0e admin admin] PATH_INFO: `/v3/projects/4d5c16ed1483476780f9ed372ff41ffb/users/103cdb5625a0438cbd51920cfaf8116a/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.311945 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6732bf3-730d-4e82-8111-9caaedd40c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5c16ed1483476780f9ed372ff41ffb, user_id=103cdb5625a0438cbd51920cfaf8116a, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:07.312768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 981/1942] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:07 2022] PUT /identity/v3/projects/bc67de00bbb64f98b193e3e78798c232/users/c6f8110fb4ee404c9d84416041bce4f6/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:07.317565 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de705cd-389b-4d6c-bb3a-68d8c54f49a9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:07.317829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6732bf3-730d-4e82-8111-9caaedd40c0e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:07.320033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6de705cd-389b-4d6c-bb3a-68d8c54f49a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:07.339360 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 962/1943] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:07 2022] PUT /identity/v3/projects/4d5c16ed1483476780f9ed372ff41ffb/users/103cdb5625a0438cbd51920cfaf8116a/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:07.343506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6732bf3-730d-4e82-8111-9caaedd40c0e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:07.465221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6732bf3-730d-4e82-8111-9caaedd40c0e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:07.481334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e23181-ca07-44c4-94bd-130b676c6fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:07.482173 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e23181-ca07-44c4-94bd-130b676c6fec admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.484194 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e23181-ca07-44c4-94bd-130b676c6fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.484488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e23181-ca07-44c4-94bd-130b676c6fec admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.485690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e23181-ca07-44c4-94bd-130b676c6fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:07.490096 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e23181-ca07-44c4-94bd-130b676c6fec admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:07.496156 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de705cd-389b-4d6c-bb3a-68d8c54f49a9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:07.508663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 963/1944] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:31:07.512547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e23181-ca07-44c4-94bd-130b676c6fec admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:07.516260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94f96a-0019-4c6b-a947-8435d766de64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:07.517101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94f96a-0019-4c6b-a947-8435d766de64 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.517416 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94f96a-0019-4c6b-a947-8435d766de64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.517642 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94f96a-0019-4c6b-a947-8435d766de64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.519120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94f96a-0019-4c6b-a947-8435d766de64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:07.521251 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94f96a-0019-4c6b-a947-8435d766de64 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:07.530246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e23181-ca07-44c4-94bd-130b676c6fec admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:07.535637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 982/1945] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:07.536013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41720b23-622f-4aed-8b6d-430c77d5a944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:07.537442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41720b23-622f-4aed-8b6d-430c77d5a944 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.538368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41720b23-622f-4aed-8b6d-430c77d5a944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.538488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41720b23-622f-4aed-8b6d-430c77d5a944 admin admin] PATH_INFO: `/v3/projects/4d5c16ed1483476780f9ed372ff41ffb/users/103cdb5625a0438cbd51920cfaf8116a/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.540386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94f96a-0019-4c6b-a947-8435d766de64 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:07.545790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41720b23-622f-4aed-8b6d-430c77d5a944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5c16ed1483476780f9ed372ff41ffb, user_id=103cdb5625a0438cbd51920cfaf8116a, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:07.550757 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41720b23-622f-4aed-8b6d-430c77d5a944 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:07.554317 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:07.557183 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94f96a-0019-4c6b-a947-8435d766de64 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:07.578760 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39368e1d-e05f-4044-9659-d210923f1e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:07.578760 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39368e1d-e05f-4044-9659-d210923f1e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.578760 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39368e1d-e05f-4044-9659-d210923f1e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.578760 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39368e1d-e05f-4044-9659-d210923f1e3b admin admin] PATH_INFO: `/v3/projects/bc67de00bbb64f98b193e3e78798c232/users/c6f8110fb4ee404c9d84416041bce4f6/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.579072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 964/1946] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:07 2022] PUT /identity/v3/projects/4d5c16ed1483476780f9ed372ff41ffb/users/103cdb5625a0438cbd51920cfaf8116a/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:31:07.579149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39368e1d-e05f-4044-9659-d210923f1e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc67de00bbb64f98b193e3e78798c232, user_id=c6f8110fb4ee404c9d84416041bce4f6, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:07.579149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39368e1d-e05f-4044-9659-d210923f1e3b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:07.593663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496c640-5a41-4269-a26a-2c549e75d74b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.594009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496c640-5a41-4269-a26a-2c549e75d74b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.603678 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496c640-5a41-4269-a26a-2c549e75d74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.604203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 983/1947] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:07 2022] PUT /identity/v3/projects/bc67de00bbb64f98b193e3e78798c232/users/c6f8110fb4ee404c9d84416041bce4f6/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:31:07.605741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5700e4-b6ba-49e2-8766-a05cc365a462 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.606036 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5700e4-b6ba-49e2-8766-a05cc365a462 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.606319 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5700e4-b6ba-49e2-8766-a05cc365a462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.649433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fb5700e4-b6ba-49e2-8766-a05cc365a462 None None] MFA Rules not processed for user `c6f8110fb4ee404c9d84416041bce4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:07.650711 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fb5700e4-b6ba-49e2-8766-a05cc365a462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:07.657056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-7496c640-5a41-4269-a26a-2c549e75d74b None None] MFA Rules not processed for user `103cdb5625a0438cbd51920cfaf8116a`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:07.658333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7496c640-5a41-4269-a26a-2c549e75d74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:07.754138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 984/1948] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:07.755317 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5700e4-b6ba-49e2-8766-a05cc365a462 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:07.756352 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fb5700e4-b6ba-49e2-8766-a05cc365a462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:07.766687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 965/1949] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:07.767741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496c640-5a41-4269-a26a-2c549e75d74b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:07.776540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7496c640-5a41-4269-a26a-2c549e75d74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:07.816967 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:07.832664 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5700e4-b6ba-49e2-8766-a05cc365a462 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:07.837209 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a8ba2-4674-41e1-9ce0-b835aa0c5a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:07.838085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a8ba2-4674-41e1-9ce0-b835aa0c5a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.838393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a8ba2-4674-41e1-9ce0-b835aa0c5a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.838511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496c640-5a41-4269-a26a-2c549e75d74b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:07.838666 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a8ba2-4674-41e1-9ce0-b835aa0c5a4c admin admin] PATH_INFO: `/v3/projects/f4f2f7d17d6149149403f3536f73d607` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.839946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a8ba2-4674-41e1-9ce0-b835aa0c5a4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f2f7d17d6149149403f3536f73d607)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:07.841949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a8ba2-4674-41e1-9ce0-b835aa0c5a4c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:07.842274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c775c51-6861-42b5-a51c-13376b2d8906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:07.842980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c775c51-6861-42b5-a51c-13376b2d8906 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.843272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c775c51-6861-42b5-a51c-13376b2d8906 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.843550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c775c51-6861-42b5-a51c-13376b2d8906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.852853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c775c51-6861-42b5-a51c-13376b2d8906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:07.854300 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c775c51-6861-42b5-a51c-13376b2d8906 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:07.864781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 966/1950] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:07.865651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c775c51-6861-42b5-a51c-13376b2d8906 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:07.867021 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3c775c51-6861-42b5-a51c-13376b2d8906 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:07.879252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c775c51-6861-42b5-a51c-13376b2d8906 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:07.883963 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c808c8-dc3d-4629-b4cf-ff33a25c6e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:07.884612 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c808c8-dc3d-4629-b4cf-ff33a25c6e1c service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.884994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c808c8-dc3d-4629-b4cf-ff33a25c6e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.885584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c808c8-dc3d-4629-b4cf-ff33a25c6e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.900567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4d4a8ba2-4674-41e1-9ce0-b835aa0c5a4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f2f7d17d6149149403f3536f73d607', 'request_id': 'req-4d4a8ba2-4674-41e1-9ce0-b835aa0c5a4c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:07.901043 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c808c8-dc3d-4629-b4cf-ff33a25c6e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:07.902507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c808c8-dc3d-4629-b4cf-ff33a25c6e1c service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:07.910869 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4d4a8ba2-4674-41e1-9ce0-b835aa0c5a4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f2f7d17d6149149403f3536f73d607', 'request_id': 'req-4d4a8ba2-4674-41e1-9ce0-b835aa0c5a4c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:07.918276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4d4a8ba2-4674-41e1-9ce0-b835aa0c5a4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f2f7d17d6149149403f3536f73d607', 'request_id': 'req-4d4a8ba2-4674-41e1-9ce0-b835aa0c5a4c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:07.919741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 967/1951] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:07.920357 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c808c8-dc3d-4629-b4cf-ff33a25c6e1c service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:07.933264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c808c8-dc3d-4629-b4cf-ff33a25c6e1c service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:07.942968 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4d4a8ba2-4674-41e1-9ce0-b835aa0c5a4c admin admin] The token cache is being invalidate because project f4f2f7d17d6149149403f3536f73d607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:07.943353 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4d4a8ba2-4674-41e1-9ce0-b835aa0c5a4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:07.944680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4d4a8ba2-4674-41e1-9ce0-b835aa0c5a4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:07.952566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 985/1952] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:07 2022] DELETE /identity/v3/projects/f4f2f7d17d6149149403f3536f73d607 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:07.954983 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb827-964f-4ecd-8bfd-0ce9e57f6038 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.955292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb827-964f-4ecd-8bfd-0ce9e57f6038 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.955557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb827-964f-4ecd-8bfd-0ce9e57f6038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.986267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-01fcb827-964f-4ecd-8bfd-0ce9e57f6038 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:07.988833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-01fcb827-964f-4ecd-8bfd-0ce9e57f6038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:08.039146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc259f-ce38-4dca-950a-4bb197a5d092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.040842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc259f-ce38-4dca-950a-4bb197a5d092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.041389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc259f-ce38-4dca-950a-4bb197a5d092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.041951 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc259f-ce38-4dca-950a-4bb197a5d092 admin admin] PATH_INFO: `/v3/users/fff39fc8b272458ea55d299a90d1f94b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.043801 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc259f-ce38-4dca-950a-4bb197a5d092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fff39fc8b272458ea55d299a90d1f94b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:08.046243 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc259f-ce38-4dca-950a-4bb197a5d092 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:08.061959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:08.080699 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 986/1953] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:31:08.090419 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7c404-cce0-42ed-9415-f1a37c71562d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.090741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7c404-cce0-42ed-9415-f1a37c71562d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.091152 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7c404-cce0-42ed-9415-f1a37c71562d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.125952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-50dc259f-ce38-4dca-950a-4bb197a5d092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fff39fc8b272458ea55d299a90d1f94b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:08.128424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-72b7c404-cce0-42ed-9415-f1a37c71562d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:08.129962 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-72b7c404-cce0-42ed-9415-f1a37c71562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:08.146166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 987/1954] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:08.150917 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7c404-cce0-42ed-9415-f1a37c71562d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:08.151267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-50dc259f-ce38-4dca-950a-4bb197a5d092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fff39fc8b272458ea55d299a90d1f94b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:08.152488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-50dc259f-ce38-4dca-950a-4bb197a5d092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fff39fc8b272458ea55d299a90d1f94b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:08.157069 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-50dc259f-ce38-4dca-950a-4bb197a5d092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fff39fc8b272458ea55d299a90d1f94b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:08.161137 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7c404-cce0-42ed-9415-f1a37c71562d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:08.166958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-50dc259f-ce38-4dca-950a-4bb197a5d092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fff39fc8b272458ea55d299a90d1f94b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:08.170371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e2ec3-b58e-4d56-bd9f-b7198f9dbec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.171360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e2ec3-b58e-4d56-bd9f-b7198f9dbec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.172094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e2ec3-b58e-4d56-bd9f-b7198f9dbec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.172586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e2ec3-b58e-4d56-bd9f-b7198f9dbec4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.173859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e2ec3-b58e-4d56-bd9f-b7198f9dbec4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:08.175346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e2ec3-b58e-4d56-bd9f-b7198f9dbec4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:08.177278 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e2ec3-b58e-4d56-bd9f-b7198f9dbec4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:08.188630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 968/1955] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:07 2022] DELETE /identity/v3/users/fff39fc8b272458ea55d299a90d1f94b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:08.193258 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd9770-d580-45c1-8ec8-9c1a1770568c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.193620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 988/1956] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:08.194007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd9770-d580-45c1-8ec8-9c1a1770568c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.194368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd9770-d580-45c1-8ec8-9c1a1770568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.197378 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e2ec3-b58e-4d56-bd9f-b7198f9dbec4 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:08.201710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d85e2ec3-b58e-4d56-bd9f-b7198f9dbec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:08.220638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e2ec3-b58e-4d56-bd9f-b7198f9dbec4 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:08.222746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-91cd9770-d580-45c1-8ec8-9c1a1770568c None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:08.224198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-91cd9770-d580-45c1-8ec8-9c1a1770568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:08.327474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447237e-da1d-4826-b88d-47b97f3fd7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.328477 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447237e-da1d-4826-b88d-47b97f3fd7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.329056 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447237e-da1d-4826-b88d-47b97f3fd7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.329761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447237e-da1d-4826-b88d-47b97f3fd7e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.331330 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447237e-da1d-4826-b88d-47b97f3fd7e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:08.333541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447237e-da1d-4826-b88d-47b97f3fd7e3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:08.340267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 969/1957] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:08.349352 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:08.351104 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd9770-d580-45c1-8ec8-9c1a1770568c None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:08.355641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-91cd9770-d580-45c1-8ec8-9c1a1770568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:08.392708 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 989/1958] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:08 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:08.393293 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447237e-da1d-4826-b88d-47b97f3fd7e3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:08.507817 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd9770-d580-45c1-8ec8-9c1a1770568c None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:08.564911 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447237e-da1d-4826-b88d-47b97f3fd7e3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:08.570581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7742e-8541-4b68-9847-a82649bf9690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.571367 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7742e-8541-4b68-9847-a82649bf9690 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.571881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7742e-8541-4b68-9847-a82649bf9690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.572228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7742e-8541-4b68-9847-a82649bf9690 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.573003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7742e-8541-4b68-9847-a82649bf9690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:08.575043 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7742e-8541-4b68-9847-a82649bf9690 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:08.607707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:08.610285 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 990/1959] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:08 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:31:08.611217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7742e-8541-4b68-9847-a82649bf9690 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:08.625080 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-08f7742e-8541-4b68-9847-a82649bf9690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:08.634659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f54f62-d137-42ae-9599-3f2baface976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.636323 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f54f62-d137-42ae-9599-3f2baface976 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.637590 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f54f62-d137-42ae-9599-3f2baface976 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.638600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f54f62-d137-42ae-9599-3f2baface976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.644479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7742e-8541-4b68-9847-a82649bf9690 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:08.655758 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f54f62-d137-42ae-9599-3f2baface976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:08.656539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a77a63-db11-4d54-b4e9-fc161f486497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.657581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a77a63-db11-4d54-b4e9-fc161f486497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.658038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a77a63-db11-4d54-b4e9-fc161f486497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.658289 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a77a63-db11-4d54-b4e9-fc161f486497 admin admin] PATH_INFO: `/v3/users/4dd69bb00903432898d0867da99d664a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.658858 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f54f62-d137-42ae-9599-3f2baface976 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:08.660003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a77a63-db11-4d54-b4e9-fc161f486497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd69bb00903432898d0867da99d664a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:08.662346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a77a63-db11-4d54-b4e9-fc161f486497 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:08.673107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 970/1960] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:31:08.674312 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f54f62-d137-42ae-9599-3f2baface976 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:08.686076 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f54f62-d137-42ae-9599-3f2baface976 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:08.692990 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918a4fa-edf6-4085-bcdf-b499542874a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.693984 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918a4fa-edf6-4085-bcdf-b499542874a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.694333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918a4fa-edf6-4085-bcdf-b499542874a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.694674 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918a4fa-edf6-4085-bcdf-b499542874a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.701141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918a4fa-edf6-4085-bcdf-b499542874a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:08.702850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918a4fa-edf6-4085-bcdf-b499542874a6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:08.715132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 971/1961] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:08.727955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918a4fa-edf6-4085-bcdf-b499542874a6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:08.748543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918a4fa-edf6-4085-bcdf-b499542874a6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:08.752781 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b5a77a63-db11-4d54-b4e9-fc161f486497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd69bb00903432898d0867da99d664a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:08.753536 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b5a77a63-db11-4d54-b4e9-fc161f486497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd69bb00903432898d0867da99d664a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:08.753846 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6012c-a9dc-4366-90e7-fe0efe5cba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.754444 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b5a77a63-db11-4d54-b4e9-fc161f486497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd69bb00903432898d0867da99d664a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:08.754553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6012c-a9dc-4366-90e7-fe0efe5cba58 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.754798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6012c-a9dc-4366-90e7-fe0efe5cba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.755074 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6012c-a9dc-4366-90e7-fe0efe5cba58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.755987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6012c-a9dc-4366-90e7-fe0efe5cba58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:08.762611 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b5a77a63-db11-4d54-b4e9-fc161f486497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd69bb00903432898d0867da99d664a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:08.763217 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6012c-a9dc-4366-90e7-fe0efe5cba58 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:08.775069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b5a77a63-db11-4d54-b4e9-fc161f486497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd69bb00903432898d0867da99d664a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:08.775268 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 972/1962] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:08.780198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6012c-a9dc-4366-90e7-fe0efe5cba58 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:08.783507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e7d6012c-a9dc-4366-90e7-fe0efe5cba58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:08.807282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 991/1963] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:08 2022] DELETE /identity/v3/users/4dd69bb00903432898d0867da99d664a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:08.812608 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6012c-a9dc-4366-90e7-fe0efe5cba58 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:08.812777 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37fea7-364e-4ad1-8fa2-97648b232cea None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.813308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37fea7-364e-4ad1-8fa2-97648b232cea None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.813616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37fea7-364e-4ad1-8fa2-97648b232cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.845542 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1c37fea7-364e-4ad1-8fa2-97648b232cea None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:08.847116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1c37fea7-364e-4ad1-8fa2-97648b232cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:08.979120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f0950-5406-45b8-b3d6-807abb180a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.980238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f0950-5406-45b8-b3d6-807abb180a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.980491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f0950-5406-45b8-b3d6-807abb180a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.980789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f0950-5406-45b8-b3d6-807abb180a29 admin admin] PATH_INFO: `/v3/projects/f152eebe307d4c5fb353b1c36efd01d3/users/231f5029bdbf450f84ed68713af49906/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.994916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:09.047694 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 992/1964] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:09.050326 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f0950-5406-45b8-b3d6-807abb180a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f152eebe307d4c5fb353b1c36efd01d3, user_id=231f5029bdbf450f84ed68713af49906, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:09.055045 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f0950-5406-45b8-b3d6-807abb180a29 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:09.058137 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37fea7-364e-4ad1-8fa2-97648b232cea None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:09.059902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1c37fea7-364e-4ad1-8fa2-97648b232cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:09.106004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 973/1965] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:08 2022] PUT /identity/v3/projects/f152eebe307d4c5fb353b1c36efd01d3/users/231f5029bdbf450f84ed68713af49906/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:09.117911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb5f2e-c568-4223-8145-1bf49cbc4517 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:09.118337 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb5f2e-c568-4223-8145-1bf49cbc4517 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:09.118520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb5f2e-c568-4223-8145-1bf49cbc4517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:09.158143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0dfb5f2e-c568-4223-8145-1bf49cbc4517 None None] MFA Rules not processed for user `231f5029bdbf450f84ed68713af49906`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:09.159768 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0dfb5f2e-c568-4223-8145-1bf49cbc4517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:09.228630 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37fea7-364e-4ad1-8fa2-97648b232cea None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:09.285680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 974/1966] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:09.291465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb5f2e-c568-4223-8145-1bf49cbc4517 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:09.359282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ef300-ad63-4d8b-9f5e-5716bc4d1e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:09.359996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ef300-ad63-4d8b-9f5e-5716bc4d1e89 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:09.360285 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ef300-ad63-4d8b-9f5e-5716bc4d1e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:09.360659 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ef300-ad63-4d8b-9f5e-5716bc4d1e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:09.409769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:09.465264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb5f2e-c568-4223-8145-1bf49cbc4517 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:09.476109 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04dd60f-3e65-4b14-9618-817e117bf9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:09.476925 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dd60f-3e65-4b14-9618-817e117bf9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:09.477456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dd60f-3e65-4b14-9618-817e117bf9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:09.477819 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dd60f-3e65-4b14-9618-817e117bf9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:09.479084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04dd60f-3e65-4b14-9618-817e117bf9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:09.481776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04dd60f-3e65-4b14-9618-817e117bf9f3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:09.507040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ef300-ad63-4d8b-9f5e-5716bc4d1e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:09.508845 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ef300-ad63-4d8b-9f5e-5716bc4d1e89 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:09.521690 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 993/1967] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:31:09.532176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 975/1968] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:09 2022] POST /identity/v3/projects => generated 377 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:09.532340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ef300-ad63-4d8b-9f5e-5716bc4d1e89 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:09.533096 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04dd60f-3e65-4b14-9618-817e117bf9f3 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:09.538643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-427ef300-ad63-4d8b-9f5e-5716bc4d1e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:09.553471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ef300-ad63-4d8b-9f5e-5716bc4d1e89 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:09.644172 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04dd60f-3e65-4b14-9618-817e117bf9f3 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:09.650819 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c5a21-1294-461f-9d65-b1c0374d6252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:09.651618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c5a21-1294-461f-9d65-b1c0374d6252 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:09.651978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c5a21-1294-461f-9d65-b1c0374d6252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:09.652323 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c5a21-1294-461f-9d65-b1c0374d6252 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:09.653314 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c5a21-1294-461f-9d65-b1c0374d6252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:09.656181 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c5a21-1294-461f-9d65-b1c0374d6252 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:09.661266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:09.673429 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b183d53-1457-4b21-9b9e-b4af4daf10b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:09.674575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b183d53-1457-4b21-9b9e-b4af4daf10b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:09.674750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b183d53-1457-4b21-9b9e-b4af4daf10b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:09.674987 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b183d53-1457-4b21-9b9e-b4af4daf10b0 admin admin] PATH_INFO: `/v3/projects/d00386350b6e493f997561c2914a6806` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:09.676970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b183d53-1457-4b21-9b9e-b4af4daf10b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00386350b6e493f997561c2914a6806)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:09.689102 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b183d53-1457-4b21-9b9e-b4af4daf10b0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:09.708574 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 976/1969] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:09 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:09.713382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c5a21-1294-461f-9d65-b1c0374d6252 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:09.733962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c5a21-1294-461f-9d65-b1c0374d6252 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:09.739407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f204906-aa5a-4586-acb8-3f6c324c956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:09.740376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f204906-aa5a-4586-acb8-3f6c324c956c admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:09.740844 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f204906-aa5a-4586-acb8-3f6c324c956c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:09.741281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f204906-aa5a-4586-acb8-3f6c324c956c admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:09.743116 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f204906-aa5a-4586-acb8-3f6c324c956c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:09.745062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f204906-aa5a-4586-acb8-3f6c324c956c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:09.780432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7b183d53-1457-4b21-9b9e-b4af4daf10b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00386350b6e493f997561c2914a6806', 'request_id': 'req-7b183d53-1457-4b21-9b9e-b4af4daf10b0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:09.782300 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 977/1970] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:09.785678 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f204906-aa5a-4586-acb8-3f6c324c956c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:09.802417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7b183d53-1457-4b21-9b9e-b4af4daf10b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00386350b6e493f997561c2914a6806', 'request_id': 'req-7b183d53-1457-4b21-9b9e-b4af4daf10b0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:09.804096 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f204906-aa5a-4586-acb8-3f6c324c956c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:09.821090 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7b183d53-1457-4b21-9b9e-b4af4daf10b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00386350b6e493f997561c2914a6806', 'request_id': 'req-7b183d53-1457-4b21-9b9e-b4af4daf10b0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:09.849270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7b183d53-1457-4b21-9b9e-b4af4daf10b0 admin admin] The token cache is being invalidate because project d00386350b6e493f997561c2914a6806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:09.855200 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7b183d53-1457-4b21-9b9e-b4af4daf10b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:09.856459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7b183d53-1457-4b21-9b9e-b4af4daf10b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:09.861533 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 994/1971] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:09 2022] DELETE /identity/v3/projects/d00386350b6e493f997561c2914a6806 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:31:09.869699 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b183d53-1457-4b21-9b9e-b4af4daf10b0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:09.869699 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7b183d53-1457-4b21-9b9e-b4af4daf10b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:09.934802 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19e455-4b0f-4126-b55e-34e0eba2c462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:09.936027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19e455-4b0f-4126-b55e-34e0eba2c462 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:09.936396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19e455-4b0f-4126-b55e-34e0eba2c462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:09.936740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19e455-4b0f-4126-b55e-34e0eba2c462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:09.938049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19e455-4b0f-4126-b55e-34e0eba2c462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:09.940456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19e455-4b0f-4126-b55e-34e0eba2c462 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:09.968708 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 978/1972] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:09.973353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19e455-4b0f-4126-b55e-34e0eba2c462 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:09.975741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6e19e455-4b0f-4126-b55e-34e0eba2c462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:09.997193 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b183d53-1457-4b21-9b9e-b4af4daf10b0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:10.005088 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19e455-4b0f-4126-b55e-34e0eba2c462 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:10.007571 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc664438-a52a-43e7-81db-1b911d84014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:10.008917 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc664438-a52a-43e7-81db-1b911d84014b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:10.009310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc664438-a52a-43e7-81db-1b911d84014b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:10.009620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc664438-a52a-43e7-81db-1b911d84014b admin admin] PATH_INFO: `/v3/users/c6f8110fb4ee404c9d84416041bce4f6` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:10.010944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc664438-a52a-43e7-81db-1b911d84014b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6f8110fb4ee404c9d84416041bce4f6)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:10.011588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6d010-4bc6-4cd7-b37e-1b7417ecfa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:10.013604 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc664438-a52a-43e7-81db-1b911d84014b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:10.017275 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6d010-4bc6-4cd7-b37e-1b7417ecfa20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:10.017449 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6d010-4bc6-4cd7-b37e-1b7417ecfa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:10.020175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6d010-4bc6-4cd7-b37e-1b7417ecfa20 admin admin] PATH_INFO: `/v3/projects/502492dc5598473cbbfbaf9c39aac181/users/872198c08caa42c1b2b674dcaa015007/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:10.042582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6d010-4bc6-4cd7-b37e-1b7417ecfa20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502492dc5598473cbbfbaf9c39aac181, user_id=872198c08caa42c1b2b674dcaa015007, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:10.046160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6d010-4bc6-4cd7-b37e-1b7417ecfa20 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:10.065643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 979/1973] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:09 2022] PUT /identity/v3/projects/502492dc5598473cbbfbaf9c39aac181/users/872198c08caa42c1b2b674dcaa015007/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:10.077496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6d010-4bc6-4cd7-b37e-1b7417ecfa20 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:10.081541 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0aa6d010-4bc6-4cd7-b37e-1b7417ecfa20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:10.087393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cc664438-a52a-43e7-81db-1b911d84014b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6f8110fb4ee404c9d84416041bce4f6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.088440 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cc664438-a52a-43e7-81db-1b911d84014b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6f8110fb4ee404c9d84416041bce4f6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.089149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cc664438-a52a-43e7-81db-1b911d84014b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6f8110fb4ee404c9d84416041bce4f6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.097696 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cc664438-a52a-43e7-81db-1b911d84014b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6f8110fb4ee404c9d84416041bce4f6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.100063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:10.109581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cc664438-a52a-43e7-81db-1b911d84014b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6f8110fb4ee404c9d84416041bce4f6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.137014 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 995/1974] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:09 2022] DELETE /identity/v3/users/c6f8110fb4ee404c9d84416041bce4f6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:31:10.137014 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9c1e4-0401-467e-881e-e5f80d863e18 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:10.137331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9c1e4-0401-467e-881e-e5f80d863e18 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:10.137897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9c1e4-0401-467e-881e-e5f80d863e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:10.152693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:10.180280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6d010-4bc6-4cd7-b37e-1b7417ecfa20 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:10.185485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6df9c1e4-0401-467e-881e-e5f80d863e18 None None] MFA Rules not processed for user `872198c08caa42c1b2b674dcaa015007`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:10.187096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6df9c1e4-0401-467e-881e-e5f80d863e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:10.259350 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621839ea-2bcf-4900-9a81-4da68a553d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:10.260382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621839ea-2bcf-4900-9a81-4da68a553d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:10.260657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621839ea-2bcf-4900-9a81-4da68a553d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:10.260994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621839ea-2bcf-4900-9a81-4da68a553d2e admin admin] PATH_INFO: `/v3/projects/ce0780dc9849461fa06a33d1d164f17b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:10.262307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621839ea-2bcf-4900-9a81-4da68a553d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce0780dc9849461fa06a33d1d164f17b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:10.264780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621839ea-2bcf-4900-9a81-4da68a553d2e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:10.283875 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 996/1975] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:10.289351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9c1e4-0401-467e-881e-e5f80d863e18 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:10.291981 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6df9c1e4-0401-467e-881e-e5f80d863e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:10.312290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9c1e4-0401-467e-881e-e5f80d863e18 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:10.319887 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7941337-c0a4-4861-829e-0291ada2c427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:10.320586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7941337-c0a4-4861-829e-0291ada2c427 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:10.321061 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7941337-c0a4-4861-829e-0291ada2c427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:10.321303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7941337-c0a4-4861-829e-0291ada2c427 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:10.322103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7941337-c0a4-4861-829e-0291ada2c427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:10.324197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7941337-c0a4-4861-829e-0291ada2c427 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:10.345538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-621839ea-2bcf-4900-9a81-4da68a553d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce0780dc9849461fa06a33d1d164f17b', 'request_id': 'req-621839ea-2bcf-4900-9a81-4da68a553d2e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.354405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-621839ea-2bcf-4900-9a81-4da68a553d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce0780dc9849461fa06a33d1d164f17b', 'request_id': 'req-621839ea-2bcf-4900-9a81-4da68a553d2e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.364389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-621839ea-2bcf-4900-9a81-4da68a553d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce0780dc9849461fa06a33d1d164f17b', 'request_id': 'req-621839ea-2bcf-4900-9a81-4da68a553d2e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.367663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 997/1976] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:10 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:10.370684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7941337-c0a4-4861-829e-0291ada2c427 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:10.380003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-621839ea-2bcf-4900-9a81-4da68a553d2e admin admin] The token cache is being invalidate because project ce0780dc9849461fa06a33d1d164f17b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:10.380497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-621839ea-2bcf-4900-9a81-4da68a553d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.382032 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-621839ea-2bcf-4900-9a81-4da68a553d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.386018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 980/1977] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:10 2022] DELETE /identity/v3/projects/ce0780dc9849461fa06a33d1d164f17b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:10.390300 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621839ea-2bcf-4900-9a81-4da68a553d2e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:10.392025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-621839ea-2bcf-4900-9a81-4da68a553d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:10.493969 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7941337-c0a4-4861-829e-0291ada2c427 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:10.499956 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75ad1d-d529-479c-8581-2e2aa484e925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:10.500886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75ad1d-d529-479c-8581-2e2aa484e925 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:10.501268 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75ad1d-d529-479c-8581-2e2aa484e925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:10.501645 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75ad1d-d529-479c-8581-2e2aa484e925 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:10.502458 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75ad1d-d529-479c-8581-2e2aa484e925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:10.504853 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75ad1d-d529-479c-8581-2e2aa484e925 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:10.505811 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:10.531116 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621839ea-2bcf-4900-9a81-4da68a553d2e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:10.537004 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 998/1978] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:10 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:10.538513 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc136535-bee9-4b72-ba7d-6dfabf3b310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:10.540356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc136535-bee9-4b72-ba7d-6dfabf3b310b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:10.540949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc136535-bee9-4b72-ba7d-6dfabf3b310b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:10.541350 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc136535-bee9-4b72-ba7d-6dfabf3b310b admin admin] PATH_INFO: `/v3/users/103cdb5625a0438cbd51920cfaf8116a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:10.541689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75ad1d-d529-479c-8581-2e2aa484e925 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:10.542869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc136535-bee9-4b72-ba7d-6dfabf3b310b admin admin] RBAC: Authorizing `identity:delete_user(user_id=103cdb5625a0438cbd51920cfaf8116a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:10.545607 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc136535-bee9-4b72-ba7d-6dfabf3b310b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:10.546531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6c75ad1d-d529-479c-8581-2e2aa484e925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:10.569861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75ad1d-d529-479c-8581-2e2aa484e925 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:10.579085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869903e-cbb4-48d8-ad6d-1f557d0af492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:10.580029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869903e-cbb4-48d8-ad6d-1f557d0af492 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:10.580423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869903e-cbb4-48d8-ad6d-1f557d0af492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:10.580776 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869903e-cbb4-48d8-ad6d-1f557d0af492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:10.582418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869903e-cbb4-48d8-ad6d-1f557d0af492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:10.584648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869903e-cbb4-48d8-ad6d-1f557d0af492 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:10.632050 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 999/1979] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:10.632050 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869903e-cbb4-48d8-ad6d-1f557d0af492 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:10.644025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f869903e-cbb4-48d8-ad6d-1f557d0af492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:10.665055 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869903e-cbb4-48d8-ad6d-1f557d0af492 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:10.666200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bc136535-bee9-4b72-ba7d-6dfabf3b310b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '103cdb5625a0438cbd51920cfaf8116a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.678510 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6fd01-ae8f-4dc1-85f6-8c32f97f2bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:10.679685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6fd01-ae8f-4dc1-85f6-8c32f97f2bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:10.680103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6fd01-ae8f-4dc1-85f6-8c32f97f2bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:10.680670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6fd01-ae8f-4dc1-85f6-8c32f97f2bc9 admin admin] PATH_INFO: `/v3/projects/bc67de00bbb64f98b193e3e78798c232` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:10.682019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6fd01-ae8f-4dc1-85f6-8c32f97f2bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc67de00bbb64f98b193e3e78798c232)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:10.683268 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bc136535-bee9-4b72-ba7d-6dfabf3b310b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '103cdb5625a0438cbd51920cfaf8116a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.684586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6fd01-ae8f-4dc1-85f6-8c32f97f2bc9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:10.684881 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bc136535-bee9-4b72-ba7d-6dfabf3b310b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '103cdb5625a0438cbd51920cfaf8116a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.685761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bc136535-bee9-4b72-ba7d-6dfabf3b310b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '103cdb5625a0438cbd51920cfaf8116a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.696364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-bc136535-bee9-4b72-ba7d-6dfabf3b310b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '103cdb5625a0438cbd51920cfaf8116a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.719226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 981/1980] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:10 2022] DELETE /identity/v3/users/103cdb5625a0438cbd51920cfaf8116a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:10.720433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc136535-bee9-4b72-ba7d-6dfabf3b310b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:10.721954 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bc136535-bee9-4b72-ba7d-6dfabf3b310b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:10.855628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:10.862334 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e7a6fd01-ae8f-4dc1-85f6-8c32f97f2bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc67de00bbb64f98b193e3e78798c232', 'request_id': 'req-e7a6fd01-ae8f-4dc1-85f6-8c32f97f2bc9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.872193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc136535-bee9-4b72-ba7d-6dfabf3b310b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:10.876726 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e7a6fd01-ae8f-4dc1-85f6-8c32f97f2bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc67de00bbb64f98b193e3e78798c232', 'request_id': 'req-e7a6fd01-ae8f-4dc1-85f6-8c32f97f2bc9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.892058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e7a6fd01-ae8f-4dc1-85f6-8c32f97f2bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc67de00bbb64f98b193e3e78798c232', 'request_id': 'req-e7a6fd01-ae8f-4dc1-85f6-8c32f97f2bc9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.927223 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e7a6fd01-ae8f-4dc1-85f6-8c32f97f2bc9 admin admin] The token cache is being invalidate because project bc67de00bbb64f98b193e3e78798c232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:10.927892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e7a6fd01-ae8f-4dc1-85f6-8c32f97f2bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.928788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e7a6fd01-ae8f-4dc1-85f6-8c32f97f2bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:10.930692 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1000/1981] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:10 2022] DELETE /identity/v3/projects/bc67de00bbb64f98b193e3e78798c232 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:10.935575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a6aa0-e5dc-488a-979c-d8f31d443113 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:10.935923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a6aa0-e5dc-488a-979c-d8f31d443113 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:10.936161 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a6aa0-e5dc-488a-979c-d8f31d443113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:10.961208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-230a6aa0-e5dc-488a-979c-d8f31d443113 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:10.964015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-230a6aa0-e5dc-488a-979c-d8f31d443113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:10.993338 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd005773-5515-4b6c-81a0-4d08ed502c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:10.994316 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd005773-5515-4b6c-81a0-4d08ed502c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:10.994645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd005773-5515-4b6c-81a0-4d08ed502c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:10.994925 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd005773-5515-4b6c-81a0-4d08ed502c6c admin admin] PATH_INFO: `/v3/projects/cf8ad99e587c4776a679da002d574a4f/users/179fb211a164410491679b13e9b92e6d/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:11.022077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd005773-5515-4b6c-81a0-4d08ed502c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8ad99e587c4776a679da002d574a4f, user_id=179fb211a164410491679b13e9b92e6d, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:11.025270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd005773-5515-4b6c-81a0-4d08ed502c6c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:11.038330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:11.044453 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 982/1982] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:10 2022] PUT /identity/v3/projects/cf8ad99e587c4776a679da002d574a4f/users/179fb211a164410491679b13e9b92e6d/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:11.054304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd005773-5515-4b6c-81a0-4d08ed502c6c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:11.060143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bd005773-5515-4b6c-81a0-4d08ed502c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:11.077601 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1001/1983] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:11.086891 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f380-6365-40bd-a0c8-d0c8f51abda8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:11.092355 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f380-6365-40bd-a0c8-d0c8f51abda8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:11.100895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f380-6365-40bd-a0c8-d0c8f51abda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:11.153606 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d178f380-6365-40bd-a0c8-d0c8f51abda8 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:11.155067 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d178f380-6365-40bd-a0c8-d0c8f51abda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:11.224159 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd005773-5515-4b6c-81a0-4d08ed502c6c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:11.240189 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726651f9-5461-4c9d-8c48-7158f54c3c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:11.241280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726651f9-5461-4c9d-8c48-7158f54c3c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:11.241610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726651f9-5461-4c9d-8c48-7158f54c3c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:11.241720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726651f9-5461-4c9d-8c48-7158f54c3c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:11.242917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726651f9-5461-4c9d-8c48-7158f54c3c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:11.245628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726651f9-5461-4c9d-8c48-7158f54c3c83 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:11.268858 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 983/1984] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:31:11.270589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726651f9-5461-4c9d-8c48-7158f54c3c83 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:11.272313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-726651f9-5461-4c9d-8c48-7158f54c3c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:11.295663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726651f9-5461-4c9d-8c48-7158f54c3c83 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:11.302534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1002/1985] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:11.302534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f380-6365-40bd-a0c8-d0c8f51abda8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:11.303518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee787f0-0d0d-468d-ad52-24ce087f3b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:11.304489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee787f0-0d0d-468d-ad52-24ce087f3b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:11.304839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee787f0-0d0d-468d-ad52-24ce087f3b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:11.305199 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee787f0-0d0d-468d-ad52-24ce087f3b99 admin admin] PATH_INFO: `/v3/projects/4d5c16ed1483476780f9ed372ff41ffb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:11.306519 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee787f0-0d0d-468d-ad52-24ce087f3b99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5c16ed1483476780f9ed372ff41ffb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:11.309264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee787f0-0d0d-468d-ad52-24ce087f3b99 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:11.311441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f380-6365-40bd-a0c8-d0c8f51abda8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:11.326634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2275f1-e837-4e2a-82fb-9af9d6430764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:11.327706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2275f1-e837-4e2a-82fb-9af9d6430764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:11.328060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2275f1-e837-4e2a-82fb-9af9d6430764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:11.328407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2275f1-e837-4e2a-82fb-9af9d6430764 admin admin] PATH_INFO: `/v3/projects/cf8ad99e587c4776a679da002d574a4f/users/179fb211a164410491679b13e9b92e6d/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:11.332520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2275f1-e837-4e2a-82fb-9af9d6430764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8ad99e587c4776a679da002d574a4f, user_id=179fb211a164410491679b13e9b92e6d, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:11.337020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2275f1-e837-4e2a-82fb-9af9d6430764 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:11.355732 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1003/1986] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:11 2022] PUT /identity/v3/projects/cf8ad99e587c4776a679da002d574a4f/users/179fb211a164410491679b13e9b92e6d/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:11.357255 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2275f1-e837-4e2a-82fb-9af9d6430764 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:11.394006 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6ee787f0-0d0d-468d-ad52-24ce087f3b99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5c16ed1483476780f9ed372ff41ffb', 'request_id': 'req-6ee787f0-0d0d-468d-ad52-24ce087f3b99'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:11.402265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6ee787f0-0d0d-468d-ad52-24ce087f3b99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5c16ed1483476780f9ed372ff41ffb', 'request_id': 'req-6ee787f0-0d0d-468d-ad52-24ce087f3b99'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:11.410846 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6ee787f0-0d0d-468d-ad52-24ce087f3b99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5c16ed1483476780f9ed372ff41ffb', 'request_id': 'req-6ee787f0-0d0d-468d-ad52-24ce087f3b99'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:11.432083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6ee787f0-0d0d-468d-ad52-24ce087f3b99 admin admin] The token cache is being invalidate because project 4d5c16ed1483476780f9ed372ff41ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:11.432511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6ee787f0-0d0d-468d-ad52-24ce087f3b99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:11.433396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-6ee787f0-0d0d-468d-ad52-24ce087f3b99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:11.435636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 984/1987] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:11 2022] DELETE /identity/v3/projects/4d5c16ed1483476780f9ed372ff41ffb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:11.436555 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49861f36-4aad-4559-9578-35c50274c399 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:11.436838 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49861f36-4aad-4559-9578-35c50274c399 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:11.437113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49861f36-4aad-4559-9578-35c50274c399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:11.466030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2275f1-e837-4e2a-82fb-9af9d6430764 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:11.472300 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-49861f36-4aad-4559-9578-35c50274c399 None None] MFA Rules not processed for user `179fb211a164410491679b13e9b92e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:11.473564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-49861f36-4aad-4559-9578-35c50274c399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:11.477950 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:11.574948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 985/1988] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:11.576865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a76fa-2d12-4a68-9a82-2d4081461b27 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:11.577200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a76fa-2d12-4a68-9a82-2d4081461b27 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:11.577471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a76fa-2d12-4a68-9a82-2d4081461b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:11.587566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:11.601904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d35db-0f48-4474-8c50-0ea8900e52af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:11.603238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d35db-0f48-4474-8c50-0ea8900e52af admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:11.603364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1a5a76fa-2d12-4a68-9a82-2d4081461b27 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:11.603538 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d35db-0f48-4474-8c50-0ea8900e52af admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:11.603916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d35db-0f48-4474-8c50-0ea8900e52af admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:11.604686 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d35db-0f48-4474-8c50-0ea8900e52af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:11.604818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1a5a76fa-2d12-4a68-9a82-2d4081461b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:11.605189 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d35db-0f48-4474-8c50-0ea8900e52af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:11.607008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d35db-0f48-4474-8c50-0ea8900e52af admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:11.614714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 986/1989] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:11.619923 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a76fa-2d12-4a68-9a82-2d4081461b27 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:11.620241 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1004/1990] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:11.623722 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1a5a76fa-2d12-4a68-9a82-2d4081461b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:11.625197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bf9e9-172b-4f60-8d13-173711342e0a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:11.625549 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bf9e9-172b-4f60-8d13-173711342e0a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:11.625896 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bf9e9-172b-4f60-8d13-173711342e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:11.643829 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f22bf9e9-172b-4f60-8d13-173711342e0a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:11.645149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f22bf9e9-172b-4f60-8d13-173711342e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:11.653714 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1005/1991] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:11.654501 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bf9e9-172b-4f60-8d13-173711342e0a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:11.656072 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f22bf9e9-172b-4f60-8d13-173711342e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:11.667733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bf9e9-172b-4f60-8d13-173711342e0a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:11.672903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eda057-88c6-4867-907b-8eea57af77e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:11.673636 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eda057-88c6-4867-907b-8eea57af77e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:11.673925 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eda057-88c6-4867-907b-8eea57af77e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:11.674199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eda057-88c6-4867-907b-8eea57af77e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:11.675000 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eda057-88c6-4867-907b-8eea57af77e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:11.676953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eda057-88c6-4867-907b-8eea57af77e5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:11.687591 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a76fa-2d12-4a68-9a82-2d4081461b27 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:11.691328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acef27c-36a0-40c1-ab6e-9c6ce77e0346 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:11.693381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef27c-36a0-40c1-ab6e-9c6ce77e0346 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:11.693655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef27c-36a0-40c1-ab6e-9c6ce77e0346 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:11.693950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef27c-36a0-40c1-ab6e-9c6ce77e0346 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:11.704853 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1006/1992] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:11 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:11.705732 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eda057-88c6-4867-907b-8eea57af77e5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:11.706574 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acef27c-36a0-40c1-ab6e-9c6ce77e0346 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:11.708110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acef27c-36a0-40c1-ab6e-9c6ce77e0346 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:11.718835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 987/1993] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:11.719690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acef27c-36a0-40c1-ab6e-9c6ce77e0346 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:11.731454 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acef27c-36a0-40c1-ab6e-9c6ce77e0346 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:11.786156 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eda057-88c6-4867-907b-8eea57af77e5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:11.791482 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c911b1-33ad-4e00-b46a-f37deb6bdc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:11.792294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c911b1-33ad-4e00-b46a-f37deb6bdc09 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:11.792698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c911b1-33ad-4e00-b46a-f37deb6bdc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:11.793211 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c911b1-33ad-4e00-b46a-f37deb6bdc09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:11.793892 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c911b1-33ad-4e00-b46a-f37deb6bdc09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:11.794264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c911b1-33ad-4e00-b46a-f37deb6bdc09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:11.796011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c911b1-33ad-4e00-b46a-f37deb6bdc09 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:11.809077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1007/1994] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:11.810067 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c911b1-33ad-4e00-b46a-f37deb6bdc09 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:11.813395 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a86c77-3c3b-4117-99b1-f7150a9bb7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:11.814101 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a86c77-3c3b-4117-99b1-f7150a9bb7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:11.814391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a86c77-3c3b-4117-99b1-f7150a9bb7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:11.814676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a86c77-3c3b-4117-99b1-f7150a9bb7c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:11.815384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a86c77-3c3b-4117-99b1-f7150a9bb7c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:11.817512 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a86c77-3c3b-4117-99b1-f7150a9bb7c9 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:11.840891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 988/1995] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:11 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:11.842406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a86c77-3c3b-4117-99b1-f7150a9bb7c9 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:11.857641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a86c77-3c3b-4117-99b1-f7150a9bb7c9 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:11.863754 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cdb83-a9f0-424f-afc2-c37000e119c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:11.865569 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cdb83-a9f0-424f-afc2-c37000e119c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:11.865956 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cdb83-a9f0-424f-afc2-c37000e119c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:11.866256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cdb83-a9f0-424f-afc2-c37000e119c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:11.870894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cdb83-a9f0-424f-afc2-c37000e119c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:11.870894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cdb83-a9f0-424f-afc2-c37000e119c1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:11.884299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c911b1-33ad-4e00-b46a-f37deb6bdc09 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:11.888509 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00b0d5-191d-4a9b-8874-47211ce83f82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:11.889439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00b0d5-191d-4a9b-8874-47211ce83f82 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:11.889864 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00b0d5-191d-4a9b-8874-47211ce83f82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:11.890161 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00b0d5-191d-4a9b-8874-47211ce83f82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:11.892121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fe00b0d5-191d-4a9b-8874-47211ce83f82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:11.921077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 989/1996] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:11 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:11.922095 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cdb83-a9f0-424f-afc2-c37000e119c1 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:11.936365 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:11.986210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00b0d5-191d-4a9b-8874-47211ce83f82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:11.987802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00b0d5-191d-4a9b-8874-47211ce83f82 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:11.999116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1008/1997] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:12.000139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00b0d5-191d-4a9b-8874-47211ce83f82 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.010028 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cdb83-a9f0-424f-afc2-c37000e119c1 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.011966 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00b0d5-191d-4a9b-8874-47211ce83f82 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.014882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b22faa-90d6-419f-84c0-32b1b19fe4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.015543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b22faa-90d6-419f-84c0-32b1b19fe4be admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.015854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b22faa-90d6-419f-84c0-32b1b19fe4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.016147 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b22faa-90d6-419f-84c0-32b1b19fe4be admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.016863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b22faa-90d6-419f-84c0-32b1b19fe4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.018237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e072c4f-b543-4b6f-a5a3-00b3fab23d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.018489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b22faa-90d6-419f-84c0-32b1b19fe4be admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.018949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e072c4f-b543-4b6f-a5a3-00b3fab23d21 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.019236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e072c4f-b543-4b6f-a5a3-00b3fab23d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.019673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e072c4f-b543-4b6f-a5a3-00b3fab23d21 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.020243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e072c4f-b543-4b6f-a5a3-00b3fab23d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.022327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e072c4f-b543-4b6f-a5a3-00b3fab23d21 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.041147 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 990/1998] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:12.045028 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b22faa-90d6-419f-84c0-32b1b19fe4be admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.048690 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1009/1999] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:11 2022] POST /identity/v3/users => generated 283 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:12.052467 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:12.053160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e072c4f-b543-4b6f-a5a3-00b3fab23d21 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.059306 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b22faa-90d6-419f-84c0-32b1b19fe4be admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.064077 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2c5e9-bdd5-4bd8-ad2f-be125c367799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.064915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2c5e9-bdd5-4bd8-ad2f-be125c367799 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.065356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2c5e9-bdd5-4bd8-ad2f-be125c367799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.065807 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2c5e9-bdd5-4bd8-ad2f-be125c367799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.067638 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2c5e9-bdd5-4bd8-ad2f-be125c367799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.069676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2c5e9-bdd5-4bd8-ad2f-be125c367799 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.069813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e072c4f-b543-4b6f-a5a3-00b3fab23d21 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.075560 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bafac-3a68-4977-89c3-9765f492e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.076571 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bafac-3a68-4977-89c3-9765f492e003 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.076697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bafac-3a68-4977-89c3-9765f492e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.077204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bafac-3a68-4977-89c3-9765f492e003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.078159 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bafac-3a68-4977-89c3-9765f492e003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.079749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bafac-3a68-4977-89c3-9765f492e003 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.083633 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 991/2000] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:12.085461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2c5e9-bdd5-4bd8-ad2f-be125c367799 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.091647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1010/2001] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:31:12.095395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bafac-3a68-4977-89c3-9765f492e003 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.099373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2c5e9-bdd5-4bd8-ad2f-be125c367799 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.105554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bafac-3a68-4977-89c3-9765f492e003 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.106000 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388534ee-fe70-4ad2-882d-2dbe24f2ec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.107308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388534ee-fe70-4ad2-882d-2dbe24f2ec28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.107808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388534ee-fe70-4ad2-882d-2dbe24f2ec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.108224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388534ee-fe70-4ad2-882d-2dbe24f2ec28 admin admin] PATH_INFO: `/v3/projects/20c6f5a2cf1e46c7803efbb75467d14c/users/a62fbd909c4a4d6e9ad6d9ad2722a3e0/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.110360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627e47a-a7c8-4cc0-89f1-3cd0638a2d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.111046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627e47a-a7c8-4cc0-89f1-3cd0638a2d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.111324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627e47a-a7c8-4cc0-89f1-3cd0638a2d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.113049 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627e47a-a7c8-4cc0-89f1-3cd0638a2d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.113049 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627e47a-a7c8-4cc0-89f1-3cd0638a2d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.113981 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627e47a-a7c8-4cc0-89f1-3cd0638a2d43 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.129662 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1011/2002] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:31:12.129847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388534ee-fe70-4ad2-882d-2dbe24f2ec28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c6f5a2cf1e46c7803efbb75467d14c, user_id=a62fbd909c4a4d6e9ad6d9ad2722a3e0, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.130834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627e47a-a7c8-4cc0-89f1-3cd0638a2d43 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.131122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388534ee-fe70-4ad2-882d-2dbe24f2ec28 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.143966 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627e47a-a7c8-4cc0-89f1-3cd0638a2d43 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.150649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 992/2003] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:12 2022] PUT /identity/v3/projects/20c6f5a2cf1e46c7803efbb75467d14c/users/a62fbd909c4a4d6e9ad6d9ad2722a3e0/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:31:12.162885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad36b0a-954e-4447-ac7b-84fc80b8e0c2 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.163206 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad36b0a-954e-4447-ac7b-84fc80b8e0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.163443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad36b0a-954e-4447-ac7b-84fc80b8e0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.196301 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-dad36b0a-954e-4447-ac7b-84fc80b8e0c2 None None] MFA Rules not processed for user `a62fbd909c4a4d6e9ad6d9ad2722a3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:12.197880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-dad36b0a-954e-4447-ac7b-84fc80b8e0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:12.221851 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14ea5c-d22e-40fa-bbf7-6cc64bd0d34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.223391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14ea5c-d22e-40fa-bbf7-6cc64bd0d34b admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.223702 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14ea5c-d22e-40fa-bbf7-6cc64bd0d34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.224037 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14ea5c-d22e-40fa-bbf7-6cc64bd0d34b admin admin] PATH_INFO: `/v3/projects/2400f188a2fe4bcebabe04d38cb093b9/users/481c7e74dec6483181c48d0c849b3cb7/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.244306 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14ea5c-d22e-40fa-bbf7-6cc64bd0d34b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2400f188a2fe4bcebabe04d38cb093b9, user_id=481c7e74dec6483181c48d0c849b3cb7, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.248014 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14ea5c-d22e-40fa-bbf7-6cc64bd0d34b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.267067 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1012/2004] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:12 2022] PUT /identity/v3/projects/2400f188a2fe4bcebabe04d38cb093b9/users/481c7e74dec6483181c48d0c849b3cb7/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:12.278982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf68790-f098-4b7b-9a47-19867a6f6b61 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.279463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf68790-f098-4b7b-9a47-19867a6f6b61 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.279836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf68790-f098-4b7b-9a47-19867a6f6b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.284427 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 993/2005] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:31:12.289245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad36b0a-954e-4447-ac7b-84fc80b8e0c2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.307452 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad36b0a-954e-4447-ac7b-84fc80b8e0c2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.320921 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-dcf68790-f098-4b7b-9a47-19867a6f6b61 None None] MFA Rules not processed for user `481c7e74dec6483181c48d0c849b3cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:12.322611 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-dcf68790-f098-4b7b-9a47-19867a6f6b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:12.426459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:12.446559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1013/2006] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:12.447762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf68790-f098-4b7b-9a47-19867a6f6b61 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.479772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d91cb-59b8-4d81-8645-1017e2c9cf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.479945 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d91cb-59b8-4d81-8645-1017e2c9cf26 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.480175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d91cb-59b8-4d81-8645-1017e2c9cf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.481047 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d91cb-59b8-4d81-8645-1017e2c9cf26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.482034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d91cb-59b8-4d81-8645-1017e2c9cf26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.486369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d91cb-59b8-4d81-8645-1017e2c9cf26 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.533109 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 994/2007] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:12 2022] POST /identity/v3/projects => generated 391 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:31:12.541520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d91cb-59b8-4d81-8645-1017e2c9cf26 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.553377 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf68790-f098-4b7b-9a47-19867a6f6b61 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.592765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:12.610314 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d91cb-59b8-4d81-8645-1017e2c9cf26 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.615374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39780eb-d46e-4ba0-813c-0d6fd455e1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.616242 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39780eb-d46e-4ba0-813c-0d6fd455e1bc admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.616384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39780eb-d46e-4ba0-813c-0d6fd455e1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.616638 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39780eb-d46e-4ba0-813c-0d6fd455e1bc admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.617667 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39780eb-d46e-4ba0-813c-0d6fd455e1bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.619640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39780eb-d46e-4ba0-813c-0d6fd455e1bc admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.626917 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb697668-caa4-49cd-8c30-8fe138bb2583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.627618 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb697668-caa4-49cd-8c30-8fe138bb2583 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.627910 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb697668-caa4-49cd-8c30-8fe138bb2583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.628173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb697668-caa4-49cd-8c30-8fe138bb2583 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.628875 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb697668-caa4-49cd-8c30-8fe138bb2583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.630799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb697668-caa4-49cd-8c30-8fe138bb2583 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.644809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 995/2008] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:12 2022] POST /identity/v3/users => generated 302 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:12.649029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39780eb-d46e-4ba0-813c-0d6fd455e1bc admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.661469 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39780eb-d46e-4ba0-813c-0d6fd455e1bc admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.661791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1014/2009] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:12 2022] POST /identity/v3/projects => generated 363 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:12.665893 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb697668-caa4-49cd-8c30-8fe138bb2583 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.745089 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685d35d-17a2-49cb-be2a-52dcacccfc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.745772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685d35d-17a2-49cb-be2a-52dcacccfc8c admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.746134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685d35d-17a2-49cb-be2a-52dcacccfc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.746409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685d35d-17a2-49cb-be2a-52dcacccfc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.747263 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685d35d-17a2-49cb-be2a-52dcacccfc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.749282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685d35d-17a2-49cb-be2a-52dcacccfc8c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.758257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb697668-caa4-49cd-8c30-8fe138bb2583 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.763015 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 996/2010] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:31:12.764491 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84154d7-bde8-46d4-8492-ec08e2f156e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.765360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84154d7-bde8-46d4-8492-ec08e2f156e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.765652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84154d7-bde8-46d4-8492-ec08e2f156e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.765930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84154d7-bde8-46d4-8492-ec08e2f156e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.766982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84154d7-bde8-46d4-8492-ec08e2f156e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.767778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685d35d-17a2-49cb-be2a-52dcacccfc8c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.768999 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84154d7-bde8-46d4-8492-ec08e2f156e6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.780595 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685d35d-17a2-49cb-be2a-52dcacccfc8c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.790009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ec836-c099-402f-a890-fb5bd4b2207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.791162 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ec836-c099-402f-a890-fb5bd4b2207b admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.791477 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ec836-c099-402f-a890-fb5bd4b2207b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.792283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ec836-c099-402f-a890-fb5bd4b2207b admin admin] PATH_INFO: `/v3/projects/5c44105386c4478c8665bedb659623ed/users/1d1ca395287b4efb86bff6bf5a1dc49e/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.803041 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1015/2011] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:12 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:12.806986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84154d7-bde8-46d4-8492-ec08e2f156e6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.811701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ec836-c099-402f-a890-fb5bd4b2207b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c44105386c4478c8665bedb659623ed, user_id=1d1ca395287b4efb86bff6bf5a1dc49e, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.814923 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ec836-c099-402f-a890-fb5bd4b2207b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.823798 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84154d7-bde8-46d4-8492-ec08e2f156e6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.830435 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc611d-6ce7-4404-99c6-e7aeb5b2f154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.831154 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc611d-6ce7-4404-99c6-e7aeb5b2f154 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.831529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc611d-6ce7-4404-99c6-e7aeb5b2f154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.831884 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc611d-6ce7-4404-99c6-e7aeb5b2f154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.833430 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc611d-6ce7-4404-99c6-e7aeb5b2f154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.835228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc611d-6ce7-4404-99c6-e7aeb5b2f154 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.838049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 997/2012] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:12 2022] PUT /identity/v3/projects/5c44105386c4478c8665bedb659623ed/users/1d1ca395287b4efb86bff6bf5a1dc49e/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:31:12.841951 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ec836-c099-402f-a890-fb5bd4b2207b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.851154 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1016/2013] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:12.852559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc611d-6ce7-4404-99c6-e7aeb5b2f154 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.864237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc611d-6ce7-4404-99c6-e7aeb5b2f154 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.869862 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:12.930072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ec836-c099-402f-a890-fb5bd4b2207b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.938324 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82082534-67ec-4bdb-a42f-a9ab8354992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.938824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d70e0-3531-47c4-8024-474bc433a313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:12.939090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82082534-67ec-4bdb-a42f-a9ab8354992b admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.939358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82082534-67ec-4bdb-a42f-a9ab8354992b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.939668 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82082534-67ec-4bdb-a42f-a9ab8354992b admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.940053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d70e0-3531-47c4-8024-474bc433a313 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:12.940294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d70e0-3531-47c4-8024-474bc433a313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:12.940406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82082534-67ec-4bdb-a42f-a9ab8354992b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.940560 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d70e0-3531-47c4-8024-474bc433a313 admin admin] PATH_INFO: `/v3/projects/a2b465cd37b548fd9794992cef4aeb19/users/ad225d59197e4066a06d7cb42d0f4e68/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:12.942042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82082534-67ec-4bdb-a42f-a9ab8354992b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.959257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d70e0-3531-47c4-8024-474bc433a313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b465cd37b548fd9794992cef4aeb19, user_id=ad225d59197e4066a06d7cb42d0f4e68, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:12.959731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 998/2014] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:31:12.961955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82082534-67ec-4bdb-a42f-a9ab8354992b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:12.962855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d70e0-3531-47c4-8024-474bc433a313 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:12.992895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1017/2015] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:12 2022] PUT /identity/v3/projects/a2b465cd37b548fd9794992cef4aeb19/users/ad225d59197e4066a06d7cb42d0f4e68/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:31:12.997035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82082534-67ec-4bdb-a42f-a9ab8354992b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:12.998695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d70e0-3531-47c4-8024-474bc433a313 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:13.060838 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:13.087129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b6074-20b9-4b6f-a82b-679aabaffa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:13.088260 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b6074-20b9-4b6f-a82b-679aabaffa2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:13.088544 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b6074-20b9-4b6f-a82b-679aabaffa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:13.088957 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b6074-20b9-4b6f-a82b-679aabaffa2d admin admin] PATH_INFO: `/v3/projects/5c44105386c4478c8665bedb659623ed/users/1d1ca395287b4efb86bff6bf5a1dc49e/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:13.093652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b6074-20b9-4b6f-a82b-679aabaffa2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c44105386c4478c8665bedb659623ed, user_id=1d1ca395287b4efb86bff6bf5a1dc49e, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:13.094950 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d70e0-3531-47c4-8024-474bc433a313 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:13.096633 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b6074-20b9-4b6f-a82b-679aabaffa2d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:13.100393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed6f38-801a-430d-867b-68ee6d80b744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:13.101083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed6f38-801a-430d-867b-68ee6d80b744 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:13.101393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed6f38-801a-430d-867b-68ee6d80b744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:13.101650 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed6f38-801a-430d-867b-68ee6d80b744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:13.102455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed6f38-801a-430d-867b-68ee6d80b744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:13.104096 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed6f38-801a-430d-867b-68ee6d80b744 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:13.110672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 999/2016] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:12 2022] PUT /identity/v3/projects/5c44105386c4478c8665bedb659623ed/users/1d1ca395287b4efb86bff6bf5a1dc49e/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:13.123028 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19f3a1-dd19-40d9-864a-e66224606fc5 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:13.123319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19f3a1-dd19-40d9-864a-e66224606fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:13.123589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19f3a1-dd19-40d9-864a-e66224606fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:13.126141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1018/2017] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:13.130232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed6f38-801a-430d-867b-68ee6d80b744 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:13.141184 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed6f38-801a-430d-867b-68ee6d80b744 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:13.160935 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3b19f3a1-dd19-40d9-864a-e66224606fc5 None None] MFA Rules not processed for user `1d1ca395287b4efb86bff6bf5a1dc49e`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:13.162289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3b19f3a1-dd19-40d9-864a-e66224606fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:13.212490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa06cf-2118-4326-9276-7cc3a29386fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:13.213465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa06cf-2118-4326-9276-7cc3a29386fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:13.213751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa06cf-2118-4326-9276-7cc3a29386fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:13.214059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa06cf-2118-4326-9276-7cc3a29386fe admin admin] PATH_INFO: `/v3/projects/a2b465cd37b548fd9794992cef4aeb19/users/ad225d59197e4066a06d7cb42d0f4e68/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:13.216258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa06cf-2118-4326-9276-7cc3a29386fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b465cd37b548fd9794992cef4aeb19, user_id=ad225d59197e4066a06d7cb42d0f4e68, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:13.218975 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa06cf-2118-4326-9276-7cc3a29386fe admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:13.229600 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1019/2018] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:13 2022] PUT /identity/v3/projects/a2b465cd37b548fd9794992cef4aeb19/users/ad225d59197e4066a06d7cb42d0f4e68/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:31:13.241160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792a0e5-636b-4d78-ac94-eb9363e633ff None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:13.241588 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792a0e5-636b-4d78-ac94-eb9363e633ff None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:13.242223 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792a0e5-636b-4d78-ac94-eb9363e633ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:13.246015 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1000/2019] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:31:13.257812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19f3a1-dd19-40d9-864a-e66224606fc5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:13.259765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3b19f3a1-dd19-40d9-864a-e66224606fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:13.272873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d792a0e5-636b-4d78-ac94-eb9363e633ff None None] MFA Rules not processed for user `ad225d59197e4066a06d7cb42d0f4e68`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:13.274364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d792a0e5-636b-4d78-ac94-eb9363e633ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:13.283894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:13.320904 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19f3a1-dd19-40d9-864a-e66224606fc5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:13.351271 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1020/2020] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:13 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:31:13.363314 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792a0e5-636b-4d78-ac94-eb9363e633ff None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:13.378474 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1e5e2-0ad2-40fe-8a68-2ab94c10c09c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:13.379362 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1e5e2-0ad2-40fe-8a68-2ab94c10c09c service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:13.379775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1e5e2-0ad2-40fe-8a68-2ab94c10c09c service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:13.380142 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1e5e2-0ad2-40fe-8a68-2ab94c10c09c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:13.415648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:13.424899 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792a0e5-636b-4d78-ac94-eb9363e633ff None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:13.429384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2a7f6-ae2b-4cff-8d8e-72e1ee1e9f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:13.430050 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2a7f6-ae2b-4cff-8d8e-72e1ee1e9f3f service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:13.430418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2a7f6-ae2b-4cff-8d8e-72e1ee1e9f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:13.430700 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2a7f6-ae2b-4cff-8d8e-72e1ee1e9f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:13.441222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2a7f6-ae2b-4cff-8d8e-72e1ee1e9f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:13.442828 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2a7f6-ae2b-4cff-8d8e-72e1ee1e9f3f service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:13.454117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1e5e2-0ad2-40fe-8a68-2ab94c10c09c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:13.455382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1021/2021] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:13 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:31:13.457379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1e5e2-0ad2-40fe-8a68-2ab94c10c09c service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:13.468380 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1001/2022] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:31:13.558614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2a7f6-ae2b-4cff-8d8e-72e1ee1e9f3f service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:13.568264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2a7f6-ae2b-4cff-8d8e-72e1ee1e9f3f service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:13.572278 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04337e35-536f-455a-a495-ce613f92b66a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:13.572931 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04337e35-536f-455a-a495-ce613f92b66a service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:13.573218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04337e35-536f-455a-a495-ce613f92b66a service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:13.573492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04337e35-536f-455a-a495-ce613f92b66a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:13.650641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04337e35-536f-455a-a495-ce613f92b66a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:13.652359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04337e35-536f-455a-a495-ce613f92b66a service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:13.664285 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1022/2023] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:13.681666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1e5e2-0ad2-40fe-8a68-2ab94c10c09c service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:13.690910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1e5e2-0ad2-40fe-8a68-2ab94c10c09c service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:13.694612 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc656a-bb3e-4384-8188-0fee00515f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:13.695267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc656a-bb3e-4384-8188-0fee00515f4b service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:13.695555 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc656a-bb3e-4384-8188-0fee00515f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:13.695857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc656a-bb3e-4384-8188-0fee00515f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:13.759119 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc656a-bb3e-4384-8188-0fee00515f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:13.760669 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc656a-bb3e-4384-8188-0fee00515f4b service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:13.771308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1002/2024] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:14.133168 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04337e35-536f-455a-a495-ce613f92b66a service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:14.134707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-04337e35-536f-455a-a495-ce613f92b66a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:14.197648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:14.219124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04337e35-536f-455a-a495-ce613f92b66a service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:14.223994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30347e-e4e6-4d0d-92e0-1061bccfb4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:14.224908 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30347e-e4e6-4d0d-92e0-1061bccfb4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:14.225217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30347e-e4e6-4d0d-92e0-1061bccfb4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:14.225492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30347e-e4e6-4d0d-92e0-1061bccfb4a3 admin admin] PATH_INFO: `/v3/users/e24bb41ae0ae4c4fb51a2cc23782b6e5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:14.226706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30347e-e4e6-4d0d-92e0-1061bccfb4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24bb41ae0ae4c4fb51a2cc23782b6e5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:14.228750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30347e-e4e6-4d0d-92e0-1061bccfb4a3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:14.322714 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1e30347e-e4e6-4d0d-92e0-1061bccfb4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24bb41ae0ae4c4fb51a2cc23782b6e5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:14.323425 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1e30347e-e4e6-4d0d-92e0-1061bccfb4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24bb41ae0ae4c4fb51a2cc23782b6e5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:14.324066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1e30347e-e4e6-4d0d-92e0-1061bccfb4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24bb41ae0ae4c4fb51a2cc23782b6e5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:14.334368 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1e30347e-e4e6-4d0d-92e0-1061bccfb4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24bb41ae0ae4c4fb51a2cc23782b6e5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:14.345304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1e30347e-e4e6-4d0d-92e0-1061bccfb4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24bb41ae0ae4c4fb51a2cc23782b6e5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:14.373997 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1023/2025] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:14 2022] DELETE /identity/v3/users/e24bb41ae0ae4c4fb51a2cc23782b6e5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:14.376299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab119a2-12ee-4ab2-b9b1-dfb9a868a75f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:14.376780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab119a2-12ee-4ab2-b9b1-dfb9a868a75f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:14.377318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab119a2-12ee-4ab2-b9b1-dfb9a868a75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:14.400748 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-cab119a2-12ee-4ab2-b9b1-dfb9a868a75f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:14.402328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cab119a2-12ee-4ab2-b9b1-dfb9a868a75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:14.495308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1003/2026] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:14.505357 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30347e-e4e6-4d0d-92e0-1061bccfb4a3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:14.506849 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1e30347e-e4e6-4d0d-92e0-1061bccfb4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:14.563095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30347e-e4e6-4d0d-92e0-1061bccfb4a3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:14.566766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594ccb3-a894-4a8f-a797-255906d229a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:14.567433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594ccb3-a894-4a8f-a797-255906d229a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:14.567756 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594ccb3-a894-4a8f-a797-255906d229a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:14.568088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594ccb3-a894-4a8f-a797-255906d229a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:14.577846 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594ccb3-a894-4a8f-a797-255906d229a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:14.579412 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594ccb3-a894-4a8f-a797-255906d229a9 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:14.589541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1024/2027] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:15.037602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab119a2-12ee-4ab2-b9b1-dfb9a868a75f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:15.039238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cab119a2-12ee-4ab2-b9b1-dfb9a868a75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:15.052266 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab119a2-12ee-4ab2-b9b1-dfb9a868a75f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:15.062560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:15.063467 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:15.063820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:15.064057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7 admin admin] PATH_INFO: `/v3/projects/40603b39ff2b4bb4865db6e16adee110` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:15.065403 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40603b39ff2b4bb4865db6e16adee110)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:15.067504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:15.140416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40603b39ff2b4bb4865db6e16adee110', 'request_id': 'req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:15.148698 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40603b39ff2b4bb4865db6e16adee110', 'request_id': 'req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:15.158687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40603b39ff2b4bb4865db6e16adee110', 'request_id': 'req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:15.160539 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:15.177605 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7 admin admin] The token cache is being invalidate because project 40603b39ff2b4bb4865db6e16adee110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:15.178264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:15.180082 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:15.182737 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1004/2028] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:15 2022] DELETE /identity/v3/projects/40603b39ff2b4bb4865db6e16adee110 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:15.187802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594ccb3-a894-4a8f-a797-255906d229a9 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:15.198737 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594ccb3-a894-4a8f-a797-255906d229a9 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:15.285752 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9f952-a82e-4bcb-9d3f-57dd1dbf7771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:15.286906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9f952-a82e-4bcb-9d3f-57dd1dbf7771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:15.287458 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9f952-a82e-4bcb-9d3f-57dd1dbf7771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:15.287954 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9f952-a82e-4bcb-9d3f-57dd1dbf7771 admin admin] PATH_INFO: `/v3/users/31598f99c88443c093e6309665c46d5a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:15.289434 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9f952-a82e-4bcb-9d3f-57dd1dbf7771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31598f99c88443c093e6309665c46d5a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:15.291392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9f952-a82e-4bcb-9d3f-57dd1dbf7771 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:15.306128 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:15.353219 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3ca9f952-a82e-4bcb-9d3f-57dd1dbf7771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31598f99c88443c093e6309665c46d5a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:15.354033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3ca9f952-a82e-4bcb-9d3f-57dd1dbf7771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31598f99c88443c093e6309665c46d5a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:15.354929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3ca9f952-a82e-4bcb-9d3f-57dd1dbf7771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31598f99c88443c093e6309665c46d5a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:15.364555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3ca9f952-a82e-4bcb-9d3f-57dd1dbf7771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31598f99c88443c093e6309665c46d5a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:15.374791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3ca9f952-a82e-4bcb-9d3f-57dd1dbf7771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31598f99c88443c093e6309665c46d5a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:15.400227 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1025/2029] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:15 2022] DELETE /identity/v3/users/31598f99c88443c093e6309665c46d5a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:15.767501 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:15.769171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:15.782778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fab663-8ced-4d2d-b175-cfe8716dbbf7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:15.942753 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381814d-37b5-4e3d-bc08-892f5989759a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:15.943717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381814d-37b5-4e3d-bc08-892f5989759a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:15.944010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381814d-37b5-4e3d-bc08-892f5989759a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:15.944294 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381814d-37b5-4e3d-bc08-892f5989759a admin admin] PATH_INFO: `/v3/users/231f5029bdbf450f84ed68713af49906` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:15.945589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381814d-37b5-4e3d-bc08-892f5989759a admin admin] RBAC: Authorizing `identity:delete_user(user_id=231f5029bdbf450f84ed68713af49906)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:15.948325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381814d-37b5-4e3d-bc08-892f5989759a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:16.032371 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7381814d-37b5-4e3d-bc08-892f5989759a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231f5029bdbf450f84ed68713af49906'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:16.054797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7381814d-37b5-4e3d-bc08-892f5989759a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231f5029bdbf450f84ed68713af49906'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:16.055891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7381814d-37b5-4e3d-bc08-892f5989759a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231f5029bdbf450f84ed68713af49906'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:16.058704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7381814d-37b5-4e3d-bc08-892f5989759a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231f5029bdbf450f84ed68713af49906'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:16.067879 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9f952-a82e-4bcb-9d3f-57dd1dbf7771 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:16.070885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3ca9f952-a82e-4bcb-9d3f-57dd1dbf7771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:16.076478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7381814d-37b5-4e3d-bc08-892f5989759a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231f5029bdbf450f84ed68713af49906'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:16.088726 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9f952-a82e-4bcb-9d3f-57dd1dbf7771 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:16.094364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610c279-a760-4a54-bdc7-985193de88c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:16.095396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610c279-a760-4a54-bdc7-985193de88c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:16.095804 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610c279-a760-4a54-bdc7-985193de88c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:16.096186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610c279-a760-4a54-bdc7-985193de88c0 admin admin] PATH_INFO: `/v3/users/481c7e74dec6483181c48d0c849b3cb7` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:16.097626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610c279-a760-4a54-bdc7-985193de88c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=481c7e74dec6483181c48d0c849b3cb7)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:16.099750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610c279-a760-4a54-bdc7-985193de88c0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:16.103808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1005/2030] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:15 2022] DELETE /identity/v3/users/231f5029bdbf450f84ed68713af49906 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:16.103808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381814d-37b5-4e3d-bc08-892f5989759a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:16.105393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7381814d-37b5-4e3d-bc08-892f5989759a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:16.197886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1610c279-a760-4a54-bdc7-985193de88c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481c7e74dec6483181c48d0c849b3cb7'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:16.198829 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1610c279-a760-4a54-bdc7-985193de88c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481c7e74dec6483181c48d0c849b3cb7'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:16.199628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1610c279-a760-4a54-bdc7-985193de88c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481c7e74dec6483181c48d0c849b3cb7'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:16.212208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1610c279-a760-4a54-bdc7-985193de88c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481c7e74dec6483181c48d0c849b3cb7'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:16.229810 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1610c279-a760-4a54-bdc7-985193de88c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481c7e74dec6483181c48d0c849b3cb7'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:16.254495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381814d-37b5-4e3d-bc08-892f5989759a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:16.277836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1026/2031] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:16 2022] DELETE /identity/v3/users/481c7e74dec6483181c48d0c849b3cb7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:16.280036 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a5565-6077-4717-979e-87691c6bfaca None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:16.281160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a5565-6077-4717-979e-87691c6bfaca None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:16.281608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a5565-6077-4717-979e-87691c6bfaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:16.281909 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:16.282825 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:16.283109 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:16.284889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e admin admin] PATH_INFO: `/v3/projects/1a17ca648b904206a6fcd48d03d2b883` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:16.287938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a17ca648b904206a6fcd48d03d2b883)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:16.290145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:16.308563 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-133a5565-6077-4717-979e-87691c6bfaca None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:16.311406 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-133a5565-6077-4717-979e-87691c6bfaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:16.314315 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:16.387352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a17ca648b904206a6fcd48d03d2b883', 'request_id': 'req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:16.398903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1027/2032] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:16.399132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a17ca648b904206a6fcd48d03d2b883', 'request_id': 'req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:16.400271 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c258f-82cb-40e4-8247-18665f474876 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:16.400600 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c258f-82cb-40e4-8247-18665f474876 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:16.401100 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c258f-82cb-40e4-8247-18665f474876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:16.416599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a17ca648b904206a6fcd48d03d2b883', 'request_id': 'req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:16.424882 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:16.432841 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e admin admin] The token cache is being invalidate because project 1a17ca648b904206a6fcd48d03d2b883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:16.441123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a67c258f-82cb-40e4-8247-18665f474876 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:16.442354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a67c258f-82cb-40e4-8247-18665f474876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:16.443541 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:16.444615 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:16.455821 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1006/2033] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:16 2022] DELETE /identity/v3/projects/1a17ca648b904206a6fcd48d03d2b883 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:16.456805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:16.459248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:16.535983 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1028/2034] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:16.536909 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fcfc5-e366-4ba7-96a5-b80505e61c9e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:16.537567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc082911-1f63-4c8c-a704-8b80901da724 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:16.537860 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc082911-1f63-4c8c-a704-8b80901da724 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:16.538135 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc082911-1f63-4c8c-a704-8b80901da724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:16.545722 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaadfa3-b830-4686-a2a9-45e0254ccf4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:16.546413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaadfa3-b830-4686-a2a9-45e0254ccf4b service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:16.546700 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaadfa3-b830-4686-a2a9-45e0254ccf4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:16.546986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaadfa3-b830-4686-a2a9-45e0254ccf4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:16.549179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-beaadfa3-b830-4686-a2a9-45e0254ccf4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:16.564928 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fc082911-1f63-4c8c-a704-8b80901da724 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:16.566894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fc082911-1f63-4c8c-a704-8b80901da724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:16.567834 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaadfa3-b830-4686-a2a9-45e0254ccf4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:16.569375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaadfa3-b830-4686-a2a9-45e0254ccf4b service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:16.577071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1029/2035] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:16.578041 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc082911-1f63-4c8c-a704-8b80901da724 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:16.590216 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc082911-1f63-4c8c-a704-8b80901da724 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:16.595978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cfb06-5b7d-4138-85e7-e13dfc80bcf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:16.596835 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cfb06-5b7d-4138-85e7-e13dfc80bcf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:16.597210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cfb06-5b7d-4138-85e7-e13dfc80bcf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:16.597554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cfb06-5b7d-4138-85e7-e13dfc80bcf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:16.601195 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1007/2036] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:16.602990 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ba85e-a4c1-490b-850d-f0b06fdd84ce None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:16.603180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ba85e-a4c1-490b-850d-f0b06fdd84ce None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:16.603416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ba85e-a4c1-490b-850d-f0b06fdd84ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:16.610323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cfb06-5b7d-4138-85e7-e13dfc80bcf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:16.613561 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cfb06-5b7d-4138-85e7-e13dfc80bcf2 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:16.630278 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1030/2037] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:16.650257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-dd5ba85e-a4c1-490b-850d-f0b06fdd84ce None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:16.652532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-dd5ba85e-a4c1-490b-850d-f0b06fdd84ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:16.670443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1008/2038] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:16.671797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cfb06-5b7d-4138-85e7-e13dfc80bcf2 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:16.687922 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cfb06-5b7d-4138-85e7-e13dfc80bcf2 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:16.695773 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76367e18-98ec-4c6d-bfb9-af78d337b029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:16.696581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76367e18-98ec-4c6d-bfb9-af78d337b029 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:16.697046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76367e18-98ec-4c6d-bfb9-af78d337b029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:16.697351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76367e18-98ec-4c6d-bfb9-af78d337b029 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:16.698210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76367e18-98ec-4c6d-bfb9-af78d337b029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:16.698572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76367e18-98ec-4c6d-bfb9-af78d337b029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:16.701252 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76367e18-98ec-4c6d-bfb9-af78d337b029 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:16.730160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1031/2039] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:31:16.733848 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ba85e-a4c1-490b-850d-f0b06fdd84ce None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:16.744528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ba85e-a4c1-490b-850d-f0b06fdd84ce None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:16.750869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c838fb5-1f71-458a-b57c-293b643e910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:16.751563 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c838fb5-1f71-458a-b57c-293b643e910e admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:16.751913 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c838fb5-1f71-458a-b57c-293b643e910e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:16.752246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c838fb5-1f71-458a-b57c-293b643e910e admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:16.752875 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c838fb5-1f71-458a-b57c-293b643e910e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:16.754980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c838fb5-1f71-458a-b57c-293b643e910e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:16.805659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1009/2040] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:16 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:31:16.806466 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76367e18-98ec-4c6d-bfb9-af78d337b029 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:16.819717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76367e18-98ec-4c6d-bfb9-af78d337b029 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:16.921643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43877b56-2823-4c6b-ade1-88d75608d65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:16.938611 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43877b56-2823-4c6b-ade1-88d75608d65a admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:16.939329 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43877b56-2823-4c6b-ade1-88d75608d65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:16.941765 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43877b56-2823-4c6b-ade1-88d75608d65a admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:16.942843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43877b56-2823-4c6b-ade1-88d75608d65a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:16.947633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43877b56-2823-4c6b-ade1-88d75608d65a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:16.994274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1032/2041] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:16 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:31:16.995999 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c838fb5-1f71-458a-b57c-293b643e910e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:17.008025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c838fb5-1f71-458a-b57c-293b643e910e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:17.029243 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea4e8c-e843-4aaa-9fc5-bd0af4b29d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:17.029947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea4e8c-e843-4aaa-9fc5-bd0af4b29d09 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:17.030608 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea4e8c-e843-4aaa-9fc5-bd0af4b29d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:17.030608 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea4e8c-e843-4aaa-9fc5-bd0af4b29d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:17.031478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea4e8c-e843-4aaa-9fc5-bd0af4b29d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:17.032926 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea4e8c-e843-4aaa-9fc5-bd0af4b29d09 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:17.046740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1010/2042] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:17.051318 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43877b56-2823-4c6b-ade1-88d75608d65a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:17.063429 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43877b56-2823-4c6b-ade1-88d75608d65a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:17.072087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35402d4-1814-4b95-a5df-eceb44434789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:17.075635 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35402d4-1814-4b95-a5df-eceb44434789 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:17.076065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35402d4-1814-4b95-a5df-eceb44434789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:17.076437 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35402d4-1814-4b95-a5df-eceb44434789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:17.077317 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35402d4-1814-4b95-a5df-eceb44434789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:17.079053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35402d4-1814-4b95-a5df-eceb44434789 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:17.114565 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1033/2043] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:31:17.119350 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea4e8c-e843-4aaa-9fc5-bd0af4b29d09 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:17.130598 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea4e8c-e843-4aaa-9fc5-bd0af4b29d09 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:17.136710 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a68b2-b19f-4b98-93e4-1eae0870e146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:17.137886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a68b2-b19f-4b98-93e4-1eae0870e146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:17.138481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a68b2-b19f-4b98-93e4-1eae0870e146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:17.138937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a68b2-b19f-4b98-93e4-1eae0870e146 admin admin] PATH_INFO: `/v3/projects/d71b28dd07494531890d55975e742530/users/a2bf981796a44c9196b98c2a196a044a/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:17.145324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35402d4-1814-4b95-a5df-eceb44434789 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:17.147544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c35402d4-1814-4b95-a5df-eceb44434789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:17.170646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35402d4-1814-4b95-a5df-eceb44434789 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:17.180623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a68b2-b19f-4b98-93e4-1eae0870e146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71b28dd07494531890d55975e742530, user_id=a2bf981796a44c9196b98c2a196a044a, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:17.184237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3947f-2e3e-42cb-9874-f57764a1b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:17.185773 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3947f-2e3e-42cb-9874-f57764a1b7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:17.186097 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3947f-2e3e-42cb-9874-f57764a1b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:17.186381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3947f-2e3e-42cb-9874-f57764a1b7e4 admin admin] PATH_INFO: `/v3/projects/2400f188a2fe4bcebabe04d38cb093b9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:17.188294 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a68b2-b19f-4b98-93e4-1eae0870e146 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:17.191580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3947f-2e3e-42cb-9874-f57764a1b7e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2400f188a2fe4bcebabe04d38cb093b9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:17.193556 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3947f-2e3e-42cb-9874-f57764a1b7e4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:17.217664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1011/2044] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:17 2022] PUT /identity/v3/projects/d71b28dd07494531890d55975e742530/users/a2bf981796a44c9196b98c2a196a044a/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:31:17.230169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f52c2-f158-45e0-a103-75c4bc015a22 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:17.230457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f52c2-f158-45e0-a103-75c4bc015a22 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:17.231258 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f52c2-f158-45e0-a103-75c4bc015a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:17.285465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-425f52c2-f158-45e0-a103-75c4bc015a22 None None] MFA Rules not processed for user `a2bf981796a44c9196b98c2a196a044a`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:17.286740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-425f52c2-f158-45e0-a103-75c4bc015a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:17.307550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:17.312228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-61f3947f-2e3e-42cb-9874-f57764a1b7e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2400f188a2fe4bcebabe04d38cb093b9', 'request_id': 'req-61f3947f-2e3e-42cb-9874-f57764a1b7e4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:17.320762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:17.321687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-61f3947f-2e3e-42cb-9874-f57764a1b7e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2400f188a2fe4bcebabe04d38cb093b9', 'request_id': 'req-61f3947f-2e3e-42cb-9874-f57764a1b7e4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:17.331524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-61f3947f-2e3e-42cb-9874-f57764a1b7e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2400f188a2fe4bcebabe04d38cb093b9', 'request_id': 'req-61f3947f-2e3e-42cb-9874-f57764a1b7e4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:17.366224 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-61f3947f-2e3e-42cb-9874-f57764a1b7e4 admin admin] The token cache is being invalidate because project 2400f188a2fe4bcebabe04d38cb093b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:17.366594 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-61f3947f-2e3e-42cb-9874-f57764a1b7e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:17.369437 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-61f3947f-2e3e-42cb-9874-f57764a1b7e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:17.371110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1034/2045] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:17 2022] DELETE /identity/v3/projects/2400f188a2fe4bcebabe04d38cb093b9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:31:17.374087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3947f-2e3e-42cb-9874-f57764a1b7e4 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:17.375903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-61f3947f-2e3e-42cb-9874-f57764a1b7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:17.378794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1012/2046] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:17.379776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f52c2-f158-45e0-a103-75c4bc015a22 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:17.488889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3947f-2e3e-42cb-9874-f57764a1b7e4 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:17.496347 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f998ba9-a7ac-4b51-82e0-64db572f1da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:17.498064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f998ba9-a7ac-4b51-82e0-64db572f1da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:17.498359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f998ba9-a7ac-4b51-82e0-64db572f1da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:17.498634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f998ba9-a7ac-4b51-82e0-64db572f1da2 admin admin] PATH_INFO: `/v3/projects/f152eebe307d4c5fb353b1c36efd01d3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:17.500335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f998ba9-a7ac-4b51-82e0-64db572f1da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f152eebe307d4c5fb353b1c36efd01d3)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:17.501056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f52c2-f158-45e0-a103-75c4bc015a22 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:17.502965 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f998ba9-a7ac-4b51-82e0-64db572f1da2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:17.511501 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a42c92-a94c-4a47-89ff-1dac31a846ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:17.515183 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a42c92-a94c-4a47-89ff-1dac31a846ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:17.515461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a42c92-a94c-4a47-89ff-1dac31a846ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:17.531962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a42c92-a94c-4a47-89ff-1dac31a846ad admin admin] PATH_INFO: `/v3/users/ad225d59197e4066a06d7cb42d0f4e68` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:17.534636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a42c92-a94c-4a47-89ff-1dac31a846ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad225d59197e4066a06d7cb42d0f4e68)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:17.536678 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a42c92-a94c-4a47-89ff-1dac31a846ad admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:17.595488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1f998ba9-a7ac-4b51-82e0-64db572f1da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f152eebe307d4c5fb353b1c36efd01d3', 'request_id': 'req-1f998ba9-a7ac-4b51-82e0-64db572f1da2'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:17.607375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1f998ba9-a7ac-4b51-82e0-64db572f1da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f152eebe307d4c5fb353b1c36efd01d3', 'request_id': 'req-1f998ba9-a7ac-4b51-82e0-64db572f1da2'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:17.621052 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a4a42c92-a94c-4a47-89ff-1dac31a846ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad225d59197e4066a06d7cb42d0f4e68'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:17.634267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1f998ba9-a7ac-4b51-82e0-64db572f1da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f152eebe307d4c5fb353b1c36efd01d3', 'request_id': 'req-1f998ba9-a7ac-4b51-82e0-64db572f1da2'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:17.639012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a4a42c92-a94c-4a47-89ff-1dac31a846ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad225d59197e4066a06d7cb42d0f4e68'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:17.639944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a4a42c92-a94c-4a47-89ff-1dac31a846ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad225d59197e4066a06d7cb42d0f4e68'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:17.640793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a4a42c92-a94c-4a47-89ff-1dac31a846ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad225d59197e4066a06d7cb42d0f4e68'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:17.650783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a4a42c92-a94c-4a47-89ff-1dac31a846ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad225d59197e4066a06d7cb42d0f4e68'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:17.656698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1f998ba9-a7ac-4b51-82e0-64db572f1da2 admin admin] The token cache is being invalidate because project f152eebe307d4c5fb353b1c36efd01d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:17.658143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1f998ba9-a7ac-4b51-82e0-64db572f1da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:17.658143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1f998ba9-a7ac-4b51-82e0-64db572f1da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:17.661589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1035/2047] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:17 2022] DELETE /identity/v3/projects/f152eebe307d4c5fb353b1c36efd01d3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:17.671724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f998ba9-a7ac-4b51-82e0-64db572f1da2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:17.677293 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1013/2048] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:17 2022] DELETE /identity/v3/users/ad225d59197e4066a06d7cb42d0f4e68 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:17.678178 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1f998ba9-a7ac-4b51-82e0-64db572f1da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:17.680320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a42c92-a94c-4a47-89ff-1dac31a846ad admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:17.690240 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a4a42c92-a94c-4a47-89ff-1dac31a846ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:17.820333 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f998ba9-a7ac-4b51-82e0-64db572f1da2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:17.833507 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:17.880256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:17.922637 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a42c92-a94c-4a47-89ff-1dac31a846ad admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:17.936674 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd4284-2ecc-40eb-8fda-b4b3c7c453db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:17.937718 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd4284-2ecc-40eb-8fda-b4b3c7c453db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:17.938004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd4284-2ecc-40eb-8fda-b4b3c7c453db admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:17.938278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd4284-2ecc-40eb-8fda-b4b3c7c453db admin admin] PATH_INFO: `/v3/users/872198c08caa42c1b2b674dcaa015007` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:17.941583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd4284-2ecc-40eb-8fda-b4b3c7c453db admin admin] RBAC: Authorizing `identity:delete_user(user_id=872198c08caa42c1b2b674dcaa015007)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:17.947233 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd4284-2ecc-40eb-8fda-b4b3c7c453db admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:17.951260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826e71e-0c89-4a0d-9d6a-9cdd7855add9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:17.952955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826e71e-0c89-4a0d-9d6a-9cdd7855add9 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:17.953773 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826e71e-0c89-4a0d-9d6a-9cdd7855add9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:17.955187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826e71e-0c89-4a0d-9d6a-9cdd7855add9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:17.956732 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826e71e-0c89-4a0d-9d6a-9cdd7855add9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:17.963452 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826e71e-0c89-4a0d-9d6a-9cdd7855add9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:18.016932 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1036/2049] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:17 2022] POST /identity/v3/projects => generated 367 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:18.017881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826e71e-0c89-4a0d-9d6a-9cdd7855add9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:18.022940 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3826e71e-0c89-4a0d-9d6a-9cdd7855add9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.031550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e0cd4284-2ecc-40eb-8fda-b4b3c7c453db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872198c08caa42c1b2b674dcaa015007'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.048877 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e0cd4284-2ecc-40eb-8fda-b4b3c7c453db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872198c08caa42c1b2b674dcaa015007'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.052509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e0cd4284-2ecc-40eb-8fda-b4b3c7c453db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872198c08caa42c1b2b674dcaa015007'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.053866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e0cd4284-2ecc-40eb-8fda-b4b3c7c453db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872198c08caa42c1b2b674dcaa015007'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.063245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e0cd4284-2ecc-40eb-8fda-b4b3c7c453db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872198c08caa42c1b2b674dcaa015007'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.081298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1014/2050] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:17 2022] DELETE /identity/v3/users/872198c08caa42c1b2b674dcaa015007 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:18.084924 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd4284-2ecc-40eb-8fda-b4b3c7c453db admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:18.084924 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e0cd4284-2ecc-40eb-8fda-b4b3c7c453db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.108989 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826e71e-0c89-4a0d-9d6a-9cdd7855add9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:18.177358 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89434ba-0fcb-461d-aacf-6f44d98544e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:18.178272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89434ba-0fcb-461d-aacf-6f44d98544e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.178565 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89434ba-0fcb-461d-aacf-6f44d98544e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.178979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89434ba-0fcb-461d-aacf-6f44d98544e8 admin admin] PATH_INFO: `/v3/users/a62fbd909c4a4d6e9ad6d9ad2722a3e0` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.180750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89434ba-0fcb-461d-aacf-6f44d98544e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a62fbd909c4a4d6e9ad6d9ad2722a3e0)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:18.183138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89434ba-0fcb-461d-aacf-6f44d98544e8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:18.200337 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd4284-2ecc-40eb-8fda-b4b3c7c453db admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:18.205998 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf935823-290a-49d0-857c-313585159ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:18.206737 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf935823-290a-49d0-857c-313585159ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.207026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf935823-290a-49d0-857c-313585159ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.207303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf935823-290a-49d0-857c-313585159ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.208103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf935823-290a-49d0-857c-313585159ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:18.210257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf935823-290a-49d0-857c-313585159ff1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:18.236062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1015/2051] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:18 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:18.237745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf935823-290a-49d0-857c-313585159ff1 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:18.240930 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cf935823-290a-49d0-857c-313585159ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.251938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:18.255997 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf935823-290a-49d0-857c-313585159ff1 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:18.256524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e89434ba-0fcb-461d-aacf-6f44d98544e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a62fbd909c4a4d6e9ad6d9ad2722a3e0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.258344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e89434ba-0fcb-461d-aacf-6f44d98544e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a62fbd909c4a4d6e9ad6d9ad2722a3e0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.259260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e89434ba-0fcb-461d-aacf-6f44d98544e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a62fbd909c4a4d6e9ad6d9ad2722a3e0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.264763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecfbb2-a7ca-4cd4-b1d8-efaf00c58b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:18.265557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecfbb2-a7ca-4cd4-b1d8-efaf00c58b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.266130 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecfbb2-a7ca-4cd4-b1d8-efaf00c58b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.266338 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecfbb2-a7ca-4cd4-b1d8-efaf00c58b07 admin admin] PATH_INFO: `/v3/projects/a2b465cd37b548fd9794992cef4aeb19` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.268514 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecfbb2-a7ca-4cd4-b1d8-efaf00c58b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b465cd37b548fd9794992cef4aeb19)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:18.272689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e89434ba-0fcb-461d-aacf-6f44d98544e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a62fbd909c4a4d6e9ad6d9ad2722a3e0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.275971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecfbb2-a7ca-4cd4-b1d8-efaf00c58b07 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:18.285925 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e89434ba-0fcb-461d-aacf-6f44d98544e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a62fbd909c4a4d6e9ad6d9ad2722a3e0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.311747 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1037/2052] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:18 2022] DELETE /identity/v3/users/a62fbd909c4a4d6e9ad6d9ad2722a3e0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:18.313123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89434ba-0fcb-461d-aacf-6f44d98544e8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:18.314153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e89434ba-0fcb-461d-aacf-6f44d98544e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.345357 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c6ecfbb2-a7ca-4cd4-b1d8-efaf00c58b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b465cd37b548fd9794992cef4aeb19', 'request_id': 'req-c6ecfbb2-a7ca-4cd4-b1d8-efaf00c58b07'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.350286 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:18.359698 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c6ecfbb2-a7ca-4cd4-b1d8-efaf00c58b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b465cd37b548fd9794992cef4aeb19', 'request_id': 'req-c6ecfbb2-a7ca-4cd4-b1d8-efaf00c58b07'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.374447 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c6ecfbb2-a7ca-4cd4-b1d8-efaf00c58b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b465cd37b548fd9794992cef4aeb19', 'request_id': 'req-c6ecfbb2-a7ca-4cd4-b1d8-efaf00c58b07'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.391964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c6ecfbb2-a7ca-4cd4-b1d8-efaf00c58b07 admin admin] The token cache is being invalidate because project a2b465cd37b548fd9794992cef4aeb19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:18.392453 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c6ecfbb2-a7ca-4cd4-b1d8-efaf00c58b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.393316 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c6ecfbb2-a7ca-4cd4-b1d8-efaf00c58b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.395944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1016/2053] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:18 2022] DELETE /identity/v3/projects/a2b465cd37b548fd9794992cef4aeb19 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:18.401471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991749fc-b981-4a14-af10-ae0c8ae176a1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.401955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991749fc-b981-4a14-af10-ae0c8ae176a1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.402420 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991749fc-b981-4a14-af10-ae0c8ae176a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.404929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89434ba-0fcb-461d-aacf-6f44d98544e8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:18.425504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-991749fc-b981-4a14-af10-ae0c8ae176a1 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:18.427415 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-991749fc-b981-4a14-af10-ae0c8ae176a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.502403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b8b81-a595-4b87-b333-5b85357c785d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:18.503579 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b8b81-a595-4b87-b333-5b85357c785d admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.503886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b8b81-a595-4b87-b333-5b85357c785d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.504147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b8b81-a595-4b87-b333-5b85357c785d admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.504899 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b8b81-a595-4b87-b333-5b85357c785d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:18.506672 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b8b81-a595-4b87-b333-5b85357c785d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:18.518366 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1038/2054] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:18.520990 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287a8ea-26c2-485b-962e-8275acb67455 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.521274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287a8ea-26c2-485b-962e-8275acb67455 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.521555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287a8ea-26c2-485b-962e-8275acb67455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.523915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1017/2055] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:18.525475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991749fc-b981-4a14-af10-ae0c8ae176a1 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:18.527580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-991749fc-b981-4a14-af10-ae0c8ae176a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.541203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991749fc-b981-4a14-af10-ae0c8ae176a1 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:18.547506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b9a0a-1bd3-45ec-a1a2-57f36a7147e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:18.548428 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b9a0a-1bd3-45ec-a1a2-57f36a7147e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.548570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3287a8ea-26c2-485b-962e-8275acb67455 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:18.548705 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b9a0a-1bd3-45ec-a1a2-57f36a7147e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.548999 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b9a0a-1bd3-45ec-a1a2-57f36a7147e9 admin admin] PATH_INFO: `/v3/projects/502492dc5598473cbbfbaf9c39aac181` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.549670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3287a8ea-26c2-485b-962e-8275acb67455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.550180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b9a0a-1bd3-45ec-a1a2-57f36a7147e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=502492dc5598473cbbfbaf9c39aac181)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:18.552134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b9a0a-1bd3-45ec-a1a2-57f36a7147e9 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:18.571782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1039/2056] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:18.573053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287a8ea-26c2-485b-962e-8275acb67455 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:18.574755 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3287a8ea-26c2-485b-962e-8275acb67455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.587443 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287a8ea-26c2-485b-962e-8275acb67455 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:18.592745 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69364923-c39a-4338-acbe-cf34b5d0bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:18.593649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69364923-c39a-4338-acbe-cf34b5d0bf3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.594053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69364923-c39a-4338-acbe-cf34b5d0bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.594335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69364923-c39a-4338-acbe-cf34b5d0bf3b admin admin] PATH_INFO: `/v3/projects/7207fef1a2c44dd895207b34410069f7/users/571d225b2db942969c837bd831198a1f/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.607003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-967b9a0a-1bd3-45ec-a1a2-57f36a7147e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502492dc5598473cbbfbaf9c39aac181', 'request_id': 'req-967b9a0a-1bd3-45ec-a1a2-57f36a7147e9'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.610058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69364923-c39a-4338-acbe-cf34b5d0bf3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7207fef1a2c44dd895207b34410069f7, user_id=571d225b2db942969c837bd831198a1f, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:18.612958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69364923-c39a-4338-acbe-cf34b5d0bf3b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:18.613328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-967b9a0a-1bd3-45ec-a1a2-57f36a7147e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502492dc5598473cbbfbaf9c39aac181', 'request_id': 'req-967b9a0a-1bd3-45ec-a1a2-57f36a7147e9'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.623981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-967b9a0a-1bd3-45ec-a1a2-57f36a7147e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502492dc5598473cbbfbaf9c39aac181', 'request_id': 'req-967b9a0a-1bd3-45ec-a1a2-57f36a7147e9'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.629664 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1040/2057] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:18 2022] PUT /identity/v3/projects/7207fef1a2c44dd895207b34410069f7/users/571d225b2db942969c837bd831198a1f/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:18.630657 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69364923-c39a-4338-acbe-cf34b5d0bf3b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:18.632471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-69364923-c39a-4338-acbe-cf34b5d0bf3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.637278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-967b9a0a-1bd3-45ec-a1a2-57f36a7147e9 admin admin] The token cache is being invalidate because project 502492dc5598473cbbfbaf9c39aac181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:18.637561 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-967b9a0a-1bd3-45ec-a1a2-57f36a7147e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.638224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-967b9a0a-1bd3-45ec-a1a2-57f36a7147e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.640061 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1018/2058] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:18 2022] DELETE /identity/v3/projects/502492dc5598473cbbfbaf9c39aac181 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:18.641214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638073a-c8a2-4df3-a59e-ad0390641cf0 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.641522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638073a-c8a2-4df3-a59e-ad0390641cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.641800 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638073a-c8a2-4df3-a59e-ad0390641cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.661777 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3638073a-c8a2-4df3-a59e-ad0390641cf0 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:18.662995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3638073a-c8a2-4df3-a59e-ad0390641cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.672368 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:18.697419 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69364923-c39a-4338-acbe-cf34b5d0bf3b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:18.701449 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892b5cc-1716-48be-815f-81abacdbe6f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:18.702142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892b5cc-1716-48be-815f-81abacdbe6f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.702424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892b5cc-1716-48be-815f-81abacdbe6f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.702698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892b5cc-1716-48be-815f-81abacdbe6f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.704923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0892b5cc-1716-48be-815f-81abacdbe6f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.723667 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1019/2059] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:18.724431 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638073a-c8a2-4df3-a59e-ad0390641cf0 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:18.725748 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3638073a-c8a2-4df3-a59e-ad0390641cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.732690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:18.739480 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638073a-c8a2-4df3-a59e-ad0390641cf0 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:18.745156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11e038-1587-4818-9442-c7e57bb6a01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:18.745894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11e038-1587-4818-9442-c7e57bb6a01e admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.746131 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11e038-1587-4818-9442-c7e57bb6a01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.746409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11e038-1587-4818-9442-c7e57bb6a01e admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.747202 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11e038-1587-4818-9442-c7e57bb6a01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:18.749165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11e038-1587-4818-9442-c7e57bb6a01e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:18.765666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1020/2060] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:18.765666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11e038-1587-4818-9442-c7e57bb6a01e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:18.766147 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1e11e038-1587-4818-9442-c7e57bb6a01e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.780092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892b5cc-1716-48be-815f-81abacdbe6f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:18.780794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11e038-1587-4818-9442-c7e57bb6a01e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:18.781658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892b5cc-1716-48be-815f-81abacdbe6f7 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:18.786007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c722186-7262-4ed4-a6a9-ed21913fa98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:18.787055 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c722186-7262-4ed4-a6a9-ed21913fa98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.787632 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c722186-7262-4ed4-a6a9-ed21913fa98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.787946 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c722186-7262-4ed4-a6a9-ed21913fa98c admin admin] PATH_INFO: `/v3/users/179fb211a164410491679b13e9b92e6d` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.789065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c722186-7262-4ed4-a6a9-ed21913fa98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=179fb211a164410491679b13e9b92e6d)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:18.790994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c722186-7262-4ed4-a6a9-ed21913fa98c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:18.793257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1041/2061] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:18.794066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892b5cc-1716-48be-815f-81abacdbe6f7 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:18.809323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892b5cc-1716-48be-815f-81abacdbe6f7 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:18.835238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd682eeb-0741-4ba2-b1aa-1ae40e96b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:18.836361 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd682eeb-0741-4ba2-b1aa-1ae40e96b9fb admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.836801 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd682eeb-0741-4ba2-b1aa-1ae40e96b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.836970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd682eeb-0741-4ba2-b1aa-1ae40e96b9fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.837862 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd682eeb-0741-4ba2-b1aa-1ae40e96b9fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:18.838173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd682eeb-0741-4ba2-b1aa-1ae40e96b9fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:18.840259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd682eeb-0741-4ba2-b1aa-1ae40e96b9fb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:18.855652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1042/2062] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:18.856913 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd682eeb-0741-4ba2-b1aa-1ae40e96b9fb admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:18.868829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4c722186-7262-4ed4-a6a9-ed21913fa98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '179fb211a164410491679b13e9b92e6d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.872789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd682eeb-0741-4ba2-b1aa-1ae40e96b9fb admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:18.879666 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c266d-7681-43f4-adef-149486c5954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:18.880883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c266d-7681-43f4-adef-149486c5954e admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.881388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c266d-7681-43f4-adef-149486c5954e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.881891 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c266d-7681-43f4-adef-149486c5954e admin admin] PATH_INFO: `/v3/projects/7207fef1a2c44dd895207b34410069f7/users/571d225b2db942969c837bd831198a1f/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.885123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c266d-7681-43f4-adef-149486c5954e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7207fef1a2c44dd895207b34410069f7, user_id=571d225b2db942969c837bd831198a1f, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:18.885592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4c722186-7262-4ed4-a6a9-ed21913fa98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '179fb211a164410491679b13e9b92e6d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.886325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4c722186-7262-4ed4-a6a9-ed21913fa98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '179fb211a164410491679b13e9b92e6d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.886983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4c722186-7262-4ed4-a6a9-ed21913fa98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '179fb211a164410491679b13e9b92e6d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.888278 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c266d-7681-43f4-adef-149486c5954e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:18.896590 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4c722186-7262-4ed4-a6a9-ed21913fa98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '179fb211a164410491679b13e9b92e6d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:18.901400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1043/2063] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:18 2022] PUT /identity/v3/projects/7207fef1a2c44dd895207b34410069f7/users/571d225b2db942969c837bd831198a1f/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:18.902301 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c266d-7681-43f4-adef-149486c5954e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:18.909470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-817c266d-7681-43f4-adef-149486c5954e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.922658 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1021/2064] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:18 2022] DELETE /identity/v3/users/179fb211a164410491679b13e9b92e6d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:18.924691 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6087-b418-4a36-b6c4-b16713ba1d36 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.925073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6087-b418-4a36-b6c4-b16713ba1d36 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.925604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6087-b418-4a36-b6c4-b16713ba1d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.960229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0bdb6087-b418-4a36-b6c4-b16713ba1d36 None None] MFA Rules not processed for user `571d225b2db942969c837bd831198a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:18.962094 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0bdb6087-b418-4a36-b6c4-b16713ba1d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:19.085558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1022/2065] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:19.086590 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb6087-b418-4a36-b6c4-b16713ba1d36 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:19.088468 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0bdb6087-b418-4a36-b6c4-b16713ba1d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:19.114818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c266d-7681-43f4-adef-149486c5954e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:19.171051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:19.203669 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb6087-b418-4a36-b6c4-b16713ba1d36 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:19.233443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edfd58-ad1a-49a2-b562-3be6651beb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:19.234365 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edfd58-ad1a-49a2-b562-3be6651beb1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:19.234647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edfd58-ad1a-49a2-b562-3be6651beb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:19.234923 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edfd58-ad1a-49a2-b562-3be6651beb1b admin admin] PATH_INFO: `/v3/users/4513bb6051814408a40a71f314bd9ff4` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:19.237451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edfd58-ad1a-49a2-b562-3be6651beb1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4513bb6051814408a40a71f314bd9ff4)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:19.239560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edfd58-ad1a-49a2-b562-3be6651beb1b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:19.277487 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c9149-bb98-4091-bcf2-bc965974f76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:19.278427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c9149-bb98-4091-bcf2-bc965974f76e admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:19.278963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c9149-bb98-4091-bcf2-bc965974f76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:19.279157 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c9149-bb98-4091-bcf2-bc965974f76e admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:19.280104 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c9149-bb98-4091-bcf2-bc965974f76e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:19.282578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c9149-bb98-4091-bcf2-bc965974f76e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:19.294954 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:19.320066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1044/2066] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:18 2022] POST /identity/v3/projects => generated 369 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:19.322155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c9149-bb98-4091-bcf2-bc965974f76e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:19.325405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0b8c9149-bb98-4091-bcf2-bc965974f76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:19.335366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-62edfd58-ad1a-49a2-b562-3be6651beb1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4513bb6051814408a40a71f314bd9ff4'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.354513 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-62edfd58-ad1a-49a2-b562-3be6651beb1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4513bb6051814408a40a71f314bd9ff4'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.355366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-62edfd58-ad1a-49a2-b562-3be6651beb1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4513bb6051814408a40a71f314bd9ff4'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.356301 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-62edfd58-ad1a-49a2-b562-3be6651beb1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4513bb6051814408a40a71f314bd9ff4'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.365718 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-62edfd58-ad1a-49a2-b562-3be6651beb1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4513bb6051814408a40a71f314bd9ff4'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.385633 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1023/2067] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:19 2022] DELETE /identity/v3/users/4513bb6051814408a40a71f314bd9ff4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:19.386647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edfd58-ad1a-49a2-b562-3be6651beb1b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:19.388113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-62edfd58-ad1a-49a2-b562-3be6651beb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:19.415521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c9149-bb98-4091-bcf2-bc965974f76e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:19.471589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dc527-8478-4ccc-94c7-9532c6a9492b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:19.472315 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dc527-8478-4ccc-94c7-9532c6a9492b service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:19.472597 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dc527-8478-4ccc-94c7-9532c6a9492b service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:19.472872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dc527-8478-4ccc-94c7-9532c6a9492b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:19.474090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edfd58-ad1a-49a2-b562-3be6651beb1b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:19.475025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-006dc527-8478-4ccc-94c7-9532c6a9492b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:19.479054 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e727be-92c7-4ee0-8aa0-591cbf504660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:19.480015 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e727be-92c7-4ee0-8aa0-591cbf504660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:19.480249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e727be-92c7-4ee0-8aa0-591cbf504660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:19.480632 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e727be-92c7-4ee0-8aa0-591cbf504660 admin admin] PATH_INFO: `/v3/projects/20c6f5a2cf1e46c7803efbb75467d14c` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:19.481952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e727be-92c7-4ee0-8aa0-591cbf504660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c6f5a2cf1e46c7803efbb75467d14c)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:19.483911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e727be-92c7-4ee0-8aa0-591cbf504660 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:19.547041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-99e727be-92c7-4ee0-8aa0-591cbf504660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c6f5a2cf1e46c7803efbb75467d14c', 'request_id': 'req-99e727be-92c7-4ee0-8aa0-591cbf504660'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.554211 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-99e727be-92c7-4ee0-8aa0-591cbf504660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c6f5a2cf1e46c7803efbb75467d14c', 'request_id': 'req-99e727be-92c7-4ee0-8aa0-591cbf504660'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.558795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006dc527-8478-4ccc-94c7-9532c6a9492b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:19.560984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006dc527-8478-4ccc-94c7-9532c6a9492b service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:19.563484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-99e727be-92c7-4ee0-8aa0-591cbf504660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c6f5a2cf1e46c7803efbb75467d14c', 'request_id': 'req-99e727be-92c7-4ee0-8aa0-591cbf504660'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.572613 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:19.573239 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1045/2068] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:19 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:19.574162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dc527-8478-4ccc-94c7-9532c6a9492b service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:19.575753 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-006dc527-8478-4ccc-94c7-9532c6a9492b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:19.578971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-99e727be-92c7-4ee0-8aa0-591cbf504660 admin admin] The token cache is being invalidate because project 20c6f5a2cf1e46c7803efbb75467d14c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:19.580163 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-99e727be-92c7-4ee0-8aa0-591cbf504660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.581398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-99e727be-92c7-4ee0-8aa0-591cbf504660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.583548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1024/2069] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:19 2022] DELETE /identity/v3/projects/20c6f5a2cf1e46c7803efbb75467d14c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:19.588376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e727be-92c7-4ee0-8aa0-591cbf504660 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:19.594843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-99e727be-92c7-4ee0-8aa0-591cbf504660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:19.607787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dc527-8478-4ccc-94c7-9532c6a9492b service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:19.680631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:19.691230 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ec9eb-469a-42a6-a3ff-5b58dffd9a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:19.692072 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ec9eb-469a-42a6-a3ff-5b58dffd9a39 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:19.692661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ec9eb-469a-42a6-a3ff-5b58dffd9a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:19.696022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ec9eb-469a-42a6-a3ff-5b58dffd9a39 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:19.696766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ec9eb-469a-42a6-a3ff-5b58dffd9a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:19.696865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e727be-92c7-4ee0-8aa0-591cbf504660 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:19.698713 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ec9eb-469a-42a6-a3ff-5b58dffd9a39 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:19.703670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:19.704706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:19.705348 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:19.705635 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f admin admin] PATH_INFO: `/v3/projects/cf8ad99e587c4776a679da002d574a4f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:19.707630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf8ad99e587c4776a679da002d574a4f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:19.710518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:19.724121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1046/2070] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:19 2022] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:19.724121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d29b-50ca-4895-9d5e-955ff65f82d1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:19.724121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d29b-50ca-4895-9d5e-955ff65f82d1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:19.724121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d29b-50ca-4895-9d5e-955ff65f82d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:19.741144 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-40e7d29b-50ca-4895-9d5e-955ff65f82d1 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:19.742787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-40e7d29b-50ca-4895-9d5e-955ff65f82d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:19.751687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1047/2071] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:19.752537 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7d29b-50ca-4895-9d5e-955ff65f82d1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:19.754131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-40e7d29b-50ca-4895-9d5e-955ff65f82d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:19.766365 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf8ad99e587c4776a679da002d574a4f', 'request_id': 'req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.766547 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7d29b-50ca-4895-9d5e-955ff65f82d1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:19.772600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf8ad99e587c4776a679da002d574a4f', 'request_id': 'req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.781578 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf8ad99e587c4776a679da002d574a4f', 'request_id': 'req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.791909 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f admin admin] The token cache is being invalidate because project cf8ad99e587c4776a679da002d574a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:19.792200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.792847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.794817 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1025/2072] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:19 2022] DELETE /identity/v3/projects/cf8ad99e587c4776a679da002d574a4f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:19.795847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:19.797304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:19.825262 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ac2e2-070f-468c-b72d-b40d4a86144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:19.826337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ac2e2-070f-468c-b72d-b40d4a86144a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:19.826621 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ac2e2-070f-468c-b72d-b40d4a86144a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:19.826901 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ac2e2-070f-468c-b72d-b40d4a86144a admin admin] PATH_INFO: `/v3/users/1d1ca395287b4efb86bff6bf5a1dc49e` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:19.828158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ac2e2-070f-468c-b72d-b40d4a86144a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d1ca395287b4efb86bff6bf5a1dc49e)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:19.830136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ac2e2-070f-468c-b72d-b40d4a86144a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:19.855197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69bdc0-87d2-4ef3-be6f-8094b156c08f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:19.859256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753d2f8-7779-49e6-93c2-f8b4b510cf2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:19.859947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753d2f8-7779-49e6-93c2-f8b4b510cf2e service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:19.860227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753d2f8-7779-49e6-93c2-f8b4b510cf2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:19.860509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753d2f8-7779-49e6-93c2-f8b4b510cf2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:19.862549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a753d2f8-7779-49e6-93c2-f8b4b510cf2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:19.880392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9e0ac2e2-070f-468c-b72d-b40d4a86144a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d1ca395287b4efb86bff6bf5a1dc49e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.881128 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9e0ac2e2-070f-468c-b72d-b40d4a86144a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d1ca395287b4efb86bff6bf5a1dc49e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.881802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9e0ac2e2-070f-468c-b72d-b40d4a86144a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d1ca395287b4efb86bff6bf5a1dc49e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.889052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9e0ac2e2-070f-468c-b72d-b40d4a86144a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d1ca395287b4efb86bff6bf5a1dc49e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.898905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9e0ac2e2-070f-468c-b72d-b40d4a86144a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d1ca395287b4efb86bff6bf5a1dc49e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:19.908094 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:19.918842 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1048/2073] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:19 2022] DELETE /identity/v3/users/1d1ca395287b4efb86bff6bf5a1dc49e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:19.919822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ac2e2-070f-468c-b72d-b40d4a86144a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:19.921223 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9e0ac2e2-070f-468c-b72d-b40d4a86144a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:19.929282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753d2f8-7779-49e6-93c2-f8b4b510cf2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:19.930749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753d2f8-7779-49e6-93c2-f8b4b510cf2e service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:19.940835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1026/2074] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:19.941763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753d2f8-7779-49e6-93c2-f8b4b510cf2e service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:19.943179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a753d2f8-7779-49e6-93c2-f8b4b510cf2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:19.994598 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:19.999016 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ac2e2-070f-468c-b72d-b40d4a86144a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:20.006763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753d2f8-7779-49e6-93c2-f8b4b510cf2e service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:20.011695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd736c9-db6c-4904-bc75-350c62d7503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:20.013617 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd736c9-db6c-4904-bc75-350c62d7503e admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.014103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd736c9-db6c-4904-bc75-350c62d7503e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.014475 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd736c9-db6c-4904-bc75-350c62d7503e admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.015394 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd736c9-db6c-4904-bc75-350c62d7503e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:20.018075 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd736c9-db6c-4904-bc75-350c62d7503e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:20.046398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1049/2075] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:20.048681 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510057da-f1c7-4d25-bdfb-49326354a45b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.048970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510057da-f1c7-4d25-bdfb-49326354a45b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.050001 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510057da-f1c7-4d25-bdfb-49326354a45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.072689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aced9c0-08f2-4d9b-8d95-29b0dcb43196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:20.073737 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aced9c0-08f2-4d9b-8d95-29b0dcb43196 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.074279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aced9c0-08f2-4d9b-8d95-29b0dcb43196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.074689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aced9c0-08f2-4d9b-8d95-29b0dcb43196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.077321 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0aced9c0-08f2-4d9b-8d95-29b0dcb43196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:20.077747 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-510057da-f1c7-4d25-bdfb-49326354a45b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:20.078960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-510057da-f1c7-4d25-bdfb-49326354a45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:20.089261 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1050/2076] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:20.096782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510057da-f1c7-4d25-bdfb-49326354a45b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:20.097068 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aced9c0-08f2-4d9b-8d95-29b0dcb43196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:20.099089 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aced9c0-08f2-4d9b-8d95-29b0dcb43196 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:20.101663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510057da-f1c7-4d25-bdfb-49326354a45b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:20.107484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcf6a8-20cc-44ba-a711-ae64c48f5125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:20.108824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcf6a8-20cc-44ba-a711-ae64c48f5125 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.108824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcf6a8-20cc-44ba-a711-ae64c48f5125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.109003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcf6a8-20cc-44ba-a711-ae64c48f5125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.109661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcf6a8-20cc-44ba-a711-ae64c48f5125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:20.111308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcf6a8-20cc-44ba-a711-ae64c48f5125 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:20.123552 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1051/2077] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:20.125090 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6de78-8972-470c-8eb8-95f05b6568f3 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.125391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6de78-8972-470c-8eb8-95f05b6568f3 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.125673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6de78-8972-470c-8eb8-95f05b6568f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.127048 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1027/2078] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:20.129676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aced9c0-08f2-4d9b-8d95-29b0dcb43196 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:20.145285 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-44c6de78-8972-470c-8eb8-95f05b6568f3 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:20.146759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-44c6de78-8972-470c-8eb8-95f05b6568f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:20.154449 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aced9c0-08f2-4d9b-8d95-29b0dcb43196 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:20.157344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1052/2079] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:20.160896 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fb31a-cd84-4ff6-8c86-a92cceee01f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:20.161982 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fb31a-cd84-4ff6-8c86-a92cceee01f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.162216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fb31a-cd84-4ff6-8c86-a92cceee01f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.162498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fb31a-cd84-4ff6-8c86-a92cceee01f5 admin admin] PATH_INFO: `/v3/projects/a52074d6c84f4f0e94b0dfbc8a12f8f7/users/17e0a2ee31be43b6b92f6e96bc64d73a/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.164114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6de78-8972-470c-8eb8-95f05b6568f3 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:20.182160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6de78-8972-470c-8eb8-95f05b6568f3 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:20.184740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fb31a-cd84-4ff6-8c86-a92cceee01f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52074d6c84f4f0e94b0dfbc8a12f8f7, user_id=17e0a2ee31be43b6b92f6e96bc64d73a, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:20.189012 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e2182-276a-4f66-97a7-7b92908c0897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:20.189595 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fb31a-cd84-4ff6-8c86-a92cceee01f5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:20.191045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e2182-276a-4f66-97a7-7b92908c0897 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.191574 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e2182-276a-4f66-97a7-7b92908c0897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.191976 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e2182-276a-4f66-97a7-7b92908c0897 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.193241 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e2182-276a-4f66-97a7-7b92908c0897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:20.193843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e2182-276a-4f66-97a7-7b92908c0897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:20.196008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e2182-276a-4f66-97a7-7b92908c0897 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:20.210739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1053/2080] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:20.211938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1028/2081] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:20 2022] PUT /identity/v3/projects/a52074d6c84f4f0e94b0dfbc8a12f8f7/users/17e0a2ee31be43b6b92f6e96bc64d73a/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:20.221499 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e2182-276a-4f66-97a7-7b92908c0897 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:20.223475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891080d-90cc-4ce8-88d5-42c7df071c94 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.223970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891080d-90cc-4ce8-88d5-42c7df071c94 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.224186 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891080d-90cc-4ce8-88d5-42c7df071c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.227078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e2182-276a-4f66-97a7-7b92908c0897 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:20.261772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-d891080d-90cc-4ce8-88d5-42c7df071c94 None None] MFA Rules not processed for user `17e0a2ee31be43b6b92f6e96bc64d73a`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:20.264631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d891080d-90cc-4ce8-88d5-42c7df071c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:20.296071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715a640-4ad7-4ae1-84d4-0e83c31a51c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:20.296764 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715a640-4ad7-4ae1-84d4-0e83c31a51c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.297051 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715a640-4ad7-4ae1-84d4-0e83c31a51c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.297399 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715a640-4ad7-4ae1-84d4-0e83c31a51c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.298034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715a640-4ad7-4ae1-84d4-0e83c31a51c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:20.300032 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715a640-4ad7-4ae1-84d4-0e83c31a51c8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:20.341109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1054/2082] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:20 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:20.342448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715a640-4ad7-4ae1-84d4-0e83c31a51c8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:20.365073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1029/2083] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:20.367471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891080d-90cc-4ce8-88d5-42c7df071c94 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:20.404192 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891080d-90cc-4ce8-88d5-42c7df071c94 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:20.421273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:20.537810 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a075155-7a10-4669-8a78-1ee32811863f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:20.539700 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a075155-7a10-4669-8a78-1ee32811863f admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.540596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a075155-7a10-4669-8a78-1ee32811863f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.540774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a075155-7a10-4669-8a78-1ee32811863f admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.542006 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a075155-7a10-4669-8a78-1ee32811863f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:20.548434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a075155-7a10-4669-8a78-1ee32811863f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:20.556976 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715a640-4ad7-4ae1-84d4-0e83c31a51c8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:20.573875 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596ebad-f77a-4c0e-9b64-07808584007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:20.575085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596ebad-f77a-4c0e-9b64-07808584007a admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.575316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596ebad-f77a-4c0e-9b64-07808584007a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.575588 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596ebad-f77a-4c0e-9b64-07808584007a admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.576531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596ebad-f77a-4c0e-9b64-07808584007a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:20.578470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596ebad-f77a-4c0e-9b64-07808584007a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:20.599967 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1030/2084] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:20 2022] POST /identity/v3/projects => generated 369 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:20.601272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a075155-7a10-4669-8a78-1ee32811863f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:20.603313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5a075155-7a10-4669-8a78-1ee32811863f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:20.607436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1055/2085] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:20 2022] POST /identity/v3/users => generated 290 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:20.608686 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596ebad-f77a-4c0e-9b64-07808584007a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:20.612820 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3596ebad-f77a-4c0e-9b64-07808584007a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:20.629596 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596ebad-f77a-4c0e-9b64-07808584007a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:20.670333 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:20.684495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a075155-7a10-4669-8a78-1ee32811863f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:20.691797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717bc1c-da20-4a75-8c67-b7b8963cb413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:20.693656 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717bc1c-da20-4a75-8c67-b7b8963cb413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.694120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717bc1c-da20-4a75-8c67-b7b8963cb413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.694901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717bc1c-da20-4a75-8c67-b7b8963cb413 admin admin] PATH_INFO: `/v3/users/8a8512f9c69d4456aafbea9e4a38a557` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.696577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717bc1c-da20-4a75-8c67-b7b8963cb413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8512f9c69d4456aafbea9e4a38a557)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:20.699713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717bc1c-da20-4a75-8c67-b7b8963cb413 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:20.704669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ac80f-2a81-4ff2-a53a-f3632c1390df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:20.705865 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ac80f-2a81-4ff2-a53a-f3632c1390df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.706536 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ac80f-2a81-4ff2-a53a-f3632c1390df admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.706751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ac80f-2a81-4ff2-a53a-f3632c1390df admin admin] PATH_INFO: `/v3/projects/5c44105386c4478c8665bedb659623ed` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.708179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ac80f-2a81-4ff2-a53a-f3632c1390df admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c44105386c4478c8665bedb659623ed)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:20.710726 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ac80f-2a81-4ff2-a53a-f3632c1390df admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:20.778064 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8717bc1c-da20-4a75-8c67-b7b8963cb413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8512f9c69d4456aafbea9e4a38a557'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:20.779859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a87ac80f-2a81-4ff2-a53a-f3632c1390df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c44105386c4478c8665bedb659623ed', 'request_id': 'req-a87ac80f-2a81-4ff2-a53a-f3632c1390df'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:20.790933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a87ac80f-2a81-4ff2-a53a-f3632c1390df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c44105386c4478c8665bedb659623ed', 'request_id': 'req-a87ac80f-2a81-4ff2-a53a-f3632c1390df'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:20.793632 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8717bc1c-da20-4a75-8c67-b7b8963cb413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8512f9c69d4456aafbea9e4a38a557'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:20.794509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8717bc1c-da20-4a75-8c67-b7b8963cb413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8512f9c69d4456aafbea9e4a38a557'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:20.795220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8717bc1c-da20-4a75-8c67-b7b8963cb413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8512f9c69d4456aafbea9e4a38a557'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:20.798573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a87ac80f-2a81-4ff2-a53a-f3632c1390df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c44105386c4478c8665bedb659623ed', 'request_id': 'req-a87ac80f-2a81-4ff2-a53a-f3632c1390df'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:20.803059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-8717bc1c-da20-4a75-8c67-b7b8963cb413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8512f9c69d4456aafbea9e4a38a557'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:20.811631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a87ac80f-2a81-4ff2-a53a-f3632c1390df admin admin] The token cache is being invalidate because project 5c44105386c4478c8665bedb659623ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:20.812077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a87ac80f-2a81-4ff2-a53a-f3632c1390df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:20.812776 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a87ac80f-2a81-4ff2-a53a-f3632c1390df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:20.814552 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1056/2086] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:20 2022] DELETE /identity/v3/projects/5c44105386c4478c8665bedb659623ed => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:20.815463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ac80f-2a81-4ff2-a53a-f3632c1390df admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:20.822592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a87ac80f-2a81-4ff2-a53a-f3632c1390df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:20.828704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1031/2087] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:20 2022] DELETE /identity/v3/users/8a8512f9c69d4456aafbea9e4a38a557 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:20.829717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717bc1c-da20-4a75-8c67-b7b8963cb413 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:20.832582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8717bc1c-da20-4a75-8c67-b7b8963cb413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:20.846631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:20.895962 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ac80f-2a81-4ff2-a53a-f3632c1390df admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:20.928663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717bc1c-da20-4a75-8c67-b7b8963cb413 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:20.936291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604241d3-163e-423d-84cd-89ad27ae2cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:20.937653 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604241d3-163e-423d-84cd-89ad27ae2cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.938023 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604241d3-163e-423d-84cd-89ad27ae2cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.938478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604241d3-163e-423d-84cd-89ad27ae2cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.940009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604241d3-163e-423d-84cd-89ad27ae2cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:20.941208 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604241d3-163e-423d-84cd-89ad27ae2cb1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:20.957611 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1032/2088] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:20.957611 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b964f-160e-42fb-9939-b73fdf634749 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.957611 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b964f-160e-42fb-9939-b73fdf634749 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.957611 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b964f-160e-42fb-9939-b73fdf634749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.977788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-cf4b964f-160e-42fb-9939-b73fdf634749 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:20.979268 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cf4b964f-160e-42fb-9939-b73fdf634749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:20.995026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1033/2089] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:20.995026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc27c82-9c50-465f-a3c0-55dda36fbc0b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.995026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc27c82-9c50-465f-a3c0-55dda36fbc0b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.995026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc27c82-9c50-465f-a3c0-55dda36fbc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.007054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d52717-9433-4a71-bf65-a8dbb19d2810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:21.007804 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d52717-9433-4a71-bf65-a8dbb19d2810 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.008246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d52717-9433-4a71-bf65-a8dbb19d2810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.008529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d52717-9433-4a71-bf65-a8dbb19d2810 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.016387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-7fc27c82-9c50-465f-a3c0-55dda36fbc0b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:21.017637 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7fc27c82-9c50-465f-a3c0-55dda36fbc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.018439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d52717-9433-4a71-bf65-a8dbb19d2810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:21.025204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d52717-9433-4a71-bf65-a8dbb19d2810 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:21.030313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1034/2090] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:21.030313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc27c82-9c50-465f-a3c0-55dda36fbc0b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:21.037110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7fc27c82-9c50-465f-a3c0-55dda36fbc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.058407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc27c82-9c50-465f-a3c0-55dda36fbc0b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:21.061329 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:21.064346 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2b370-d1bb-493d-a19b-e901a7470dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:21.065317 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2b370-d1bb-493d-a19b-e901a7470dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.065672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2b370-d1bb-493d-a19b-e901a7470dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.066013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2b370-d1bb-493d-a19b-e901a7470dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.066837 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2b370-d1bb-493d-a19b-e901a7470dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:21.068607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1057/2091] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:20 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:21.068727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2b370-d1bb-493d-a19b-e901a7470dc3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:21.069912 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d52717-9433-4a71-bf65-a8dbb19d2810 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:21.073521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-52d52717-9433-4a71-bf65-a8dbb19d2810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.082962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1035/2092] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:21.084742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43e5eb-1067-4edf-8a48-836b9867296a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.084742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43e5eb-1067-4edf-8a48-836b9867296a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.084974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43e5eb-1067-4edf-8a48-836b9867296a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.090630 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d52717-9433-4a71-bf65-a8dbb19d2810 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:21.097019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a0a87-e220-4439-a5c1-f9a192d989cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:21.097896 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a0a87-e220-4439-a5c1-f9a192d989cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.098173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a0a87-e220-4439-a5c1-f9a192d989cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.098441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a0a87-e220-4439-a5c1-f9a192d989cc admin admin] PATH_INFO: `/v3/projects/a041cdb28e3b4d66837b873bed9ae661` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.099711 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a0a87-e220-4439-a5c1-f9a192d989cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a041cdb28e3b4d66837b873bed9ae661)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:21.102434 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a0a87-e220-4439-a5c1-f9a192d989cc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:21.106137 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9e43e5eb-1067-4edf-8a48-836b9867296a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:21.107527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9e43e5eb-1067-4edf-8a48-836b9867296a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.117752 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1036/2093] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:21.118685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43e5eb-1067-4edf-8a48-836b9867296a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:21.120099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9e43e5eb-1067-4edf-8a48-836b9867296a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.159203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cd7a0a87-e220-4439-a5c1-f9a192d989cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a041cdb28e3b4d66837b873bed9ae661', 'request_id': 'req-cd7a0a87-e220-4439-a5c1-f9a192d989cc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:21.170656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cd7a0a87-e220-4439-a5c1-f9a192d989cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a041cdb28e3b4d66837b873bed9ae661', 'request_id': 'req-cd7a0a87-e220-4439-a5c1-f9a192d989cc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:21.177658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cd7a0a87-e220-4439-a5c1-f9a192d989cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a041cdb28e3b4d66837b873bed9ae661', 'request_id': 'req-cd7a0a87-e220-4439-a5c1-f9a192d989cc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:21.182885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43e5eb-1067-4edf-8a48-836b9867296a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:21.193012 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cd7a0a87-e220-4439-a5c1-f9a192d989cc admin admin] The token cache is being invalidate because project a041cdb28e3b4d66837b873bed9ae661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:21.193309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cd7a0a87-e220-4439-a5c1-f9a192d989cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:21.194385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cd7a0a87-e220-4439-a5c1-f9a192d989cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:21.196561 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1058/2094] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:21 2022] DELETE /identity/v3/projects/a041cdb28e3b4d66837b873bed9ae661 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:21.197622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a0a87-e220-4439-a5c1-f9a192d989cc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:21.198985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cd7a0a87-e220-4439-a5c1-f9a192d989cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.242537 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7d7db-914e-475c-a933-d8837fb1c0cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:21.243212 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7d7db-914e-475c-a933-d8837fb1c0cc service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.243497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7d7db-914e-475c-a933-d8837fb1c0cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.243810 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7d7db-914e-475c-a933-d8837fb1c0cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.246248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-71d7d7db-914e-475c-a933-d8837fb1c0cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.278940 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a0a87-e220-4439-a5c1-f9a192d989cc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:21.286020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546721d0-9f18-4e39-bdae-13e54034e02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:21.287269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546721d0-9f18-4e39-bdae-13e54034e02d admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.287613 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546721d0-9f18-4e39-bdae-13e54034e02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.287982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546721d0-9f18-4e39-bdae-13e54034e02d admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.289016 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546721d0-9f18-4e39-bdae-13e54034e02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:21.290883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546721d0-9f18-4e39-bdae-13e54034e02d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:21.300374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:21.303822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1059/2095] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:21.308016 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546721d0-9f18-4e39-bdae-13e54034e02d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:21.310174 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-546721d0-9f18-4e39-bdae-13e54034e02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.323492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546721d0-9f18-4e39-bdae-13e54034e02d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:21.324009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7d7db-914e-475c-a933-d8837fb1c0cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:21.325842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7d7db-914e-475c-a933-d8837fb1c0cc service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:21.330321 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd5af0-3e8e-40b1-a421-85e3b4f621d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:21.331349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd5af0-3e8e-40b1-a421-85e3b4f621d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.331731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd5af0-3e8e-40b1-a421-85e3b4f621d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.332080 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd5af0-3e8e-40b1-a421-85e3b4f621d6 admin admin] PATH_INFO: `/v3/projects/8c984367b0e54f1a89295bae2117d48d/users/05488c1172874c71960d001eb391a19f/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.338478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1037/2096] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:21.339483 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7d7db-914e-475c-a933-d8837fb1c0cc service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:21.341048 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-71d7d7db-914e-475c-a933-d8837fb1c0cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.350780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd5af0-3e8e-40b1-a421-85e3b4f621d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c984367b0e54f1a89295bae2117d48d, user_id=05488c1172874c71960d001eb391a19f, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:21.353973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd5af0-3e8e-40b1-a421-85e3b4f621d6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:21.354409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7d7db-914e-475c-a933-d8837fb1c0cc service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:21.360862 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fd327-392b-4144-af17-7a521aa622fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:21.361889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fd327-392b-4144-af17-7a521aa622fc admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.362208 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fd327-392b-4144-af17-7a521aa622fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.362619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fd327-392b-4144-af17-7a521aa622fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.363448 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fd327-392b-4144-af17-7a521aa622fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:21.364032 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fd327-392b-4144-af17-7a521aa622fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:21.367514 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fd327-392b-4144-af17-7a521aa622fc admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:21.374282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1060/2097] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:21 2022] PUT /identity/v3/projects/8c984367b0e54f1a89295bae2117d48d/users/05488c1172874c71960d001eb391a19f/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:21.376307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbb90a-c319-46c7-9ac5-287d78b6a844 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.377589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbb90a-c319-46c7-9ac5-287d78b6a844 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.378056 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbb90a-c319-46c7-9ac5-287d78b6a844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.383904 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1038/2098] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:21.384882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fd327-392b-4144-af17-7a521aa622fc admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:21.399069 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fd327-392b-4144-af17-7a521aa622fc admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:21.405078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c8cbb90a-c319-46c7-9ac5-287d78b6a844 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:21.407780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c8cbb90a-c319-46c7-9ac5-287d78b6a844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.485901 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:21.501072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18340f89-4cd1-464f-9cd3-a6cc449b280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:21.502351 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18340f89-4cd1-464f-9cd3-a6cc449b280b admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.502641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18340f89-4cd1-464f-9cd3-a6cc449b280b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.503117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18340f89-4cd1-464f-9cd3-a6cc449b280b admin admin] PATH_INFO: `/v3/projects/9bc33ab165b44c999e15864715e5ca59/users/908bcd62300c403eb4a6a493cf7846cf/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.504349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1061/2099] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:21.506257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbb90a-c319-46c7-9ac5-287d78b6a844 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:21.527053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbb90a-c319-46c7-9ac5-287d78b6a844 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:21.537873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2fb9-38d9-4028-a526-6cd86bde0d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:21.538710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2fb9-38d9-4028-a526-6cd86bde0d51 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.539097 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2fb9-38d9-4028-a526-6cd86bde0d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.539473 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2fb9-38d9-4028-a526-6cd86bde0d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.540325 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e2fb9-38d9-4028-a526-6cd86bde0d51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:21.542928 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18340f89-4cd1-464f-9cd3-a6cc449b280b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc33ab165b44c999e15864715e5ca59, user_id=908bcd62300c403eb4a6a493cf7846cf, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:21.543063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e2fb9-38d9-4028-a526-6cd86bde0d51 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:21.546410 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18340f89-4cd1-464f-9cd3-a6cc449b280b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:21.578537 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1039/2100] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:21 2022] PUT /identity/v3/projects/9bc33ab165b44c999e15864715e5ca59/users/908bcd62300c403eb4a6a493cf7846cf/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:21.583094 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351644-4f90-4599-b845-d46fc4e4d27c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.583968 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351644-4f90-4599-b845-d46fc4e4d27c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.585928 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351644-4f90-4599-b845-d46fc4e4d27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.590013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1062/2101] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:21 2022] POST /identity/v3/projects => generated 389 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:21.592244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b010a0d-9416-405f-827f-05b2bf44ee4a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.592244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b010a0d-9416-405f-827f-05b2bf44ee4a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.592244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b010a0d-9416-405f-827f-05b2bf44ee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.622247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2b010a0d-9416-405f-827f-05b2bf44ee4a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:21.623940 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2b010a0d-9416-405f-827f-05b2bf44ee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.632257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9f351644-4f90-4599-b845-d46fc4e4d27c None None] MFA Rules not processed for user `05488c1172874c71960d001eb391a19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:21.633486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9f351644-4f90-4599-b845-d46fc4e4d27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.755423 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1040/2102] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:21.755423 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f351644-4f90-4599-b845-d46fc4e4d27c None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:21.783838 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1063/2103] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:21.783838 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b010a0d-9416-405f-827f-05b2bf44ee4a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:21.796968 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b010a0d-9416-405f-827f-05b2bf44ee4a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:21.805075 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0203145-5393-48a4-8819-5146786a0633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:21.805894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0203145-5393-48a4-8819-5146786a0633 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.806174 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0203145-5393-48a4-8819-5146786a0633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.806454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0203145-5393-48a4-8819-5146786a0633 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.807209 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0203145-5393-48a4-8819-5146786a0633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:21.809514 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0203145-5393-48a4-8819-5146786a0633 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:21.815630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:21.835357 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1064/2104] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:21 2022] POST /identity/v3/users => generated 295 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:21.836373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0203145-5393-48a4-8819-5146786a0633 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:21.837998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c0203145-5393-48a4-8819-5146786a0633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.842278 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f351644-4f90-4599-b845-d46fc4e4d27c None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:21.847932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf06879-a354-45b2-97d9-84d5df952ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:21.848827 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf06879-a354-45b2-97d9-84d5df952ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.849294 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf06879-a354-45b2-97d9-84d5df952ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.849750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf06879-a354-45b2-97d9-84d5df952ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.850657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf06879-a354-45b2-97d9-84d5df952ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:21.852529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf06879-a354-45b2-97d9-84d5df952ff5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:21.859689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0203145-5393-48a4-8819-5146786a0633 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:21.864622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1041/2105] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:21.865938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf06879-a354-45b2-97d9-84d5df952ff5 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:21.870735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d7591-205f-4df6-a68f-d07c8b417ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:21.871749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d7591-205f-4df6-a68f-d07c8b417ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.872037 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d7591-205f-4df6-a68f-d07c8b417ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.872634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d7591-205f-4df6-a68f-d07c8b417ab4 admin admin] PATH_INFO: `/v3/projects/896b7e14985640a49010cebb84f51cfe` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.873602 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d7591-205f-4df6-a68f-d07c8b417ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=896b7e14985640a49010cebb84f51cfe)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:21.876220 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d7591-205f-4df6-a68f-d07c8b417ab4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:21.894256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf06879-a354-45b2-97d9-84d5df952ff5 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:21.908843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571a209-1f40-4f30-b8be-f15845eb52b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:21.909547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571a209-1f40-4f30-b8be-f15845eb52b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.909975 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571a209-1f40-4f30-b8be-f15845eb52b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.910403 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571a209-1f40-4f30-b8be-f15845eb52b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.911274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571a209-1f40-4f30-b8be-f15845eb52b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:21.913380 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571a209-1f40-4f30-b8be-f15845eb52b4 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:21.954913 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9e1d7591-205f-4df6-a68f-d07c8b417ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896b7e14985640a49010cebb84f51cfe', 'request_id': 'req-9e1d7591-205f-4df6-a68f-d07c8b417ab4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:21.960391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1042/2106] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:21 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:21.961711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571a209-1f40-4f30-b8be-f15845eb52b4 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:21.971027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9e1d7591-205f-4df6-a68f-d07c8b417ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896b7e14985640a49010cebb84f51cfe', 'request_id': 'req-9e1d7591-205f-4df6-a68f-d07c8b417ab4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:21.982287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9e1d7591-205f-4df6-a68f-d07c8b417ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896b7e14985640a49010cebb84f51cfe', 'request_id': 'req-9e1d7591-205f-4df6-a68f-d07c8b417ab4'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:21.998829 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9e1d7591-205f-4df6-a68f-d07c8b417ab4 admin admin] The token cache is being invalidate because project 896b7e14985640a49010cebb84f51cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:21.999240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9e1d7591-205f-4df6-a68f-d07c8b417ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:22.000290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9e1d7591-205f-4df6-a68f-d07c8b417ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:22.002500 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1065/2107] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:21 2022] DELETE /identity/v3/projects/896b7e14985640a49010cebb84f51cfe => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:22.005634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d7591-205f-4df6-a68f-d07c8b417ab4 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:22.006413 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9e1d7591-205f-4df6-a68f-d07c8b417ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:22.048792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571a209-1f40-4f30-b8be-f15845eb52b4 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:22.054769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16ca85-e2c0-4ff4-8e50-5e05c3ebcc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:22.055754 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16ca85-e2c0-4ff4-8e50-5e05c3ebcc69 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:22.056039 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16ca85-e2c0-4ff4-8e50-5e05c3ebcc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:22.056315 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16ca85-e2c0-4ff4-8e50-5e05c3ebcc69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:22.057057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16ca85-e2c0-4ff4-8e50-5e05c3ebcc69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:22.057595 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16ca85-e2c0-4ff4-8e50-5e05c3ebcc69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:22.059921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16ca85-e2c0-4ff4-8e50-5e05c3ebcc69 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:22.075326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:22.079823 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1043/2108] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:22.080481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16ca85-e2c0-4ff4-8e50-5e05c3ebcc69 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:22.082496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7b16ca85-e2c0-4ff4-8e50-5e05c3ebcc69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:22.100282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16ca85-e2c0-4ff4-8e50-5e05c3ebcc69 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:22.109750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840eb81-60a8-46fc-bd9b-3fc7e1cfb1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:22.111503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840eb81-60a8-46fc-bd9b-3fc7e1cfb1ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:22.112013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840eb81-60a8-46fc-bd9b-3fc7e1cfb1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:22.113141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840eb81-60a8-46fc-bd9b-3fc7e1cfb1ef admin admin] PATH_INFO: `/v3/projects/9bc33ab165b44c999e15864715e5ca59/users/908bcd62300c403eb4a6a493cf7846cf/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:22.116281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840eb81-60a8-46fc-bd9b-3fc7e1cfb1ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc33ab165b44c999e15864715e5ca59, user_id=908bcd62300c403eb4a6a493cf7846cf, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:22.120069 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840eb81-60a8-46fc-bd9b-3fc7e1cfb1ef admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:22.126518 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d7591-205f-4df6-a68f-d07c8b417ab4 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:22.138893 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e6873-9f45-4e64-8536-54416200c7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:22.139929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e6873-9f45-4e64-8536-54416200c7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:22.140220 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e6873-9f45-4e64-8536-54416200c7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:22.140493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e6873-9f45-4e64-8536-54416200c7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:22.141245 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e6873-9f45-4e64-8536-54416200c7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:22.142877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e6873-9f45-4e64-8536-54416200c7d9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:22.147809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1044/2109] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:22 2022] PUT /identity/v3/projects/9bc33ab165b44c999e15864715e5ca59/users/908bcd62300c403eb4a6a493cf7846cf/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:22.148850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840eb81-60a8-46fc-bd9b-3fc7e1cfb1ef admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:22.151165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6840eb81-60a8-46fc-bd9b-3fc7e1cfb1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:22.170129 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1066/2110] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:22.172132 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e6873-9f45-4e64-8536-54416200c7d9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:22.174438 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fa0e6873-9f45-4e64-8536-54416200c7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:22.190932 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e6873-9f45-4e64-8536-54416200c7d9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:22.232085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840eb81-60a8-46fc-bd9b-3fc7e1cfb1ef admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:22.237350 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577f54e-d9fd-431a-99f3-acab1d367cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:22.237679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577f54e-d9fd-431a-99f3-acab1d367cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:22.237962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577f54e-d9fd-431a-99f3-acab1d367cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:22.238233 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577f54e-d9fd-431a-99f3-acab1d367cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:22.238932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577f54e-d9fd-431a-99f3-acab1d367cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:22.241133 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577f54e-d9fd-431a-99f3-acab1d367cb4 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:22.268190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1045/2111] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:22 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:22.269392 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577f54e-d9fd-431a-99f3-acab1d367cb4 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:22.272709 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0577f54e-d9fd-431a-99f3-acab1d367cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:22.296806 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c89007-b4b4-4e45-bae0-f8dcd73e39f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:22.297322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577f54e-d9fd-431a-99f3-acab1d367cb4 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:22.297909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c89007-b4b4-4e45-bae0-f8dcd73e39f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:22.298192 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c89007-b4b4-4e45-bae0-f8dcd73e39f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:22.298600 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c89007-b4b4-4e45-bae0-f8dcd73e39f2 admin admin] PATH_INFO: `/v3/users/d5fb92f204d34e29b9c19b633c853694` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:22.300130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c89007-b4b4-4e45-bae0-f8dcd73e39f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5fb92f204d34e29b9c19b633c853694)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:22.302409 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c89007-b4b4-4e45-bae0-f8dcd73e39f2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:22.303622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22f284-1bc4-4957-869f-988973df4bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:22.304451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22f284-1bc4-4957-869f-988973df4bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:22.304733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22f284-1bc4-4957-869f-988973df4bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:22.306210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22f284-1bc4-4957-869f-988973df4bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:22.307036 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22f284-1bc4-4957-869f-988973df4bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:22.310154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22f284-1bc4-4957-869f-988973df4bb3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:22.349011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1046/2112] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:22 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:22.350426 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e444f5a-4eaf-4e36-84dc-e5fa16d903bd None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:22.350719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e444f5a-4eaf-4e36-84dc-e5fa16d903bd None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:22.351074 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e444f5a-4eaf-4e36-84dc-e5fa16d903bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:22.359501 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:22.385684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-67c89007-b4b4-4e45-bae0-f8dcd73e39f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5fb92f204d34e29b9c19b633c853694'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:22.386956 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-67c89007-b4b4-4e45-bae0-f8dcd73e39f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5fb92f204d34e29b9c19b633c853694'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:22.388326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-67c89007-b4b4-4e45-bae0-f8dcd73e39f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5fb92f204d34e29b9c19b633c853694'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:22.400939 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-67c89007-b4b4-4e45-bae0-f8dcd73e39f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5fb92f204d34e29b9c19b633c853694'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:22.405533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9e444f5a-4eaf-4e36-84dc-e5fa16d903bd None None] MFA Rules not processed for user `908bcd62300c403eb4a6a493cf7846cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:22.406968 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9e444f5a-4eaf-4e36-84dc-e5fa16d903bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:22.413811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-67c89007-b4b4-4e45-bae0-f8dcd73e39f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5fb92f204d34e29b9c19b633c853694'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:22.459209 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1067/2113] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:22 2022] DELETE /identity/v3/users/d5fb92f204d34e29b9c19b633c853694 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:22.461040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c89007-b4b4-4e45-bae0-f8dcd73e39f2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:22.462768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-67c89007-b4b4-4e45-bae0-f8dcd73e39f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:22.527396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1047/2114] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:22 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:22.528409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e444f5a-4eaf-4e36-84dc-e5fa16d903bd None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:22.531540 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9e444f5a-4eaf-4e36-84dc-e5fa16d903bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:22.534639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:22.557682 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c89007-b4b4-4e45-bae0-f8dcd73e39f2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:22.570034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa976a-48bb-4111-bd9a-ce4a5d0e546c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:22.570810 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa976a-48bb-4111-bd9a-ce4a5d0e546c admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:22.571176 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa976a-48bb-4111-bd9a-ce4a5d0e546c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:22.571546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa976a-48bb-4111-bd9a-ce4a5d0e546c admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:22.572481 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa976a-48bb-4111-bd9a-ce4a5d0e546c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:22.575920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa976a-48bb-4111-bd9a-ce4a5d0e546c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:22.595492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1068/2115] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:22.595492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa976a-48bb-4111-bd9a-ce4a5d0e546c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:22.596768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-61aa976a-48bb-4111-bd9a-ce4a5d0e546c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:22.614123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa976a-48bb-4111-bd9a-ce4a5d0e546c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:22.621547 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb47a38-e34f-4ab0-bdf3-f9c811b6f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:22.622525 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb47a38-e34f-4ab0-bdf3-f9c811b6f14f admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:22.623168 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb47a38-e34f-4ab0-bdf3-f9c811b6f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:22.623304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb47a38-e34f-4ab0-bdf3-f9c811b6f14f admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:22.624018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb47a38-e34f-4ab0-bdf3-f9c811b6f14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:22.626572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb47a38-e34f-4ab0-bdf3-f9c811b6f14f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:22.664598 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e444f5a-4eaf-4e36-84dc-e5fa16d903bd None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:22.672300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1069/2116] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:22 2022] POST /identity/v3/users => generated 288 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:22.672660 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6cb0e-edc9-4c33-b495-e6b42fb9faa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:22.673563 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6cb0e-edc9-4c33-b495-e6b42fb9faa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:22.673964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6cb0e-edc9-4c33-b495-e6b42fb9faa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:22.674388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6cb0e-edc9-4c33-b495-e6b42fb9faa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:22.675475 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb47a38-e34f-4ab0-bdf3-f9c811b6f14f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:22.675584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6cb0e-edc9-4c33-b495-e6b42fb9faa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:22.677778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6cb0e-edc9-4c33-b495-e6b42fb9faa3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:22.678745 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cbb47a38-e34f-4ab0-bdf3-f9c811b6f14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:22.702262 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1048/2117] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:22.703194 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6cb0e-edc9-4c33-b495-e6b42fb9faa3 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:22.715269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6cb0e-edc9-4c33-b495-e6b42fb9faa3 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:22.721398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44167-c911-4db3-9290-3af2c317cc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:22.722938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44167-c911-4db3-9290-3af2c317cc84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:22.723220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44167-c911-4db3-9290-3af2c317cc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:22.723499 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44167-c911-4db3-9290-3af2c317cc84 admin admin] PATH_INFO: `/v3/projects/8abbfe1cef044cda9a92872176849abb/users/1e63f3fd5a864644b0b9567e0117dc58/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:22.744336 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f44167-c911-4db3-9290-3af2c317cc84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abbfe1cef044cda9a92872176849abb, user_id=1e63f3fd5a864644b0b9567e0117dc58, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:22.747358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f44167-c911-4db3-9290-3af2c317cc84 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:22.774958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb47a38-e34f-4ab0-bdf3-f9c811b6f14f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:22.779675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1049/2118] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:22 2022] PUT /identity/v3/projects/8abbfe1cef044cda9a92872176849abb/users/1e63f3fd5a864644b0b9567e0117dc58/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:22.780909 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44167-c911-4db3-9290-3af2c317cc84 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:22.840020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfe5a3-7d82-49b5-8218-95c898ae90a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:22.841153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfe5a3-7d82-49b5-8218-95c898ae90a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:22.842238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfe5a3-7d82-49b5-8218-95c898ae90a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:22.842521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfe5a3-7d82-49b5-8218-95c898ae90a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:22.879202 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44167-c911-4db3-9290-3af2c317cc84 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:22.886063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d90d80-9428-4a99-8e59-c0cfa2be0ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:22.887407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90d80-9428-4a99-8e59-c0cfa2be0ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:22.887888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90d80-9428-4a99-8e59-c0cfa2be0ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:22.891837 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90d80-9428-4a99-8e59-c0cfa2be0ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:22.893488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d90d80-9428-4a99-8e59-c0cfa2be0ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:22.895143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d90d80-9428-4a99-8e59-c0cfa2be0ed0 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:22.898175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:22.913197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1050/2119] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:22.914867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d90d80-9428-4a99-8e59-c0cfa2be0ed0 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:22.923269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfe5a3-7d82-49b5-8218-95c898ae90a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:22.924779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfe5a3-7d82-49b5-8218-95c898ae90a4 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:22.926771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d90d80-9428-4a99-8e59-c0cfa2be0ed0 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:22.932600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392b7c9-6194-4b4e-a3a2-6d9a094ebca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:22.934085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b7c9-6194-4b4e-a3a2-6d9a094ebca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:22.934544 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b7c9-6194-4b4e-a3a2-6d9a094ebca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:22.934961 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b7c9-6194-4b4e-a3a2-6d9a094ebca6 admin admin] PATH_INFO: `/v3/projects/05dfb632df48424a8286a2a1a67daf05/users/0814ed4adbc2402e91df3965f864e9d3/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:22.935764 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1070/2120] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:22 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:22.937273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a1b3d-57f5-4723-ba7a-77bf240ce5e9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:22.937564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a1b3d-57f5-4723-ba7a-77bf240ce5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:22.937845 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a1b3d-57f5-4723-ba7a-77bf240ce5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:22.953565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392b7c9-6194-4b4e-a3a2-6d9a094ebca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05dfb632df48424a8286a2a1a67daf05, user_id=0814ed4adbc2402e91df3965f864e9d3, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:22.956230 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392b7c9-6194-4b4e-a3a2-6d9a094ebca6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:22.969767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7e8a1b3d-57f5-4723-ba7a-77bf240ce5e9 None None] MFA Rules not processed for user `1e63f3fd5a864644b0b9567e0117dc58`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:22.971488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7e8a1b3d-57f5-4723-ba7a-77bf240ce5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:22.976318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1051/2121] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:22 2022] PUT /identity/v3/projects/05dfb632df48424a8286a2a1a67daf05/users/0814ed4adbc2402e91df3965f864e9d3/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:22.980406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392b7c9-6194-4b4e-a3a2-6d9a094ebca6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:22.982344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f392b7c9-6194-4b4e-a3a2-6d9a094ebca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:23.005058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:23.058945 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1071/2122] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:23.062758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a1b3d-57f5-4723-ba7a-77bf240ce5e9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:23.062856 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392b7c9-6194-4b4e-a3a2-6d9a094ebca6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:23.067418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657a60a-9468-4864-b1c4-d51c4ba560dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:23.068465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657a60a-9468-4864-b1c4-d51c4ba560dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.068746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657a60a-9468-4864-b1c4-d51c4ba560dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.069021 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657a60a-9468-4864-b1c4-d51c4ba560dd admin admin] PATH_INFO: `/v3/projects/651a8634db694fc1a63aa11da53ddc6f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.071581 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657a60a-9468-4864-b1c4-d51c4ba560dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=651a8634db694fc1a63aa11da53ddc6f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:23.073339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a1b3d-57f5-4723-ba7a-77bf240ce5e9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:23.073699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657a60a-9468-4864-b1c4-d51c4ba560dd admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:23.078417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eedf98-dde2-4416-a7ef-678cedc22cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:23.079166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eedf98-dde2-4416-a7ef-678cedc22cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.079452 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eedf98-dde2-4416-a7ef-678cedc22cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.079764 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eedf98-dde2-4416-a7ef-678cedc22cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.080652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eedf98-dde2-4416-a7ef-678cedc22cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:23.082556 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eedf98-dde2-4416-a7ef-678cedc22cb7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:23.099028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1072/2123] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:23.099028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eedf98-dde2-4416-a7ef-678cedc22cb7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:23.112105 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eedf98-dde2-4416-a7ef-678cedc22cb7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:23.117830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63f8d1-1c76-4a8a-96ed-a222d1a41f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:23.118995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63f8d1-1c76-4a8a-96ed-a222d1a41f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.119353 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63f8d1-1c76-4a8a-96ed-a222d1a41f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.119734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63f8d1-1c76-4a8a-96ed-a222d1a41f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.120910 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63f8d1-1c76-4a8a-96ed-a222d1a41f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:23.123161 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63f8d1-1c76-4a8a-96ed-a222d1a41f6a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:23.136423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1073/2124] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:23.137852 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63f8d1-1c76-4a8a-96ed-a222d1a41f6a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:23.173937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2657a60a-9468-4864-b1c4-d51c4ba560dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '651a8634db694fc1a63aa11da53ddc6f', 'request_id': 'req-2657a60a-9468-4864-b1c4-d51c4ba560dd'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:23.183704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2657a60a-9468-4864-b1c4-d51c4ba560dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '651a8634db694fc1a63aa11da53ddc6f', 'request_id': 'req-2657a60a-9468-4864-b1c4-d51c4ba560dd'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:23.195299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2657a60a-9468-4864-b1c4-d51c4ba560dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '651a8634db694fc1a63aa11da53ddc6f', 'request_id': 'req-2657a60a-9468-4864-b1c4-d51c4ba560dd'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:23.213675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2657a60a-9468-4864-b1c4-d51c4ba560dd admin admin] The token cache is being invalidate because project 651a8634db694fc1a63aa11da53ddc6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:23.213675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2657a60a-9468-4864-b1c4-d51c4ba560dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:23.220210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2657a60a-9468-4864-b1c4-d51c4ba560dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:23.222963 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1052/2125] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:22 2022] DELETE /identity/v3/projects/651a8634db694fc1a63aa11da53ddc6f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:23.223068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63f8d1-1c76-4a8a-96ed-a222d1a41f6a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:23.223435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657a60a-9468-4864-b1c4-d51c4ba560dd admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:23.225413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2657a60a-9468-4864-b1c4-d51c4ba560dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:23.301648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e652e-5764-433f-9102-5624023a43bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:23.302009 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e652e-5764-433f-9102-5624023a43bb service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.304679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e652e-5764-433f-9102-5624023a43bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.304977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e652e-5764-433f-9102-5624023a43bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.311590 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-330e652e-5764-433f-9102-5624023a43bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:23.316665 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657a60a-9468-4864-b1c4-d51c4ba560dd admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:23.323406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081f4dd-648a-4bfd-a38c-a641219e56fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:23.324259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081f4dd-648a-4bfd-a38c-a641219e56fe admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.324691 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081f4dd-648a-4bfd-a38c-a641219e56fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.325038 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081f4dd-648a-4bfd-a38c-a641219e56fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.326158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081f4dd-648a-4bfd-a38c-a641219e56fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:23.328230 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081f4dd-648a-4bfd-a38c-a641219e56fe admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:23.341654 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:23.369955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1053/2126] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:23 2022] POST /identity/v3/projects => generated 389 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:23.371236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081f4dd-648a-4bfd-a38c-a641219e56fe admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:23.373640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c081f4dd-648a-4bfd-a38c-a641219e56fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:23.443287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e652e-5764-433f-9102-5624023a43bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:23.445819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e652e-5764-433f-9102-5624023a43bb service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:23.469079 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1074/2127] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:23.469975 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e652e-5764-433f-9102-5624023a43bb service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:23.471543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-330e652e-5764-433f-9102-5624023a43bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:23.488983 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e652e-5764-433f-9102-5624023a43bb service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:23.494395 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081f4dd-648a-4bfd-a38c-a641219e56fe admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:23.496575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf4a87-0048-4d9f-9b76-c9324c16aa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:23.497548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf4a87-0048-4d9f-9b76-c9324c16aa75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.497832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf4a87-0048-4d9f-9b76-c9324c16aa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.498110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf4a87-0048-4d9f-9b76-c9324c16aa75 admin admin] PATH_INFO: `/v3/projects/05dfb632df48424a8286a2a1a67daf05/users/0814ed4adbc2402e91df3965f864e9d3/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.500336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf4a87-0048-4d9f-9b76-c9324c16aa75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05dfb632df48424a8286a2a1a67daf05, user_id=0814ed4adbc2402e91df3965f864e9d3, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:23.503422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf4a87-0048-4d9f-9b76-c9324c16aa75 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:23.509042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f59b2-d64f-4c4e-90f9-31b08ccca0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:23.510074 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f59b2-d64f-4c4e-90f9-31b08ccca0dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.510358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f59b2-d64f-4c4e-90f9-31b08ccca0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.510652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f59b2-d64f-4c4e-90f9-31b08ccca0dd admin admin] PATH_INFO: `/v3/projects/3425f543338c4618bf383b9ebc4e9daf/users/4497946aad2648d487b847da52306693/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.527078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1075/2128] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:23 2022] PUT /identity/v3/projects/05dfb632df48424a8286a2a1a67daf05/users/0814ed4adbc2402e91df3965f864e9d3/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:23.529017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2377e-5ca6-45de-95a5-697c1859771c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.529344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2377e-5ca6-45de-95a5-697c1859771c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.529588 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2377e-5ca6-45de-95a5-697c1859771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.538030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:23.549416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f59b2-d64f-4c4e-90f9-31b08ccca0dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3425f543338c4618bf383b9ebc4e9daf, user_id=4497946aad2648d487b847da52306693, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:23.557306 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f59b2-d64f-4c4e-90f9-31b08ccca0dd admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:23.557872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-49a2377e-5ca6-45de-95a5-697c1859771c None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:23.559498 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-49a2377e-5ca6-45de-95a5-697c1859771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:23.600638 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1054/2129] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:23 2022] PUT /identity/v3/projects/3425f543338c4618bf383b9ebc4e9daf/users/4497946aad2648d487b847da52306693/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:23.601566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f59b2-d64f-4c4e-90f9-31b08ccca0dd admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:23.647637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1076/2130] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:23.649402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e03323-a077-4dba-91d3-86d860448050 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.649786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e03323-a077-4dba-91d3-86d860448050 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.650156 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e03323-a077-4dba-91d3-86d860448050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.688734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-26e03323-a077-4dba-91d3-86d860448050 None None] MFA Rules not processed for user `0814ed4adbc2402e91df3965f864e9d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:23.690786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-26e03323-a077-4dba-91d3-86d860448050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:23.751297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f59b2-d64f-4c4e-90f9-31b08ccca0dd admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:23.757927 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622aab1-8a16-46ee-94a0-9f27f60106f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:23.758655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622aab1-8a16-46ee-94a0-9f27f60106f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.758980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622aab1-8a16-46ee-94a0-9f27f60106f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.759261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622aab1-8a16-46ee-94a0-9f27f60106f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.760159 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622aab1-8a16-46ee-94a0-9f27f60106f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:23.762831 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622aab1-8a16-46ee-94a0-9f27f60106f5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:23.797393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1077/2131] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:23.800254 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ed400-9c10-48c3-8061-2a8025c48e8b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.800978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ed400-9c10-48c3-8061-2a8025c48e8b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.801537 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ed400-9c10-48c3-8061-2a8025c48e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.801961 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1055/2132] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:23 2022] POST /identity/v3/users => generated 301 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:23.803492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f802142-7b86-4c8e-8d5e-3c903932dfb3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.803828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f802142-7b86-4c8e-8d5e-3c903932dfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.821521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f802142-7b86-4c8e-8d5e-3c903932dfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.848365 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6f802142-7b86-4c8e-8d5e-3c903932dfb3 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:23.850659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6f802142-7b86-4c8e-8d5e-3c903932dfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:23.853815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2d0ed400-9c10-48c3-8061-2a8025c48e8b None None] MFA Rules not processed for user `4497946aad2648d487b847da52306693`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:23.856225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2d0ed400-9c10-48c3-8061-2a8025c48e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:23.861318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1056/2133] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:23.862472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f802142-7b86-4c8e-8d5e-3c903932dfb3 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:23.875501 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f802142-7b86-4c8e-8d5e-3c903932dfb3 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:23.882897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69258962-b02a-421f-bb06-6567707f0e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:23.884812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69258962-b02a-421f-bb06-6567707f0e97 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.885279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69258962-b02a-421f-bb06-6567707f0e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.885560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69258962-b02a-421f-bb06-6567707f0e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.886317 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69258962-b02a-421f-bb06-6567707f0e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:23.888404 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69258962-b02a-421f-bb06-6567707f0e97 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:23.903959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1057/2134] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:23.903959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69258962-b02a-421f-bb06-6567707f0e97 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:23.908456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-69258962-b02a-421f-bb06-6567707f0e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:24.010475 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1078/2135] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:24.015406 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ed400-9c10-48c3-8061-2a8025c48e8b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:24.017448 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:24.031048 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69258962-b02a-421f-bb06-6567707f0e97 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:24.038101 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f09fcf-a1d3-4aa7-bbb1-fd8fa113e535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:24.038763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f09fcf-a1d3-4aa7-bbb1-fd8fa113e535 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:24.039044 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f09fcf-a1d3-4aa7-bbb1-fd8fa113e535 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:24.039312 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f09fcf-a1d3-4aa7-bbb1-fd8fa113e535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:24.052007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ed400-9c10-48c3-8061-2a8025c48e8b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:24.055177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f09fcf-a1d3-4aa7-bbb1-fd8fa113e535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:24.056757 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f09fcf-a1d3-4aa7-bbb1-fd8fa113e535 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:24.061568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bb84a-d7da-4f23-93d0-488cdfae963e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:24.062255 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bb84a-d7da-4f23-93d0-488cdfae963e admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:24.062537 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bb84a-d7da-4f23-93d0-488cdfae963e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:24.062811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bb84a-d7da-4f23-93d0-488cdfae963e admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:24.063554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bb84a-d7da-4f23-93d0-488cdfae963e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:24.063884 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bb84a-d7da-4f23-93d0-488cdfae963e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:24.065495 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bb84a-d7da-4f23-93d0-488cdfae963e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:24.070011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1058/2136] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:24.071110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f09fcf-a1d3-4aa7-bbb1-fd8fa113e535 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:24.082882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f09fcf-a1d3-4aa7-bbb1-fd8fa113e535 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:24.094170 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1079/2137] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:24.094312 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e50259-d7d0-423d-93de-90e56f17c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:24.095419 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bb84a-d7da-4f23-93d0-488cdfae963e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:24.095538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e50259-d7d0-423d-93de-90e56f17c98c admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:24.095913 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e50259-d7d0-423d-93de-90e56f17c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:24.096276 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e50259-d7d0-423d-93de-90e56f17c98c admin admin] PATH_INFO: `/v3/projects/73bb042a4f334518801cc4f2f73bbfa9/users/3b6050251a924b2b8f0ca1b61dcaf634/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:24.112612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:24.121531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bb84a-d7da-4f23-93d0-488cdfae963e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:24.136330 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4afe8-76c4-405e-90fb-15b508a603fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:24.136478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4afe8-76c4-405e-90fb-15b508a603fe admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:24.136708 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4afe8-76c4-405e-90fb-15b508a603fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:24.136955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4afe8-76c4-405e-90fb-15b508a603fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:24.137821 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e50259-d7d0-423d-93de-90e56f17c98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bb042a4f334518801cc4f2f73bbfa9, user_id=3b6050251a924b2b8f0ca1b61dcaf634, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:24.142726 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e50259-d7d0-423d-93de-90e56f17c98c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:24.149421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4afe8-76c4-405e-90fb-15b508a603fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:24.151740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4afe8-76c4-405e-90fb-15b508a603fe admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:24.175007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1059/2138] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:24 2022] PUT /identity/v3/projects/73bb042a4f334518801cc4f2f73bbfa9/users/3b6050251a924b2b8f0ca1b61dcaf634/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:24.175007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e50259-d7d0-423d-93de-90e56f17c98c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:24.221806 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1080/2139] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:24 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:24.225975 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4afe8-76c4-405e-90fb-15b508a603fe admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:24.325588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e50259-d7d0-423d-93de-90e56f17c98c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:24.333214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f74929-c5b1-486c-af8a-fbf4de7e0dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:24.334146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f74929-c5b1-486c-af8a-fbf4de7e0dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:24.334531 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f74929-c5b1-486c-af8a-fbf4de7e0dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:24.334911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f74929-c5b1-486c-af8a-fbf4de7e0dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:24.335922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f74929-c5b1-486c-af8a-fbf4de7e0dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:24.338150 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f74929-c5b1-486c-af8a-fbf4de7e0dc9 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:24.341974 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4afe8-76c4-405e-90fb-15b508a603fe admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:24.356422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feab4fb-a1aa-48e4-ba61-0f01d689dbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:24.357512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feab4fb-a1aa-48e4-ba61-0f01d689dbfe admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:24.357904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feab4fb-a1aa-48e4-ba61-0f01d689dbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:24.358793 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feab4fb-a1aa-48e4-ba61-0f01d689dbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:24.360457 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feab4fb-a1aa-48e4-ba61-0f01d689dbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:24.365564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feab4fb-a1aa-48e4-ba61-0f01d689dbfe admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:24.384927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1081/2140] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:24.384927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feab4fb-a1aa-48e4-ba61-0f01d689dbfe admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:24.391557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1060/2141] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:24 2022] POST /identity/v3/projects => generated 387 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:24.393087 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f74929-c5b1-486c-af8a-fbf4de7e0dc9 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:24.406842 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feab4fb-a1aa-48e4-ba61-0f01d689dbfe admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:24.534964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f74929-c5b1-486c-af8a-fbf4de7e0dc9 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:24.540554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d611fe1-3e7b-4087-9563-5706e7ca9605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:24.541456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d611fe1-3e7b-4087-9563-5706e7ca9605 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:24.541801 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d611fe1-3e7b-4087-9563-5706e7ca9605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:24.541924 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5976895-7bc7-43cb-a9a9-f512513c2d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:24.542343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d611fe1-3e7b-4087-9563-5706e7ca9605 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:24.543337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d611fe1-3e7b-4087-9563-5706e7ca9605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:24.546052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d611fe1-3e7b-4087-9563-5706e7ca9605 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:24.548332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5976895-7bc7-43cb-a9a9-f512513c2d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:24.548836 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5976895-7bc7-43cb-a9a9-f512513c2d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:24.549177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5976895-7bc7-43cb-a9a9-f512513c2d30 admin admin] PATH_INFO: `/v3/projects/73bb042a4f334518801cc4f2f73bbfa9/users/3b6050251a924b2b8f0ca1b61dcaf634/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:24.552869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5976895-7bc7-43cb-a9a9-f512513c2d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bb042a4f334518801cc4f2f73bbfa9, user_id=3b6050251a924b2b8f0ca1b61dcaf634, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:24.556247 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5976895-7bc7-43cb-a9a9-f512513c2d30 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:24.572906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1061/2142] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:24 2022] PUT /identity/v3/projects/73bb042a4f334518801cc4f2f73bbfa9/users/3b6050251a924b2b8f0ca1b61dcaf634/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:24.579835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5976895-7bc7-43cb-a9a9-f512513c2d30 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:24.593041 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1082/2143] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:24 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:24.594491 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea3497-f8c6-4503-9451-46781f2c9045 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:24.594832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea3497-f8c6-4503-9451-46781f2c9045 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:24.595113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea3497-f8c6-4503-9451-46781f2c9045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:24.629386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-49ea3497-f8c6-4503-9451-46781f2c9045 None None] MFA Rules not processed for user `3b6050251a924b2b8f0ca1b61dcaf634`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:24.630617 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-49ea3497-f8c6-4503-9451-46781f2c9045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:24.647437 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:24.672034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5976895-7bc7-43cb-a9a9-f512513c2d30 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:24.678602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d1eba-77a8-4e0e-8a99-499509dc06fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:24.679627 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d1eba-77a8-4e0e-8a99-499509dc06fa admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:24.679929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d1eba-77a8-4e0e-8a99-499509dc06fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:24.680342 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d1eba-77a8-4e0e-8a99-499509dc06fa admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:24.681151 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d1eba-77a8-4e0e-8a99-499509dc06fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:24.683448 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d1eba-77a8-4e0e-8a99-499509dc06fa admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:24.704843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:24.722366 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1083/2144] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:24.723577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea3497-f8c6-4503-9451-46781f2c9045 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:24.739717 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea3497-f8c6-4503-9451-46781f2c9045 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:24.746377 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c7bff-2f9b-4861-8b48-e1e46ad450d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:24.748836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c7bff-2f9b-4861-8b48-e1e46ad450d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:24.749339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c7bff-2f9b-4861-8b48-e1e46ad450d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:24.749761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c7bff-2f9b-4861-8b48-e1e46ad450d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:24.750713 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c7bff-2f9b-4861-8b48-e1e46ad450d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:24.752589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c7bff-2f9b-4861-8b48-e1e46ad450d1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:24.755965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1062/2145] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:24 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:24.755965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d1eba-77a8-4e0e-8a99-499509dc06fa admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:24.769421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1084/2146] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:24.770459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c7bff-2f9b-4861-8b48-e1e46ad450d1 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:24.775413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d1eba-77a8-4e0e-8a99-499509dc06fa admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:24.816052 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b0add-74f7-4243-bc54-8c1f850774d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:24.817132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b0add-74f7-4243-bc54-8c1f850774d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:24.817415 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b0add-74f7-4243-bc54-8c1f850774d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:24.817811 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b0add-74f7-4243-bc54-8c1f850774d2 admin admin] PATH_INFO: `/v3/users/05488c1172874c71960d001eb391a19f` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:24.819174 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b0add-74f7-4243-bc54-8c1f850774d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05488c1172874c71960d001eb391a19f)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:24.821183 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b0add-74f7-4243-bc54-8c1f850774d2 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:24.900819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c7bff-2f9b-4861-8b48-e1e46ad450d1 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:24.906109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35511d3-67ac-4e14-84c1-e6ffbd084cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:24.906802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35511d3-67ac-4e14-84c1-e6ffbd084cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:24.907292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35511d3-67ac-4e14-84c1-e6ffbd084cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:24.907479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35511d3-67ac-4e14-84c1-e6ffbd084cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:24.926219 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35511d3-67ac-4e14-84c1-e6ffbd084cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:24.929786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35511d3-67ac-4e14-84c1-e6ffbd084cc2 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:24.943860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-146b0add-74f7-4243-bc54-8c1f850774d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05488c1172874c71960d001eb391a19f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:24.954482 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1085/2147] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:24.955548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35511d3-67ac-4e14-84c1-e6ffbd084cc2 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:24.968616 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-146b0add-74f7-4243-bc54-8c1f850774d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05488c1172874c71960d001eb391a19f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:24.971247 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-146b0add-74f7-4243-bc54-8c1f850774d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05488c1172874c71960d001eb391a19f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:24.972335 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-146b0add-74f7-4243-bc54-8c1f850774d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05488c1172874c71960d001eb391a19f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:24.977116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35511d3-67ac-4e14-84c1-e6ffbd084cc2 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:24.991171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-146b0add-74f7-4243-bc54-8c1f850774d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05488c1172874c71960d001eb391a19f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:24.998607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fe951-1a66-47ee-bb7d-e996f7714678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:24.999316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fe951-1a66-47ee-bb7d-e996f7714678 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:24.999651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fe951-1a66-47ee-bb7d-e996f7714678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:24.999944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fe951-1a66-47ee-bb7d-e996f7714678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:25.000866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fe951-1a66-47ee-bb7d-e996f7714678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:25.002509 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fe951-1a66-47ee-bb7d-e996f7714678 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:25.029246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1086/2148] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:25.037697 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1063/2149] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:24 2022] DELETE /identity/v3/users/05488c1172874c71960d001eb391a19f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:25.038584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b0add-74f7-4243-bc54-8c1f850774d2 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:25.039685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fe951-1a66-47ee-bb7d-e996f7714678 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:25.040289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-146b0add-74f7-4243-bc54-8c1f850774d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:25.045886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6e3fe951-1a66-47ee-bb7d-e996f7714678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:25.072459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fe951-1a66-47ee-bb7d-e996f7714678 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:25.163535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0877309-6f2f-4d58-bcb7-7d8d351f94fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:25.164668 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0877309-6f2f-4d58-bcb7-7d8d351f94fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:25.164979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0877309-6f2f-4d58-bcb7-7d8d351f94fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:25.165259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0877309-6f2f-4d58-bcb7-7d8d351f94fa admin admin] PATH_INFO: `/v3/projects/e0e2c575380542eea28adcd0d14ff043/users/aef868433d39495bbd3827beff290072/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:25.166666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b0add-74f7-4243-bc54-8c1f850774d2 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:25.172468 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce5360-d242-403c-9d5d-f058b6bc9b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:25.173232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce5360-d242-403c-9d5d-f058b6bc9b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:25.173517 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce5360-d242-403c-9d5d-f058b6bc9b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:25.173788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce5360-d242-403c-9d5d-f058b6bc9b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:25.174597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce5360-d242-403c-9d5d-f058b6bc9b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:25.176248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce5360-d242-403c-9d5d-f058b6bc9b9f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:25.192235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1064/2150] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:25.193982 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d0d7c-59c3-406f-b884-0c5ba8cd7beb None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:25.194489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d0d7c-59c3-406f-b884-0c5ba8cd7beb None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:25.194992 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d0d7c-59c3-406f-b884-0c5ba8cd7beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:25.204592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0877309-6f2f-4d58-bcb7-7d8d351f94fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e2c575380542eea28adcd0d14ff043, user_id=aef868433d39495bbd3827beff290072, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:25.207679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0877309-6f2f-4d58-bcb7-7d8d351f94fa admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:25.222750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3d4d0d7c-59c3-406f-b884-0c5ba8cd7beb None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:25.224692 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3d4d0d7c-59c3-406f-b884-0c5ba8cd7beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:25.233313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1087/2151] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:25 2022] PUT /identity/v3/projects/e0e2c575380542eea28adcd0d14ff043/users/aef868433d39495bbd3827beff290072/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:25.233313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0877309-6f2f-4d58-bcb7-7d8d351f94fa admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:25.240301 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a0877309-6f2f-4d58-bcb7-7d8d351f94fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:25.297617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:25.333170 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:25.339705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0877309-6f2f-4d58-bcb7-7d8d351f94fa admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:25.346459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca0480-c4f3-4525-969b-d56fd4eff396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:25.348176 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca0480-c4f3-4525-969b-d56fd4eff396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:25.348176 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca0480-c4f3-4525-969b-d56fd4eff396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:25.348612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca0480-c4f3-4525-969b-d56fd4eff396 admin admin] PATH_INFO: `/v3/users/1e63f3fd5a864644b0b9567e0117dc58` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:25.350153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca0480-c4f3-4525-969b-d56fd4eff396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e63f3fd5a864644b0b9567e0117dc58)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:25.352534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca0480-c4f3-4525-969b-d56fd4eff396 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:25.371648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1065/2152] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:25.376280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d0d7c-59c3-406f-b884-0c5ba8cd7beb None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:25.394719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d0d7c-59c3-406f-b884-0c5ba8cd7beb None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:25.401235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f37b51-6068-40fc-b14c-c0d6207e8f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:25.402405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f37b51-6068-40fc-b14c-c0d6207e8f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:25.403365 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f37b51-6068-40fc-b14c-c0d6207e8f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:25.403747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f37b51-6068-40fc-b14c-c0d6207e8f41 admin admin] PATH_INFO: `/v3/projects/b3e9a41ee2334f8f9512e5843b36a641/users/d91a52e1bd634dc8b7ede66bfd0ae7a8/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:25.425330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f37b51-6068-40fc-b14c-c0d6207e8f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e9a41ee2334f8f9512e5843b36a641, user_id=d91a52e1bd634dc8b7ede66bfd0ae7a8, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:25.435107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f37b51-6068-40fc-b14c-c0d6207e8f41 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:25.453811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e2ca0480-c4f3-4525-969b-d56fd4eff396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e63f3fd5a864644b0b9567e0117dc58'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:25.454826 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e2ca0480-c4f3-4525-969b-d56fd4eff396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e63f3fd5a864644b0b9567e0117dc58'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:25.455509 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e2ca0480-c4f3-4525-969b-d56fd4eff396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e63f3fd5a864644b0b9567e0117dc58'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:25.464811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e2ca0480-c4f3-4525-969b-d56fd4eff396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e63f3fd5a864644b0b9567e0117dc58'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:25.476728 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e2ca0480-c4f3-4525-969b-d56fd4eff396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e63f3fd5a864644b0b9567e0117dc58'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:25.482724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1066/2153] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:25 2022] PUT /identity/v3/projects/b3e9a41ee2334f8f9512e5843b36a641/users/d91a52e1bd634dc8b7ede66bfd0ae7a8/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:25.483931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f37b51-6068-40fc-b14c-c0d6207e8f41 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:25.485682 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e4f37b51-6068-40fc-b14c-c0d6207e8f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:25.506874 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1088/2154] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:25 2022] DELETE /identity/v3/users/1e63f3fd5a864644b0b9567e0117dc58 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:25.508646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca0480-c4f3-4525-969b-d56fd4eff396 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:25.512396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e2ca0480-c4f3-4525-969b-d56fd4eff396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:25.588667 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca0480-c4f3-4525-969b-d56fd4eff396 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:25.593486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d568d3-b0ba-421a-beab-6980d38bdd03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:25.594773 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d568d3-b0ba-421a-beab-6980d38bdd03 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:25.595056 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d568d3-b0ba-421a-beab-6980d38bdd03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:25.595330 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d568d3-b0ba-421a-beab-6980d38bdd03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:25.598238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-94d568d3-b0ba-421a-beab-6980d38bdd03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:25.641101 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f37b51-6068-40fc-b14c-c0d6207e8f41 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:25.731580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d568d3-b0ba-421a-beab-6980d38bdd03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:25.733261 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d568d3-b0ba-421a-beab-6980d38bdd03 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:25.750415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1089/2155] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:25.751839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4684b-f7a5-435c-bce2-3bf79ec597fd None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:25.752195 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4684b-f7a5-435c-bce2-3bf79ec597fd None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:25.752410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4684b-f7a5-435c-bce2-3bf79ec597fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:25.790775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5bc4684b-f7a5-435c-bce2-3bf79ec597fd None None] MFA Rules not processed for user `d91a52e1bd634dc8b7ede66bfd0ae7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:25.792916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373ebe5-dc1e-40b4-b044-a792ea0205ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:25.793885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373ebe5-dc1e-40b4-b044-a792ea0205ba admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:25.796783 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5bc4684b-f7a5-435c-bce2-3bf79ec597fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:25.797272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373ebe5-dc1e-40b4-b044-a792ea0205ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:25.797697 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373ebe5-dc1e-40b4-b044-a792ea0205ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:25.798598 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373ebe5-dc1e-40b4-b044-a792ea0205ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:25.800567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373ebe5-dc1e-40b4-b044-a792ea0205ba admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:25.819318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1067/2156] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:25.823944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a5a21-0dd4-4949-ae91-164b1c8343ab None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:25.824301 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a5a21-0dd4-4949-ae91-164b1c8343ab None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:25.824739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a5a21-0dd4-4949-ae91-164b1c8343ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:25.837170 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:25.854953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a48a5a21-0dd4-4949-ae91-164b1c8343ab None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:25.857606 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a48a5a21-0dd4-4949-ae91-164b1c8343ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:25.895092 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1068/2157] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:25.896159 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a5a21-0dd4-4949-ae91-164b1c8343ab None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:25.921065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a5a21-0dd4-4949-ae91-164b1c8343ab None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:25.939628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e499472-8b8d-4ebe-bc9a-59c00d2d33c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:25.940785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e499472-8b8d-4ebe-bc9a-59c00d2d33c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:25.941236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e499472-8b8d-4ebe-bc9a-59c00d2d33c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:25.941603 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e499472-8b8d-4ebe-bc9a-59c00d2d33c1 admin admin] PATH_INFO: `/v3/projects/e0e2c575380542eea28adcd0d14ff043/users/aef868433d39495bbd3827beff290072/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:25.943915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e499472-8b8d-4ebe-bc9a-59c00d2d33c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e2c575380542eea28adcd0d14ff043, user_id=aef868433d39495bbd3827beff290072, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:25.946903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e499472-8b8d-4ebe-bc9a-59c00d2d33c1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:25.970430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1069/2158] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:25 2022] PUT /identity/v3/projects/e0e2c575380542eea28adcd0d14ff043/users/aef868433d39495bbd3827beff290072/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:25.971376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e499472-8b8d-4ebe-bc9a-59c00d2d33c1 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:25.973531 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5e499472-8b8d-4ebe-bc9a-59c00d2d33c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:25.999576 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1090/2159] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:26.001004 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5324ad-07a5-48b2-9352-c0ba6d90284c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:26.001294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5324ad-07a5-48b2-9352-c0ba6d90284c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:26.001571 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5324ad-07a5-48b2-9352-c0ba6d90284c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:26.074863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0a5324ad-07a5-48b2-9352-c0ba6d90284c None None] MFA Rules not processed for user `aef868433d39495bbd3827beff290072`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:26.076160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0a5324ad-07a5-48b2-9352-c0ba6d90284c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:26.135958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:26.152783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e499472-8b8d-4ebe-bc9a-59c00d2d33c1 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:26.167652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c95633-8c0e-4310-a0d5-577462d54469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:26.168690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c95633-8c0e-4310-a0d5-577462d54469 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:26.170604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c95633-8c0e-4310-a0d5-577462d54469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:26.175120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c95633-8c0e-4310-a0d5-577462d54469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:26.268598 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1091/2160] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:26.268598 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5324ad-07a5-48b2-9352-c0ba6d90284c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:26.282809 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0a5324ad-07a5-48b2-9352-c0ba6d90284c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:26.344156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c95633-8c0e-4310-a0d5-577462d54469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:26.345624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c95633-8c0e-4310-a0d5-577462d54469 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:26.382588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1070/2161] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:26.383742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c95633-8c0e-4310-a0d5-577462d54469 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:26.391549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-00c95633-8c0e-4310-a0d5-577462d54469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:26.420370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5324ad-07a5-48b2-9352-c0ba6d90284c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:26.426713 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5775c78-8fed-47ed-a65e-939ad4365b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:26.427529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5775c78-8fed-47ed-a65e-939ad4365b0d admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:26.427940 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5775c78-8fed-47ed-a65e-939ad4365b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:26.428315 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5775c78-8fed-47ed-a65e-939ad4365b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:26.429407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5775c78-8fed-47ed-a65e-939ad4365b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:26.431986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5775c78-8fed-47ed-a65e-939ad4365b0d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:26.514521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1092/2162] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:26 2022] POST /identity/v3/projects => generated 387 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:26.515422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5775c78-8fed-47ed-a65e-939ad4365b0d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:26.517428 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f5775c78-8fed-47ed-a65e-939ad4365b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:26.518284 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c95633-8c0e-4310-a0d5-577462d54469 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:26.560815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:26.589100 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86b589-fc46-4a75-ad37-98654b4e45af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:26.589915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86b589-fc46-4a75-ad37-98654b4e45af service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:26.591614 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86b589-fc46-4a75-ad37-98654b4e45af service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:26.591614 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86b589-fc46-4a75-ad37-98654b4e45af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:26.599992 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5d86b589-fc46-4a75-ad37-98654b4e45af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:26.621817 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5775c78-8fed-47ed-a65e-939ad4365b0d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:26.626753 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa4352-b81f-45ab-b928-aab9ae3c883d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:26.627679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa4352-b81f-45ab-b928-aab9ae3c883d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:26.627966 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa4352-b81f-45ab-b928-aab9ae3c883d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:26.628243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa4352-b81f-45ab-b928-aab9ae3c883d admin admin] PATH_INFO: `/v3/users/a2bf981796a44c9196b98c2a196a044a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:26.629463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa4352-b81f-45ab-b928-aab9ae3c883d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2bf981796a44c9196b98c2a196a044a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:26.631398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa4352-b81f-45ab-b928-aab9ae3c883d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:26.703192 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-87aa4352-b81f-45ab-b928-aab9ae3c883d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2bf981796a44c9196b98c2a196a044a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:26.704204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-87aa4352-b81f-45ab-b928-aab9ae3c883d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2bf981796a44c9196b98c2a196a044a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:26.705109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-87aa4352-b81f-45ab-b928-aab9ae3c883d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2bf981796a44c9196b98c2a196a044a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:26.718994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86b589-fc46-4a75-ad37-98654b4e45af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:26.720376 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-87aa4352-b81f-45ab-b928-aab9ae3c883d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2bf981796a44c9196b98c2a196a044a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:26.720687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86b589-fc46-4a75-ad37-98654b4e45af service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:26.735038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-87aa4352-b81f-45ab-b928-aab9ae3c883d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2bf981796a44c9196b98c2a196a044a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:26.743141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:26.756996 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1071/2163] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:26.757925 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86b589-fc46-4a75-ad37-98654b4e45af service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:26.771136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1093/2164] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:26 2022] DELETE /identity/v3/users/a2bf981796a44c9196b98c2a196a044a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:26.771136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa4352-b81f-45ab-b928-aab9ae3c883d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:26.772827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-87aa4352-b81f-45ab-b928-aab9ae3c883d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:26.785342 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86b589-fc46-4a75-ad37-98654b4e45af service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:26.858809 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa4352-b81f-45ab-b928-aab9ae3c883d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:26.864617 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498d801-024d-4c3e-84bb-0c8ecdf02430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:26.865673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498d801-024d-4c3e-84bb-0c8ecdf02430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:26.866112 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498d801-024d-4c3e-84bb-0c8ecdf02430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:26.866837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498d801-024d-4c3e-84bb-0c8ecdf02430 admin admin] PATH_INFO: `/v3/projects/8c984367b0e54f1a89295bae2117d48d` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:26.869212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498d801-024d-4c3e-84bb-0c8ecdf02430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c984367b0e54f1a89295bae2117d48d)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:26.871727 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498d801-024d-4c3e-84bb-0c8ecdf02430 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:26.893296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edc4b8-924b-4514-9306-0c71d6e48c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:26.894097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edc4b8-924b-4514-9306-0c71d6e48c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:26.894390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edc4b8-924b-4514-9306-0c71d6e48c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:26.895368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edc4b8-924b-4514-9306-0c71d6e48c29 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:26.896178 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edc4b8-924b-4514-9306-0c71d6e48c29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:26.899296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edc4b8-924b-4514-9306-0c71d6e48c29 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:26.949538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1072/2165] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:26 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:26.951544 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea121e0-a750-4fa7-afeb-1143b4e194bc None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:26.951871 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea121e0-a750-4fa7-afeb-1143b4e194bc None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:26.952334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea121e0-a750-4fa7-afeb-1143b4e194bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:26.968182 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:26.970526 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b498d801-024d-4c3e-84bb-0c8ecdf02430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c984367b0e54f1a89295bae2117d48d', 'request_id': 'req-b498d801-024d-4c3e-84bb-0c8ecdf02430'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:26.978113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3ea121e0-a750-4fa7-afeb-1143b4e194bc None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:26.979354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3ea121e0-a750-4fa7-afeb-1143b4e194bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:26.986978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b498d801-024d-4c3e-84bb-0c8ecdf02430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c984367b0e54f1a89295bae2117d48d', 'request_id': 'req-b498d801-024d-4c3e-84bb-0c8ecdf02430'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.000403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b498d801-024d-4c3e-84bb-0c8ecdf02430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c984367b0e54f1a89295bae2117d48d', 'request_id': 'req-b498d801-024d-4c3e-84bb-0c8ecdf02430'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.018149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b498d801-024d-4c3e-84bb-0c8ecdf02430 admin admin] The token cache is being invalidate because project 8c984367b0e54f1a89295bae2117d48d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:27.018460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b498d801-024d-4c3e-84bb-0c8ecdf02430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.019320 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-b498d801-024d-4c3e-84bb-0c8ecdf02430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.023693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1094/2166] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:26 2022] DELETE /identity/v3/projects/8c984367b0e54f1a89295bae2117d48d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:27.028479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab2cf5-e987-4d83-944a-5711ba6b2015 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:27.028992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab2cf5-e987-4d83-944a-5711ba6b2015 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:27.029269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab2cf5-e987-4d83-944a-5711ba6b2015 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:27.031089 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1095/2167] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 08:31:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:27.032028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab2cf5-e987-4d83-944a-5711ba6b2015 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:27.044170 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-faab2cf5-e987-4d83-944a-5711ba6b2015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:27.072664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1073/2168] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:27.073625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea121e0-a750-4fa7-afeb-1143b4e194bc None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:27.079844 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3ea121e0-a750-4fa7-afeb-1143b4e194bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:27.092809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea121e0-a750-4fa7-afeb-1143b4e194bc None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:27.098064 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c122d0-8b2a-4508-aa87-981bad71d096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:27.103026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c122d0-8b2a-4508-aa87-981bad71d096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:27.103330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c122d0-8b2a-4508-aa87-981bad71d096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:27.103611 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c122d0-8b2a-4508-aa87-981bad71d096 admin admin] PATH_INFO: `/v3/users/4401e25f8d434f8d92875f16874b8c4d` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:27.105053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c122d0-8b2a-4508-aa87-981bad71d096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4401e25f8d434f8d92875f16874b8c4d)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:27.107738 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c122d0-8b2a-4508-aa87-981bad71d096 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:27.144243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab2cf5-e987-4d83-944a-5711ba6b2015 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:27.150303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ec0bf-02d1-478c-81f3-b420e4552d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:27.151273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ec0bf-02d1-478c-81f3-b420e4552d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:27.151638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ec0bf-02d1-478c-81f3-b420e4552d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:27.151880 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ec0bf-02d1-478c-81f3-b420e4552d3e admin admin] PATH_INFO: `/v3/projects/8abbfe1cef044cda9a92872176849abb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:27.153242 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ec0bf-02d1-478c-81f3-b420e4552d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8abbfe1cef044cda9a92872176849abb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:27.155580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ec0bf-02d1-478c-81f3-b420e4552d3e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:27.190565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-41c122d0-8b2a-4508-aa87-981bad71d096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4401e25f8d434f8d92875f16874b8c4d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.218074 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-41c122d0-8b2a-4508-aa87-981bad71d096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4401e25f8d434f8d92875f16874b8c4d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.219009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-41c122d0-8b2a-4508-aa87-981bad71d096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4401e25f8d434f8d92875f16874b8c4d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.219628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-41c122d0-8b2a-4508-aa87-981bad71d096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4401e25f8d434f8d92875f16874b8c4d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.222443 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d12ec0bf-02d1-478c-81f3-b420e4552d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8abbfe1cef044cda9a92872176849abb', 'request_id': 'req-d12ec0bf-02d1-478c-81f3-b420e4552d3e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.236987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-41c122d0-8b2a-4508-aa87-981bad71d096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4401e25f8d434f8d92875f16874b8c4d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.238589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d12ec0bf-02d1-478c-81f3-b420e4552d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8abbfe1cef044cda9a92872176849abb', 'request_id': 'req-d12ec0bf-02d1-478c-81f3-b420e4552d3e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.252242 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d12ec0bf-02d1-478c-81f3-b420e4552d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8abbfe1cef044cda9a92872176849abb', 'request_id': 'req-d12ec0bf-02d1-478c-81f3-b420e4552d3e'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.270327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1074/2169] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:27 2022] DELETE /identity/v3/users/4401e25f8d434f8d92875f16874b8c4d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:27.271948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c122d0-8b2a-4508-aa87-981bad71d096 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:27.285958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d12ec0bf-02d1-478c-81f3-b420e4552d3e admin admin] The token cache is being invalidate because project 8abbfe1cef044cda9a92872176849abb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:27.286570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d12ec0bf-02d1-478c-81f3-b420e4552d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.287468 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d12ec0bf-02d1-478c-81f3-b420e4552d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.288880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-41c122d0-8b2a-4508-aa87-981bad71d096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:27.293161 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1096/2170] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:27 2022] DELETE /identity/v3/projects/8abbfe1cef044cda9a92872176849abb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:27.295008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ec0bf-02d1-478c-81f3-b420e4552d3e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:27.297658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d12ec0bf-02d1-478c-81f3-b420e4552d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:27.307024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:27.402265 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ec0bf-02d1-478c-81f3-b420e4552d3e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:27.407530 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c122d0-8b2a-4508-aa87-981bad71d096 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:27.407969 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae479a0-6f93-4c94-8467-b09a35debd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:27.409040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae479a0-6f93-4c94-8467-b09a35debd37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:27.409382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae479a0-6f93-4c94-8467-b09a35debd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:27.409715 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae479a0-6f93-4c94-8467-b09a35debd37 admin admin] PATH_INFO: `/v3/users/0814ed4adbc2402e91df3965f864e9d3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:27.411158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae479a0-6f93-4c94-8467-b09a35debd37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0814ed4adbc2402e91df3965f864e9d3)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:27.413468 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae479a0-6f93-4c94-8467-b09a35debd37 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:27.413918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6774643-c30b-43e7-88e6-be4ac5ad9e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:27.414613 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774643-c30b-43e7-88e6-be4ac5ad9e0c admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:27.414899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774643-c30b-43e7-88e6-be4ac5ad9e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:27.415177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774643-c30b-43e7-88e6-be4ac5ad9e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:27.415952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6774643-c30b-43e7-88e6-be4ac5ad9e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:27.422484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6774643-c30b-43e7-88e6-be4ac5ad9e0c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:27.428620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:27.453767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1075/2171] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:27.457663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e87ea-03a8-497d-8ed4-6ca66a6509a9 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:27.458535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e87ea-03a8-497d-8ed4-6ca66a6509a9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:27.458535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e87ea-03a8-497d-8ed4-6ca66a6509a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:27.487791 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-d49e87ea-03a8-497d-8ed4-6ca66a6509a9 None None] MFA Rules not processed for user `b1146aa09d30458f9ab3b3bec8f94233`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:27.489028 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d49e87ea-03a8-497d-8ed4-6ca66a6509a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:27.511564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0ae479a0-6f93-4c94-8467-b09a35debd37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0814ed4adbc2402e91df3965f864e9d3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.513906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0ae479a0-6f93-4c94-8467-b09a35debd37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0814ed4adbc2402e91df3965f864e9d3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.514827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0ae479a0-6f93-4c94-8467-b09a35debd37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0814ed4adbc2402e91df3965f864e9d3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.525706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0ae479a0-6f93-4c94-8467-b09a35debd37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0814ed4adbc2402e91df3965f864e9d3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.542045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0ae479a0-6f93-4c94-8467-b09a35debd37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0814ed4adbc2402e91df3965f864e9d3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.577116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1097/2172] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:27 2022] DELETE /identity/v3/users/0814ed4adbc2402e91df3965f864e9d3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:27.578838 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae479a0-6f93-4c94-8467-b09a35debd37 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:27.580991 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0ae479a0-6f93-4c94-8467-b09a35debd37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:27.590883 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1076/2173] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 08:31:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:27.592923 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e87ea-03a8-497d-8ed4-6ca66a6509a9 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:27.594630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d49e87ea-03a8-497d-8ed4-6ca66a6509a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:27.612825 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e87ea-03a8-497d-8ed4-6ca66a6509a9 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:27.694691 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae479a0-6f93-4c94-8467-b09a35debd37 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:27.698703 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd947c41-7404-4015-8144-5870e884d5e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:27.700104 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd947c41-7404-4015-8144-5870e884d5e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:27.700490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd947c41-7404-4015-8144-5870e884d5e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:27.700762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd947c41-7404-4015-8144-5870e884d5e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:27.705776 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fd947c41-7404-4015-8144-5870e884d5e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:27.729594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e967cd8-6c67-4297-b189-f4374b75e5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:27.731036 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e967cd8-6c67-4297-b189-f4374b75e5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:27.731429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e967cd8-6c67-4297-b189-f4374b75e5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:27.732115 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e967cd8-6c67-4297-b189-f4374b75e5bf admin admin] PATH_INFO: `/v3/users/3b6050251a924b2b8f0ca1b61dcaf634` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:27.733565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e967cd8-6c67-4297-b189-f4374b75e5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b6050251a924b2b8f0ca1b61dcaf634)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:27.735910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e967cd8-6c67-4297-b189-f4374b75e5bf admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:27.800715 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:27.807249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd947c41-7404-4015-8144-5870e884d5e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:27.809609 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd947c41-7404-4015-8144-5870e884d5e5 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:27.813973 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7e967cd8-6c67-4297-b189-f4374b75e5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b6050251a924b2b8f0ca1b61dcaf634'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.821557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1098/2174] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:27.822738 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd947c41-7404-4015-8144-5870e884d5e5 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:27.824146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fd947c41-7404-4015-8144-5870e884d5e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:27.836996 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7e967cd8-6c67-4297-b189-f4374b75e5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b6050251a924b2b8f0ca1b61dcaf634'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.837242 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd947c41-7404-4015-8144-5870e884d5e5 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:27.838801 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7e967cd8-6c67-4297-b189-f4374b75e5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b6050251a924b2b8f0ca1b61dcaf634'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.839712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7e967cd8-6c67-4297-b189-f4374b75e5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b6050251a924b2b8f0ca1b61dcaf634'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.842221 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96210738-c211-492c-ae5c-00c3ccb66485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:27.843142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96210738-c211-492c-ae5c-00c3ccb66485 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:27.843425 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96210738-c211-492c-ae5c-00c3ccb66485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:27.843744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96210738-c211-492c-ae5c-00c3ccb66485 admin admin] PATH_INFO: `/v3/projects/a0b344b541494af3911c6d9b1409c78a/users/7b76f7782b82434b925d7c5450414c5b/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:27.851726 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7e967cd8-6c67-4297-b189-f4374b75e5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b6050251a924b2b8f0ca1b61dcaf634'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:27.863772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96210738-c211-492c-ae5c-00c3ccb66485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b344b541494af3911c6d9b1409c78a, user_id=7b76f7782b82434b925d7c5450414c5b, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:27.867690 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96210738-c211-492c-ae5c-00c3ccb66485 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:27.878623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1077/2175] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:27 2022] DELETE /identity/v3/users/3b6050251a924b2b8f0ca1b61dcaf634 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:27.881323 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e967cd8-6c67-4297-b189-f4374b75e5bf admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:27.883525 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7e967cd8-6c67-4297-b189-f4374b75e5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:27.888151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1099/2176] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:27 2022] PUT /identity/v3/projects/a0b344b541494af3911c6d9b1409c78a/users/7b76f7782b82434b925d7c5450414c5b/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:27.889287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96210738-c211-492c-ae5c-00c3ccb66485 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:27.892830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-96210738-c211-492c-ae5c-00c3ccb66485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:27.913722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:28.002598 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96210738-c211-492c-ae5c-00c3ccb66485 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:28.010098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ba7fb-e27a-4d97-acd1-e3ec15078c2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1146aa09d30458f9ab3b3bec8f94233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:28.011564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ba7fb-e27a-4d97-acd1-e3ec15078c2b service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.012472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ba7fb-e27a-4d97-acd1-e3ec15078c2b service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.013044 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ba7fb-e27a-4d97-acd1-e3ec15078c2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.015586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8a6ba7fb-e27a-4d97-acd1-e3ec15078c2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.028695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ba7fb-e27a-4d97-acd1-e3ec15078c2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:28.030770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ba7fb-e27a-4d97-acd1-e3ec15078c2b service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:28.032267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e967cd8-6c67-4297-b189-f4374b75e5bf admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:28.042329 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1100/2177] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:28.043562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ba7fb-e27a-4d97-acd1-e3ec15078c2b service placement] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:28.045092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8a6ba7fb-e27a-4d97-acd1-e3ec15078c2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.132653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ba7fb-e27a-4d97-acd1-e3ec15078c2b service placement] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:28.136939 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89125f-1776-4be3-8976-e25f76c1b8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:28.138023 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89125f-1776-4be3-8976-e25f76c1b8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.138334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89125f-1776-4be3-8976-e25f76c1b8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.138584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89125f-1776-4be3-8976-e25f76c1b8c0 admin admin] PATH_INFO: `/v3/projects/3e29a1a57a7944859207b4fb4c89dec8` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.139247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225abd6-2b4d-4239-8445-7701c5a9c637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:28.139920 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89125f-1776-4be3-8976-e25f76c1b8c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e29a1a57a7944859207b4fb4c89dec8)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:28.140178 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225abd6-2b4d-4239-8445-7701c5a9c637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.140459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225abd6-2b4d-4239-8445-7701c5a9c637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.140898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225abd6-2b4d-4239-8445-7701c5a9c637 admin admin] PATH_INFO: `/v3/users/17e0a2ee31be43b6b92f6e96bc64d73a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.142433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225abd6-2b4d-4239-8445-7701c5a9c637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e0a2ee31be43b6b92f6e96bc64d73a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:28.142566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89125f-1776-4be3-8976-e25f76c1b8c0 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:28.145065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225abd6-2b4d-4239-8445-7701c5a9c637 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:28.217909 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5c89125f-1776-4be3-8976-e25f76c1b8c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e29a1a57a7944859207b4fb4c89dec8', 'request_id': 'req-5c89125f-1776-4be3-8976-e25f76c1b8c0'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.220743 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e225abd6-2b4d-4239-8445-7701c5a9c637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e0a2ee31be43b6b92f6e96bc64d73a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.221686 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e225abd6-2b4d-4239-8445-7701c5a9c637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e0a2ee31be43b6b92f6e96bc64d73a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.222535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e225abd6-2b4d-4239-8445-7701c5a9c637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e0a2ee31be43b6b92f6e96bc64d73a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.226132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5c89125f-1776-4be3-8976-e25f76c1b8c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e29a1a57a7944859207b4fb4c89dec8', 'request_id': 'req-5c89125f-1776-4be3-8976-e25f76c1b8c0'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.236002 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e225abd6-2b4d-4239-8445-7701c5a9c637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e0a2ee31be43b6b92f6e96bc64d73a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.236216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5c89125f-1776-4be3-8976-e25f76c1b8c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e29a1a57a7944859207b4fb4c89dec8', 'request_id': 'req-5c89125f-1776-4be3-8976-e25f76c1b8c0'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.240929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:28.250780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e225abd6-2b4d-4239-8445-7701c5a9c637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e0a2ee31be43b6b92f6e96bc64d73a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.271687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5c89125f-1776-4be3-8976-e25f76c1b8c0 admin admin] The token cache is being invalidate because project 3e29a1a57a7944859207b4fb4c89dec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:28.272731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5c89125f-1776-4be3-8976-e25f76c1b8c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.273928 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5c89125f-1776-4be3-8976-e25f76c1b8c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.275950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1078/2178] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:27 2022] DELETE /identity/v3/projects/3e29a1a57a7944859207b4fb4c89dec8 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:28.276761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89125f-1776-4be3-8976-e25f76c1b8c0 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:28.280851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5c89125f-1776-4be3-8976-e25f76c1b8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.304313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1101/2179] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:28 2022] DELETE /identity/v3/users/17e0a2ee31be43b6b92f6e96bc64d73a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:28.304313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225abd6-2b4d-4239-8445-7701c5a9c637 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:28.305078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e225abd6-2b4d-4239-8445-7701c5a9c637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.334463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:28.397422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89125f-1776-4be3-8976-e25f76c1b8c0 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:28.399454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225abd6-2b4d-4239-8445-7701c5a9c637 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:28.405573 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29ffe4-1621-454a-8f90-fc5794fed2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:28.406352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29ffe4-1621-454a-8f90-fc5794fed2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.406705 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29ffe4-1621-454a-8f90-fc5794fed2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.406983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29ffe4-1621-454a-8f90-fc5794fed2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.408225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29ffe4-1621-454a-8f90-fc5794fed2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:28.410150 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29ffe4-1621-454a-8f90-fc5794fed2e6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:28.417728 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a82c1-299c-405a-9772-0102f6722150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:28.418659 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a82c1-299c-405a-9772-0102f6722150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.419038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a82c1-299c-405a-9772-0102f6722150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.419238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a82c1-299c-405a-9772-0102f6722150 admin admin] PATH_INFO: `/v3/projects/05dfb632df48424a8286a2a1a67daf05` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.420485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a82c1-299c-405a-9772-0102f6722150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05dfb632df48424a8286a2a1a67daf05)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:28.422426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a82c1-299c-405a-9772-0102f6722150 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:28.424249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1079/2180] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:28.425115 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29ffe4-1621-454a-8f90-fc5794fed2e6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:28.427098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7f29ffe4-1621-454a-8f90-fc5794fed2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.440998 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29ffe4-1621-454a-8f90-fc5794fed2e6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:28.446034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43fa55-71a3-4a4c-a50a-7814ba6a3a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:28.447476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43fa55-71a3-4a4c-a50a-7814ba6a3a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.447920 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43fa55-71a3-4a4c-a50a-7814ba6a3a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.448263 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43fa55-71a3-4a4c-a50a-7814ba6a3a31 admin admin] PATH_INFO: `/v3/projects/d71b28dd07494531890d55975e742530` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.449887 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43fa55-71a3-4a4c-a50a-7814ba6a3a31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71b28dd07494531890d55975e742530)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:28.452231 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43fa55-71a3-4a4c-a50a-7814ba6a3a31 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:28.495035 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9b4a82c1-299c-405a-9772-0102f6722150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05dfb632df48424a8286a2a1a67daf05', 'request_id': 'req-9b4a82c1-299c-405a-9772-0102f6722150'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.506560 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9b4a82c1-299c-405a-9772-0102f6722150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05dfb632df48424a8286a2a1a67daf05', 'request_id': 'req-9b4a82c1-299c-405a-9772-0102f6722150'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.514768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9b4a82c1-299c-405a-9772-0102f6722150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05dfb632df48424a8286a2a1a67daf05', 'request_id': 'req-9b4a82c1-299c-405a-9772-0102f6722150'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.519659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4e43fa55-71a3-4a4c-a50a-7814ba6a3a31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71b28dd07494531890d55975e742530', 'request_id': 'req-4e43fa55-71a3-4a4c-a50a-7814ba6a3a31'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.527953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4e43fa55-71a3-4a4c-a50a-7814ba6a3a31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71b28dd07494531890d55975e742530', 'request_id': 'req-4e43fa55-71a3-4a4c-a50a-7814ba6a3a31'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.529599 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9b4a82c1-299c-405a-9772-0102f6722150 admin admin] The token cache is being invalidate because project 05dfb632df48424a8286a2a1a67daf05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:28.529991 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9b4a82c1-299c-405a-9772-0102f6722150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.530759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9b4a82c1-299c-405a-9772-0102f6722150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.532513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1102/2181] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:28 2022] DELETE /identity/v3/projects/05dfb632df48424a8286a2a1a67daf05 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:28.533844 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0d491-a9eb-489f-a754-89a4fc0b744c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.536914 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0d491-a9eb-489f-a754-89a4fc0b744c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.536914 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0d491-a9eb-489f-a754-89a4fc0b744c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.542608 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4e43fa55-71a3-4a4c-a50a-7814ba6a3a31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71b28dd07494531890d55975e742530', 'request_id': 'req-4e43fa55-71a3-4a4c-a50a-7814ba6a3a31'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.555156 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a1c0d491-a9eb-489f-a754-89a4fc0b744c None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:28.556443 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a1c0d491-a9eb-489f-a754-89a4fc0b744c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.562595 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4e43fa55-71a3-4a4c-a50a-7814ba6a3a31 admin admin] The token cache is being invalidate because project d71b28dd07494531890d55975e742530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:28.563084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4e43fa55-71a3-4a4c-a50a-7814ba6a3a31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.563922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4e43fa55-71a3-4a4c-a50a-7814ba6a3a31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.565904 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1080/2182] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:28 2022] DELETE /identity/v3/projects/d71b28dd07494531890d55975e742530 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:28.566962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfecd0a-f54d-441c-8dce-75baf54bd99e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.567248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfecd0a-f54d-441c-8dce-75baf54bd99e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.567529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfecd0a-f54d-441c-8dce-75baf54bd99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.590740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-5cfecd0a-f54d-441c-8dce-75baf54bd99e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:28.592344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5cfecd0a-f54d-441c-8dce-75baf54bd99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.621514 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1103/2183] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:28.622506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0d491-a9eb-489f-a754-89a4fc0b744c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:28.623804 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a1c0d491-a9eb-489f-a754-89a4fc0b744c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.635915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0d491-a9eb-489f-a754-89a4fc0b744c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:28.641338 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:28.642445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.642720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.643038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625 admin admin] PATH_INFO: `/v3/projects/73bb042a4f334518801cc4f2f73bbfa9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.644341 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73bb042a4f334518801cc4f2f73bbfa9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:28.646351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:28.665359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1081/2184] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:28.666492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfecd0a-f54d-441c-8dce-75baf54bd99e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:28.667792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5cfecd0a-f54d-441c-8dce-75baf54bd99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.685587 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfecd0a-f54d-441c-8dce-75baf54bd99e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:28.691454 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdee92a-2cb0-41e8-a223-82658b998cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:28.692579 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdee92a-2cb0-41e8-a223-82658b998cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.692909 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdee92a-2cb0-41e8-a223-82658b998cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.693364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdee92a-2cb0-41e8-a223-82658b998cbd admin admin] PATH_INFO: `/v3/projects/a0b344b541494af3911c6d9b1409c78a/users/7b76f7782b82434b925d7c5450414c5b/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.695375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdee92a-2cb0-41e8-a223-82658b998cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b344b541494af3911c6d9b1409c78a, user_id=7b76f7782b82434b925d7c5450414c5b, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:28.698159 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdee92a-2cb0-41e8-a223-82658b998cbd admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:28.699542 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:28.702439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73bb042a4f334518801cc4f2f73bbfa9', 'request_id': 'req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.706274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:28.712108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1082/2185] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:28 2022] PUT /identity/v3/projects/a0b344b541494af3911c6d9b1409c78a/users/7b76f7782b82434b925d7c5450414c5b/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:28.715859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73bb042a4f334518801cc4f2f73bbfa9', 'request_id': 'req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.723660 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73bb042a4f334518801cc4f2f73bbfa9', 'request_id': 'req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.723962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2545bd-2886-4a48-9434-826e8879fd9b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.724265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2545bd-2886-4a48-9434-826e8879fd9b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.724550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2545bd-2886-4a48-9434-826e8879fd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.739043 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625 admin admin] The token cache is being invalidate because project 73bb042a4f334518801cc4f2f73bbfa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:28.739443 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.740219 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.742547 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1104/2186] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:28 2022] DELETE /identity/v3/projects/73bb042a4f334518801cc4f2f73bbfa9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:28.743255 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:28.744672 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.749656 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6b2545bd-2886-4a48-9434-826e8879fd9b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:28.751096 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6b2545bd-2886-4a48-9434-826e8879fd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.819766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c06b7-3cf2-42fa-a02e-b9c8cc6c3625 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:28.831111 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1083/2187] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:28.838824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f9caa-73d7-40a2-aaf6-73d40b6007a4 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.838824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f9caa-73d7-40a2-aaf6-73d40b6007a4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.838824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f9caa-73d7-40a2-aaf6-73d40b6007a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.855024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-024f9caa-73d7-40a2-aaf6-73d40b6007a4 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:28.856712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-024f9caa-73d7-40a2-aaf6-73d40b6007a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.868363 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1084/2188] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:28.868363 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f9caa-73d7-40a2-aaf6-73d40b6007a4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:28.873029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-024f9caa-73d7-40a2-aaf6-73d40b6007a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.889765 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bd9ad-9723-457a-89d9-5f9b5f3637b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:28.890910 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd9ad-9723-457a-89d9-5f9b5f3637b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.891304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd9ad-9723-457a-89d9-5f9b5f3637b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.891586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd9ad-9723-457a-89d9-5f9b5f3637b0 admin admin] PATH_INFO: `/v3/users/571d225b2db942969c837bd831198a1f` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.892903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bd9ad-9723-457a-89d9-5f9b5f3637b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571d225b2db942969c837bd831198a1f)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:28.894902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bd9ad-9723-457a-89d9-5f9b5f3637b0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:28.931837 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f9caa-73d7-40a2-aaf6-73d40b6007a4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:28.936358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf883d2e-fab9-4915-9281-b520fc760c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:28.937024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf883d2e-fab9-4915-9281-b520fc760c9f service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.937311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf883d2e-fab9-4915-9281-b520fc760c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.937603 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf883d2e-fab9-4915-9281-b520fc760c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.939462 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-cf883d2e-fab9-4915-9281-b520fc760c9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.943792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d71bd9ad-9723-457a-89d9-5f9b5f3637b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571d225b2db942969c837bd831198a1f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.944477 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d71bd9ad-9723-457a-89d9-5f9b5f3637b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571d225b2db942969c837bd831198a1f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.945095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d71bd9ad-9723-457a-89d9-5f9b5f3637b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571d225b2db942969c837bd831198a1f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.952396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d71bd9ad-9723-457a-89d9-5f9b5f3637b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571d225b2db942969c837bd831198a1f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.952524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf883d2e-fab9-4915-9281-b520fc760c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:28.953943 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf883d2e-fab9-4915-9281-b520fc760c9f service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:28.961340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d71bd9ad-9723-457a-89d9-5f9b5f3637b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571d225b2db942969c837bd831198a1f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:28.963748 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1085/2189] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:28.965320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22757cce-dcc3-465e-8861-f98419136da3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.965622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22757cce-dcc3-465e-8861-f98419136da3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.965903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22757cce-dcc3-465e-8861-f98419136da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.977119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:28.982615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1105/2190] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:28 2022] DELETE /identity/v3/users/571d225b2db942969c837bd831198a1f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:28.994511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-22757cce-dcc3-465e-8861-f98419136da3 None None] MFA Rules not processed for user `7b76f7782b82434b925d7c5450414c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:28.996171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-22757cce-dcc3-465e-8861-f98419136da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.998637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4570b9-4b55-40f9-9baa-8415add26e20 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.998637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4570b9-4b55-40f9-9baa-8415add26e20 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.998909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4570b9-4b55-40f9-9baa-8415add26e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.038779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-aa4570b9-4b55-40f9-9baa-8415add26e20 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:29.040105 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-aa4570b9-4b55-40f9-9baa-8415add26e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:29.108102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1086/2191] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:29.110693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1883a-c741-4f6d-9de3-e35996773ef0 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:29.111091 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1883a-c741-4f6d-9de3-e35996773ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:29.111544 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1883a-c741-4f6d-9de3-e35996773ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.120674 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1106/2192] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:29.122047 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4570b9-4b55-40f9-9baa-8415add26e20 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:29.124813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-aa4570b9-4b55-40f9-9baa-8415add26e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:29.134082 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a4d1883a-c741-4f6d-9de3-e35996773ef0 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:29.135310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a4d1883a-c741-4f6d-9de3-e35996773ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:29.146220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1087/2193] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:29.146220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1883a-c741-4f6d-9de3-e35996773ef0 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:29.146866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a4d1883a-c741-4f6d-9de3-e35996773ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:29.154796 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4570b9-4b55-40f9-9baa-8415add26e20 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:29.165083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:29.176524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ec3fe-2330-4422-b2c3-51f8e12b7e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:29.177229 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ec3fe-2330-4422-b2c3-51f8e12b7e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:29.177517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ec3fe-2330-4422-b2c3-51f8e12b7e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:29.177795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ec3fe-2330-4422-b2c3-51f8e12b7e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.178555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ec3fe-2330-4422-b2c3-51f8e12b7e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:29.178867 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ec3fe-2330-4422-b2c3-51f8e12b7e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:29.184381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ec3fe-2330-4422-b2c3-51f8e12b7e0e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:29.212881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1107/2194] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:29.214760 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148f3c6-cecb-4ba4-82fe-fe979149326d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:29.215739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148f3c6-cecb-4ba4-82fe-fe979149326d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:29.215852 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1883a-c741-4f6d-9de3-e35996773ef0 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:29.216357 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148f3c6-cecb-4ba4-82fe-fe979149326d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.221008 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6ba26-0f9b-475f-b835-a5f93c36a5ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:29.221679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6ba26-0f9b-475f-b835-a5f93c36a5ec service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:29.221964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6ba26-0f9b-475f-b835-a5f93c36a5ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:29.222241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6ba26-0f9b-475f-b835-a5f93c36a5ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.233476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6ba26-0f9b-475f-b835-a5f93c36a5ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:29.235238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6ba26-0f9b-475f-b835-a5f93c36a5ec service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:29.241654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e148f3c6-cecb-4ba4-82fe-fe979149326d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:29.243087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e148f3c6-cecb-4ba4-82fe-fe979149326d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:29.248272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1088/2195] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:29.249282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6ba26-0f9b-475f-b835-a5f93c36a5ec service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:29.261802 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6ba26-0f9b-475f-b835-a5f93c36a5ec service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:29.267811 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24151888-782d-4d1d-9ff0-470830c8bfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:29.268557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24151888-782d-4d1d-9ff0-470830c8bfbf admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:29.268911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24151888-782d-4d1d-9ff0-470830c8bfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:29.269289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24151888-782d-4d1d-9ff0-470830c8bfbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.270251 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24151888-782d-4d1d-9ff0-470830c8bfbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:29.270554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1108/2196] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:29.273835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24151888-782d-4d1d-9ff0-470830c8bfbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:29.273835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24151888-782d-4d1d-9ff0-470830c8bfbf admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:29.274281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148f3c6-cecb-4ba4-82fe-fe979149326d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:29.290571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1089/2197] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:29.290571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24151888-782d-4d1d-9ff0-470830c8bfbf admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:29.297622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148f3c6-cecb-4ba4-82fe-fe979149326d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:29.306041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24151888-782d-4d1d-9ff0-470830c8bfbf admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:29.312402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa42b4-d29d-498d-98b2-8484736910a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:29.314018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa42b4-d29d-498d-98b2-8484736910a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:29.314846 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa42b4-d29d-498d-98b2-8484736910a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:29.315856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa42b4-d29d-498d-98b2-8484736910a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.316863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa42b4-d29d-498d-98b2-8484736910a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:29.319854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee92e8-099e-40b4-885c-97ce23af0191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:29.320610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee92e8-099e-40b4-885c-97ce23af0191 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:29.320895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee92e8-099e-40b4-885c-97ce23af0191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:29.321201 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee92e8-099e-40b4-885c-97ce23af0191 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.321982 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee92e8-099e-40b4-885c-97ce23af0191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:29.322284 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee92e8-099e-40b4-885c-97ce23af0191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:29.322924 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa42b4-d29d-498d-98b2-8484736910a8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:29.324176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee92e8-099e-40b4-885c-97ce23af0191 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:29.340917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1090/2198] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:29.340917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee92e8-099e-40b4-885c-97ce23af0191 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:29.352434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee92e8-099e-40b4-885c-97ce23af0191 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:29.359335 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05db46-c24c-49ec-8ee0-18c3f4920360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:29.360374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05db46-c24c-49ec-8ee0-18c3f4920360 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:29.360657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05db46-c24c-49ec-8ee0-18c3f4920360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:29.360936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05db46-c24c-49ec-8ee0-18c3f4920360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.361647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05db46-c24c-49ec-8ee0-18c3f4920360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:29.363932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05db46-c24c-49ec-8ee0-18c3f4920360 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:29.403000 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1109/2199] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:29 2022] POST /identity/v3/projects => generated 389 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:29.403887 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa42b4-d29d-498d-98b2-8484736910a8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:29.408343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a6fa42b4-d29d-498d-98b2-8484736910a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:29.417775 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1091/2200] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:29 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:29.422425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05db46-c24c-49ec-8ee0-18c3f4920360 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:29.494676 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa42b4-d29d-498d-98b2-8484736910a8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:29.514216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05db46-c24c-49ec-8ee0-18c3f4920360 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:29.519814 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18af67-12ab-437a-a0fd-b7fdca3dcad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:29.520486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18af67-12ab-437a-a0fd-b7fdca3dcad9 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:29.520770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18af67-12ab-437a-a0fd-b7fdca3dcad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:29.521047 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18af67-12ab-437a-a0fd-b7fdca3dcad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.522283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18af67-12ab-437a-a0fd-b7fdca3dcad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:29.524932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18af67-12ab-437a-a0fd-b7fdca3dcad9 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:29.558915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319683e5-164c-4801-ad23-838e9ee458b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:29.559988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319683e5-164c-4801-ad23-838e9ee458b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:29.560349 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319683e5-164c-4801-ad23-838e9ee458b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:29.560646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319683e5-164c-4801-ad23-838e9ee458b8 admin admin] PATH_INFO: `/v3/projects/a52074d6c84f4f0e94b0dfbc8a12f8f7` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.564663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1092/2201] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:29 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:29.564824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319683e5-164c-4801-ad23-838e9ee458b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a52074d6c84f4f0e94b0dfbc8a12f8f7)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:29.564925 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18af67-12ab-437a-a0fd-b7fdca3dcad9 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:29.565004 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319683e5-164c-4801-ad23-838e9ee458b8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:29.566393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bf18af67-12ab-437a-a0fd-b7fdca3dcad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:29.575063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:29.626816 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:29.629815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-319683e5-164c-4801-ad23-838e9ee458b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a52074d6c84f4f0e94b0dfbc8a12f8f7', 'request_id': 'req-319683e5-164c-4801-ad23-838e9ee458b8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:29.638816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-319683e5-164c-4801-ad23-838e9ee458b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a52074d6c84f4f0e94b0dfbc8a12f8f7', 'request_id': 'req-319683e5-164c-4801-ad23-838e9ee458b8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:29.642532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18af67-12ab-437a-a0fd-b7fdca3dcad9 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:29.645606 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-319683e5-164c-4801-ad23-838e9ee458b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a52074d6c84f4f0e94b0dfbc8a12f8f7', 'request_id': 'req-319683e5-164c-4801-ad23-838e9ee458b8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:29.657972 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-319683e5-164c-4801-ad23-838e9ee458b8 admin admin] The token cache is being invalidate because project a52074d6c84f4f0e94b0dfbc8a12f8f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:29.658414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-319683e5-164c-4801-ad23-838e9ee458b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:29.659090 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-319683e5-164c-4801-ad23-838e9ee458b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:29.661210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1110/2202] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:29 2022] DELETE /identity/v3/projects/a52074d6c84f4f0e94b0dfbc8a12f8f7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:29.662011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319683e5-164c-4801-ad23-838e9ee458b8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:29.663361 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-319683e5-164c-4801-ad23-838e9ee458b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:29.710673 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:29.711573 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:29.711826 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:29.712153 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0 admin admin] PATH_INFO: `/v3/projects/7207fef1a2c44dd895207b34410069f7` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.713466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7207fef1a2c44dd895207b34410069f7)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:29.716511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:29.736478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319683e5-164c-4801-ad23-838e9ee458b8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:29.741993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af863032-b738-44bf-8c73-c04d50fa95e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:29.742682 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af863032-b738-44bf-8c73-c04d50fa95e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:29.743117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af863032-b738-44bf-8c73-c04d50fa95e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:29.743234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af863032-b738-44bf-8c73-c04d50fa95e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.743956 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af863032-b738-44bf-8c73-c04d50fa95e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:29.745888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af863032-b738-44bf-8c73-c04d50fa95e5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:29.769903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1111/2203] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:29 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:29.770752 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af863032-b738-44bf-8c73-c04d50fa95e5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:29.772432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-af863032-b738-44bf-8c73-c04d50fa95e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:29.780196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7207fef1a2c44dd895207b34410069f7', 'request_id': 'req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:29.785133 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af863032-b738-44bf-8c73-c04d50fa95e5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:29.788488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7207fef1a2c44dd895207b34410069f7', 'request_id': 'req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:29.798656 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7207fef1a2c44dd895207b34410069f7', 'request_id': 'req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:29.813710 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0 admin admin] The token cache is being invalidate because project 7207fef1a2c44dd895207b34410069f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:29.813995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:29.814664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:29.816960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1093/2204] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:29 2022] DELETE /identity/v3/projects/7207fef1a2c44dd895207b34410069f7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:29.820723 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:29.822216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:29.859850 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31946670-9b72-4e17-a899-606d9e044742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:29.860729 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946670-9b72-4e17-a899-606d9e044742 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:29.861639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946670-9b72-4e17-a899-606d9e044742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:29.861934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946670-9b72-4e17-a899-606d9e044742 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.862677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31946670-9b72-4e17-a899-606d9e044742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:29.864924 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31946670-9b72-4e17-a899-606d9e044742 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:29.891538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92a74a-84b9-4cef-93a9-3bc49e3d3cf0 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:29.897266 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029b0c8-322e-4889-96f8-bd3f6e6b84f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:29.898271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029b0c8-322e-4889-96f8-bd3f6e6b84f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:29.898529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029b0c8-322e-4889-96f8-bd3f6e6b84f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:29.898765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029b0c8-322e-4889-96f8-bd3f6e6b84f7 admin admin] PATH_INFO: `/v3/users/4497946aad2648d487b847da52306693` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.899396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1112/2205] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:29 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:29.902848 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029b0c8-322e-4889-96f8-bd3f6e6b84f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4497946aad2648d487b847da52306693)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:29.902949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31946670-9b72-4e17-a899-606d9e044742 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:29.902949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-31946670-9b72-4e17-a899-606d9e044742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:29.903123 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029b0c8-322e-4889-96f8-bd3f6e6b84f7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:29.914553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31946670-9b72-4e17-a899-606d9e044742 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:29.928210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33859b15-9143-4cd2-8cf5-9dd2509f0bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:29.929170 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33859b15-9143-4cd2-8cf5-9dd2509f0bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:29.929681 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33859b15-9143-4cd2-8cf5-9dd2509f0bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:29.929886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33859b15-9143-4cd2-8cf5-9dd2509f0bcf admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:29.930481 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33859b15-9143-4cd2-8cf5-9dd2509f0bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:29.936659 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33859b15-9143-4cd2-8cf5-9dd2509f0bcf admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:29.959744 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:29.960115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=10 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:29.970739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1113/2206] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:29 2022] POST /identity/v3/users => generated 293 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:29.972339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33859b15-9143-4cd2-8cf5-9dd2509f0bcf admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:29.977245 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-33859b15-9143-4cd2-8cf5-9dd2509f0bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:29.980115 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d029b0c8-322e-4889-96f8-bd3f6e6b84f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4497946aad2648d487b847da52306693'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:29.991673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33859b15-9143-4cd2-8cf5-9dd2509f0bcf admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:29.995545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d029b0c8-322e-4889-96f8-bd3f6e6b84f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4497946aad2648d487b847da52306693'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:29.996414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d029b0c8-322e-4889-96f8-bd3f6e6b84f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4497946aad2648d487b847da52306693'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:29.997161 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d029b0c8-322e-4889-96f8-bd3f6e6b84f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4497946aad2648d487b847da52306693'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.000800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7e5f7-67b5-4045-bafc-6b0d9aee036e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:30.002112 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7e5f7-67b5-4045-bafc-6b0d9aee036e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.002750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7e5f7-67b5-4045-bafc-6b0d9aee036e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.003040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7e5f7-67b5-4045-bafc-6b0d9aee036e admin admin] PATH_INFO: `/v3/users/908bcd62300c403eb4a6a493cf7846cf` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.004215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d029b0c8-322e-4889-96f8-bd3f6e6b84f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4497946aad2648d487b847da52306693'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.004474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7e5f7-67b5-4045-bafc-6b0d9aee036e admin admin] RBAC: Authorizing `identity:delete_user(user_id=908bcd62300c403eb4a6a493cf7846cf)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:30.007195 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7e5f7-67b5-4045-bafc-6b0d9aee036e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:30.025096 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1094/2207] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:29 2022] DELETE /identity/v3/users/4497946aad2648d487b847da52306693 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:30.028896 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029b0c8-322e-4889-96f8-bd3f6e6b84f7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:30.031378 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d029b0c8-322e-4889-96f8-bd3f6e6b84f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.064095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f3e7e5f7-67b5-4045-bafc-6b0d9aee036e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '908bcd62300c403eb4a6a493cf7846cf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.064770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f3e7e5f7-67b5-4045-bafc-6b0d9aee036e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '908bcd62300c403eb4a6a493cf7846cf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.065981 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f3e7e5f7-67b5-4045-bafc-6b0d9aee036e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '908bcd62300c403eb4a6a493cf7846cf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.073245 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f3e7e5f7-67b5-4045-bafc-6b0d9aee036e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '908bcd62300c403eb4a6a493cf7846cf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.086169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f3e7e5f7-67b5-4045-bafc-6b0d9aee036e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '908bcd62300c403eb4a6a493cf7846cf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.104097 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1114/2208] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:29 2022] DELETE /identity/v3/users/908bcd62300c403eb4a6a493cf7846cf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:30.105603 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06b75d-c741-4660-9cfb-38e1f69feeaa None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.105949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06b75d-c741-4660-9cfb-38e1f69feeaa None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.106264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06b75d-c741-4660-9cfb-38e1f69feeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.107617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029b0c8-322e-4889-96f8-bd3f6e6b84f7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:30.126139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9a06b75d-c741-4660-9cfb-38e1f69feeaa None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:30.127390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9a06b75d-c741-4660-9cfb-38e1f69feeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.176806 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02ca1e-1951-49f9-a014-e7d2c84d40ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:30.177586 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02ca1e-1951-49f9-a014-e7d2c84d40ab admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.177856 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02ca1e-1951-49f9-a014-e7d2c84d40ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.178149 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02ca1e-1951-49f9-a014-e7d2c84d40ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.178882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02ca1e-1951-49f9-a014-e7d2c84d40ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:30.180549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02ca1e-1951-49f9-a014-e7d2c84d40ab admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:30.191844 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1095/2209] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:30.192778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02ca1e-1951-49f9-a014-e7d2c84d40ab admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:30.196197 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7a02ca1e-1951-49f9-a014-e7d2c84d40ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.209699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02ca1e-1951-49f9-a014-e7d2c84d40ab admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:30.215416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38f7a2-513c-4fe0-a8c4-604ae95ceca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:30.216141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38f7a2-513c-4fe0-a8c4-604ae95ceca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.216454 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38f7a2-513c-4fe0-a8c4-604ae95ceca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.216731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38f7a2-513c-4fe0-a8c4-604ae95ceca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.216886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1115/2210] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:30.217470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38f7a2-513c-4fe0-a8c4-604ae95ceca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:30.217941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06b75d-c741-4660-9cfb-38e1f69feeaa None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:30.219173 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38f7a2-513c-4fe0-a8c4-604ae95ceca8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:30.219295 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9a06b75d-c741-4660-9cfb-38e1f69feeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.230443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1096/2211] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:30.231435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38f7a2-513c-4fe0-a8c4-604ae95ceca8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:30.232666 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06b75d-c741-4660-9cfb-38e1f69feeaa None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:30.233401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9a38f7a2-513c-4fe0-a8c4-604ae95ceca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.237541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c1c9e-f952-4f84-88aa-d67ec48a9bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:30.238467 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c1c9e-f952-4f84-88aa-d67ec48a9bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.238748 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c1c9e-f952-4f84-88aa-d67ec48a9bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.239021 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c1c9e-f952-4f84-88aa-d67ec48a9bb3 admin admin] PATH_INFO: `/v3/users/d91a52e1bd634dc8b7ede66bfd0ae7a8` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.240288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c1c9e-f952-4f84-88aa-d67ec48a9bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91a52e1bd634dc8b7ede66bfd0ae7a8)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:30.242603 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c1c9e-f952-4f84-88aa-d67ec48a9bb3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:30.246419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38f7a2-513c-4fe0-a8c4-604ae95ceca8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:30.251425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ba908-3c49-42e8-92e2-0314ee33a030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:30.252148 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ba908-3c49-42e8-92e2-0314ee33a030 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.252553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ba908-3c49-42e8-92e2-0314ee33a030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.252830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ba908-3c49-42e8-92e2-0314ee33a030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.254270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ba908-3c49-42e8-92e2-0314ee33a030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:30.255917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ba908-3c49-42e8-92e2-0314ee33a030 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:30.268380 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1097/2212] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:30.270303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703fec3-5028-40b2-8401-a4f41298f437 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.270446 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703fec3-5028-40b2-8401-a4f41298f437 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.270801 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703fec3-5028-40b2-8401-a4f41298f437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.290864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-7703fec3-5028-40b2-8401-a4f41298f437 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:30.292226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7703fec3-5028-40b2-8401-a4f41298f437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.300451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1098/2213] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:30.301407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703fec3-5028-40b2-8401-a4f41298f437 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:30.304872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7703fec3-5028-40b2-8401-a4f41298f437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.308145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-de0c1c9e-f952-4f84-88aa-d67ec48a9bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91a52e1bd634dc8b7ede66bfd0ae7a8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.309921 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-de0c1c9e-f952-4f84-88aa-d67ec48a9bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91a52e1bd634dc8b7ede66bfd0ae7a8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.310652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-de0c1c9e-f952-4f84-88aa-d67ec48a9bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91a52e1bd634dc8b7ede66bfd0ae7a8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.318117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703fec3-5028-40b2-8401-a4f41298f437 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:30.319897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-de0c1c9e-f952-4f84-88aa-d67ec48a9bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91a52e1bd634dc8b7ede66bfd0ae7a8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.323582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8d1cf-f5ad-48d8-8c32-17b57d03dfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:30.324433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8d1cf-f5ad-48d8-8c32-17b57d03dfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.324689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8d1cf-f5ad-48d8-8c32-17b57d03dfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.324937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8d1cf-f5ad-48d8-8c32-17b57d03dfe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.325681 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8d1cf-f5ad-48d8-8c32-17b57d03dfe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:30.327302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8d1cf-f5ad-48d8-8c32-17b57d03dfe2 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:30.330346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-de0c1c9e-f952-4f84-88aa-d67ec48a9bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91a52e1bd634dc8b7ede66bfd0ae7a8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.333102 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:30.338667 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1099/2214] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:30.340476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f244af-c77e-4635-91e3-405e704d5110 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.340839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f244af-c77e-4635-91e3-405e704d5110 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.341106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f244af-c77e-4635-91e3-405e704d5110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.355259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1116/2215] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:30 2022] DELETE /identity/v3/users/d91a52e1bd634dc8b7ede66bfd0ae7a8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:30.356269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c1c9e-f952-4f84-88aa-d67ec48a9bb3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:30.357741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-de0c1c9e-f952-4f84-88aa-d67ec48a9bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.361298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b4f244af-c77e-4635-91e3-405e704d5110 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:30.362232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b4f244af-c77e-4635-91e3-405e704d5110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.371791 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:30.441494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c1c9e-f952-4f84-88aa-d67ec48a9bb3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:30.446978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6696f4-8db0-4047-9606-623460998005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:30.447816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6696f4-8db0-4047-9606-623460998005 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.448312 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1100/2216] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:30.448578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6696f4-8db0-4047-9606-623460998005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.448974 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6696f4-8db0-4047-9606-623460998005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.449731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f244af-c77e-4635-91e3-405e704d5110 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:30.450218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6696f4-8db0-4047-9606-623460998005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:30.452235 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6696f4-8db0-4047-9606-623460998005 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:30.456685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b4f244af-c77e-4635-91e3-405e704d5110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.466702 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1117/2217] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:30.466702 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6696f4-8db0-4047-9606-623460998005 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:30.467861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3f6696f4-8db0-4047-9606-623460998005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.469799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f244af-c77e-4635-91e3-405e704d5110 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:30.474396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cb681-4720-47aa-90ab-5d1447ff1b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:30.475073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cb681-4720-47aa-90ab-5d1447ff1b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.475356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cb681-4720-47aa-90ab-5d1447ff1b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.475755 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cb681-4720-47aa-90ab-5d1447ff1b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.476568 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6cb681-4720-47aa-90ab-5d1447ff1b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:30.478180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6cb681-4720-47aa-90ab-5d1447ff1b63 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:30.492872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1101/2218] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:30.492872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cb681-4720-47aa-90ab-5d1447ff1b63 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:30.492872 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ce6cb681-4720-47aa-90ab-5d1447ff1b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.506038 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cb681-4720-47aa-90ab-5d1447ff1b63 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:30.510963 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e52ea1-7fb4-41b7-95db-812464d1727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:30.512166 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e52ea1-7fb4-41b7-95db-812464d1727e admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.512563 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e52ea1-7fb4-41b7-95db-812464d1727e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.512898 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e52ea1-7fb4-41b7-95db-812464d1727e admin admin] PATH_INFO: `/v3/projects/85ff6c0a732c4a4f96c805737a03a389/users/29aac2ddd3e04ee3b0c68ba2457a8b1a/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.528513 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e52ea1-7fb4-41b7-95db-812464d1727e admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ff6c0a732c4a4f96c805737a03a389, user_id=29aac2ddd3e04ee3b0c68ba2457a8b1a, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:30.528919 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6696f4-8db0-4047-9606-623460998005 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:30.531238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e52ea1-7fb4-41b7-95db-812464d1727e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:30.532626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a33e37-8b57-4e37-8e04-b9692773943e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:30.533283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a33e37-8b57-4e37-8e04-b9692773943e service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.533604 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a33e37-8b57-4e37-8e04-b9692773943e service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.533885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a33e37-8b57-4e37-8e04-b9692773943e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.535811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-40a33e37-8b57-4e37-8e04-b9692773943e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.545481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1102/2219] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:30 2022] PUT /identity/v3/projects/85ff6c0a732c4a4f96c805737a03a389/users/29aac2ddd3e04ee3b0c68ba2457a8b1a/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:30.546954 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf1c29-b4a3-4e19-901b-b7eb423b4163 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.547238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf1c29-b4a3-4e19-901b-b7eb423b4163 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.547515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf1c29-b4a3-4e19-901b-b7eb423b4163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.551938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a33e37-8b57-4e37-8e04-b9692773943e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:30.553403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a33e37-8b57-4e37-8e04-b9692773943e service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:30.563996 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1118/2220] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:30.564823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a33e37-8b57-4e37-8e04-b9692773943e service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:30.566174 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9bcf1c29-b4a3-4e19-901b-b7eb423b4163 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:30.566286 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-40a33e37-8b57-4e37-8e04-b9692773943e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.567625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9bcf1c29-b4a3-4e19-901b-b7eb423b4163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.579074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a33e37-8b57-4e37-8e04-b9692773943e service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:30.640132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1103/2221] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:30.640965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf1c29-b4a3-4e19-901b-b7eb423b4163 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:30.652102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf1c29-b4a3-4e19-901b-b7eb423b4163 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:30.657549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea08a74-b9c8-4e18-ad73-7ff66079a089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:30.658222 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea08a74-b9c8-4e18-ad73-7ff66079a089 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.658507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea08a74-b9c8-4e18-ad73-7ff66079a089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.658768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca731e0-fa16-4668-8658-79726d2e7c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:30.658939 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea08a74-b9c8-4e18-ad73-7ff66079a089 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.659685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca731e0-fa16-4668-8658-79726d2e7c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.659800 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea08a74-b9c8-4e18-ad73-7ff66079a089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:30.659973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca731e0-fa16-4668-8658-79726d2e7c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.660079 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea08a74-b9c8-4e18-ad73-7ff66079a089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:30.660253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca731e0-fa16-4668-8658-79726d2e7c78 admin admin] PATH_INFO: `/v3/projects/9bc33ab165b44c999e15864715e5ca59` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.661493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca731e0-fa16-4668-8658-79726d2e7c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc33ab165b44c999e15864715e5ca59)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:30.661593 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea08a74-b9c8-4e18-ad73-7ff66079a089 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:30.663477 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca731e0-fa16-4668-8658-79726d2e7c78 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:30.675548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1104/2222] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:30.676398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea08a74-b9c8-4e18-ad73-7ff66079a089 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:30.687143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea08a74-b9c8-4e18-ad73-7ff66079a089 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:30.692649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4907a-b5af-49a3-82a0-c9edda368cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:30.693544 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4907a-b5af-49a3-82a0-c9edda368cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.693832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4907a-b5af-49a3-82a0-c9edda368cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.694108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4907a-b5af-49a3-82a0-c9edda368cf3 admin admin] PATH_INFO: `/v3/projects/37d9782f0f0a40939eb95e5641823161/users/6c2d8e0d59b64f508829dff6f9e8b574/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.695827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:30.710725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4907a-b5af-49a3-82a0-c9edda368cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d9782f0f0a40939eb95e5641823161, user_id=6c2d8e0d59b64f508829dff6f9e8b574, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:30.714106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4907a-b5af-49a3-82a0-c9edda368cf3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:30.726995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bca731e0-fa16-4668-8658-79726d2e7c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc33ab165b44c999e15864715e5ca59', 'request_id': 'req-bca731e0-fa16-4668-8658-79726d2e7c78'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.732086 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1105/2223] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:30 2022] PUT /identity/v3/projects/37d9782f0f0a40939eb95e5641823161/users/6c2d8e0d59b64f508829dff6f9e8b574/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:30.742754 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bca731e0-fa16-4668-8658-79726d2e7c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc33ab165b44c999e15864715e5ca59', 'request_id': 'req-bca731e0-fa16-4668-8658-79726d2e7c78'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.743228 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4907a-b5af-49a3-82a0-c9edda368cf3 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:30.750987 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bca731e0-fa16-4668-8658-79726d2e7c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc33ab165b44c999e15864715e5ca59', 'request_id': 'req-bca731e0-fa16-4668-8658-79726d2e7c78'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.764672 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bca731e0-fa16-4668-8658-79726d2e7c78 admin admin] The token cache is being invalidate because project 9bc33ab165b44c999e15864715e5ca59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:30.765303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bca731e0-fa16-4668-8658-79726d2e7c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.765737 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-bca731e0-fa16-4668-8658-79726d2e7c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:30.767408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1119/2224] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:30 2022] DELETE /identity/v3/projects/9bc33ab165b44c999e15864715e5ca59 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:30.768752 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aadac8-4a7e-45d0-a105-67da53f45b48 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.769038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aadac8-4a7e-45d0-a105-67da53f45b48 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.769316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aadac8-4a7e-45d0-a105-67da53f45b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.790430 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-81aadac8-4a7e-45d0-a105-67da53f45b48 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:30.792118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-81aadac8-4a7e-45d0-a105-67da53f45b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.799399 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:30.823844 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4907a-b5af-49a3-82a0-c9edda368cf3 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:30.829046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bbd51-4e3b-44dc-8db6-47ea22b04800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:30.829952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bbd51-4e3b-44dc-8db6-47ea22b04800 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.830238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bbd51-4e3b-44dc-8db6-47ea22b04800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.830515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bbd51-4e3b-44dc-8db6-47ea22b04800 admin admin] PATH_INFO: `/v3/projects/56c893b8a05948628c2e31caf42d0fff/users/36e41b00e30346578060a3002ca1fe9b/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.847625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bbd51-4e3b-44dc-8db6-47ea22b04800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c893b8a05948628c2e31caf42d0fff, user_id=36e41b00e30346578060a3002ca1fe9b, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:30.850576 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bbd51-4e3b-44dc-8db6-47ea22b04800 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:30.871486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1120/2225] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:30.872282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1106/2226] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:30 2022] PUT /identity/v3/projects/56c893b8a05948628c2e31caf42d0fff/users/36e41b00e30346578060a3002ca1fe9b/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:30.872487 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aadac8-4a7e-45d0-a105-67da53f45b48 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:30.874499 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-81aadac8-4a7e-45d0-a105-67da53f45b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.884129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bbd51-4e3b-44dc-8db6-47ea22b04800 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:30.884129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-469bbd51-4e3b-44dc-8db6-47ea22b04800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:30.947714 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aadac8-4a7e-45d0-a105-67da53f45b48 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:30.951300 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bbd51-4e3b-44dc-8db6-47ea22b04800 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:30.956162 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da343c79-923c-4fdc-bc43-30c196156baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:30.956833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da343c79-923c-4fdc-bc43-30c196156baa admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.957295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da343c79-923c-4fdc-bc43-30c196156baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.957582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da343c79-923c-4fdc-bc43-30c196156baa admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.958285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da343c79-923c-4fdc-bc43-30c196156baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:30.960252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da343c79-923c-4fdc-bc43-30c196156baa admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:30.991515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1107/2227] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:30 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:30.991515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12b0f4-188a-4c62-97e1-8ab504a42c3f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:30.991515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12b0f4-188a-4c62-97e1-8ab504a42c3f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:30.991515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12b0f4-188a-4c62-97e1-8ab504a42c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:30.999625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635031a0-247c-4498-afb4-7b58237ccdd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:31.000305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635031a0-247c-4498-afb4-7b58237ccdd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:31.000588 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635031a0-247c-4498-afb4-7b58237ccdd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:31.000869 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635031a0-247c-4498-afb4-7b58237ccdd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:31.002874 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-635031a0-247c-4498-afb4-7b58237ccdd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.015066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635031a0-247c-4498-afb4-7b58237ccdd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:31.016563 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635031a0-247c-4498-afb4-7b58237ccdd6 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:31.016729 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-6e12b0f4-188a-4c62-97e1-8ab504a42c3f None None] MFA Rules not processed for user `6c2d8e0d59b64f508829dff6f9e8b574`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:31.017950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6e12b0f4-188a-4c62-97e1-8ab504a42c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.026257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1121/2228] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:31.033038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377086f2-0e8c-42cb-9dc8-752b41d01b61 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:31.033330 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377086f2-0e8c-42cb-9dc8-752b41d01b61 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:31.033614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377086f2-0e8c-42cb-9dc8-752b41d01b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:31.053507 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-377086f2-0e8c-42cb-9dc8-752b41d01b61 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:31.054974 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-377086f2-0e8c-42cb-9dc8-752b41d01b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.061247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:31.092958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1108/2229] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:31.093657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12b0f4-188a-4c62-97e1-8ab504a42c3f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:31.096517 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6e12b0f4-188a-4c62-97e1-8ab504a42c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.141281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1122/2230] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:31.142415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fbb4e-ae4c-4dc4-af8c-9d39dc11d56d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:31.142711 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fbb4e-ae4c-4dc4-af8c-9d39dc11d56d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:31.142991 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fbb4e-ae4c-4dc4-af8c-9d39dc11d56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:31.162128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:31.174791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fd5fbb4e-ae4c-4dc4-af8c-9d39dc11d56d None None] MFA Rules not processed for user `36e41b00e30346578060a3002ca1fe9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:31.175946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fd5fbb4e-ae4c-4dc4-af8c-9d39dc11d56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.188379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12b0f4-188a-4c62-97e1-8ab504a42c3f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:31.194058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a2b1c-b397-4cf2-b27c-684678278b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:31.194991 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a2b1c-b397-4cf2-b27c-684678278b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:31.195279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a2b1c-b397-4cf2-b27c-684678278b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:31.195553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a2b1c-b397-4cf2-b27c-684678278b0c admin admin] PATH_INFO: `/v3/projects/3425f543338c4618bf383b9ebc4e9daf` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:31.197004 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a2b1c-b397-4cf2-b27c-684678278b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3425f543338c4618bf383b9ebc4e9daf)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:31.199564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a2b1c-b397-4cf2-b27c-684678278b0c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:31.248890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1123/2231] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:31.252799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fbb4e-ae4c-4dc4-af8c-9d39dc11d56d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:31.274675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0b7a2b1c-b397-4cf2-b27c-684678278b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3425f543338c4618bf383b9ebc4e9daf', 'request_id': 'req-0b7a2b1c-b397-4cf2-b27c-684678278b0c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:31.282379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0b7a2b1c-b397-4cf2-b27c-684678278b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3425f543338c4618bf383b9ebc4e9daf', 'request_id': 'req-0b7a2b1c-b397-4cf2-b27c-684678278b0c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:31.292786 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0b7a2b1c-b397-4cf2-b27c-684678278b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3425f543338c4618bf383b9ebc4e9daf', 'request_id': 'req-0b7a2b1c-b397-4cf2-b27c-684678278b0c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:31.306053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0b7a2b1c-b397-4cf2-b27c-684678278b0c admin admin] The token cache is being invalidate because project 3425f543338c4618bf383b9ebc4e9daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:31.306741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0b7a2b1c-b397-4cf2-b27c-684678278b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:31.307398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0b7a2b1c-b397-4cf2-b27c-684678278b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:31.309435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1109/2232] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:31 2022] DELETE /identity/v3/projects/3425f543338c4618bf383b9ebc4e9daf => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:31.309988 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a2b1c-b397-4cf2-b27c-684678278b0c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:31.311480 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0b7a2b1c-b397-4cf2-b27c-684678278b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.319026 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fbb4e-ae4c-4dc4-af8c-9d39dc11d56d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:31.378960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ef15d-93ce-4e7d-9591-fbe22709093d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:31.379849 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ef15d-93ce-4e7d-9591-fbe22709093d service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:31.380293 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ef15d-93ce-4e7d-9591-fbe22709093d service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:31.380725 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ef15d-93ce-4e7d-9591-fbe22709093d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:31.382631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-660ef15d-93ce-4e7d-9591-fbe22709093d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.395731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:31.405326 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a2b1c-b397-4cf2-b27c-684678278b0c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:31.410439 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee02b8f-54ce-48db-a1a3-8db907c4715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:31.411131 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee02b8f-54ce-48db-a1a3-8db907c4715b admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:31.411413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee02b8f-54ce-48db-a1a3-8db907c4715b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:31.411742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee02b8f-54ce-48db-a1a3-8db907c4715b admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:31.412580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee02b8f-54ce-48db-a1a3-8db907c4715b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:31.417588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee02b8f-54ce-48db-a1a3-8db907c4715b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:31.447529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1110/2233] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:31 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:31.447529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee02b8f-54ce-48db-a1a3-8db907c4715b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:31.447529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9ee02b8f-54ce-48db-a1a3-8db907c4715b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.462074 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee02b8f-54ce-48db-a1a3-8db907c4715b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:31.462265 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ef15d-93ce-4e7d-9591-fbe22709093d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:31.463900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ef15d-93ce-4e7d-9591-fbe22709093d service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:31.466843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa7e58-9759-4b92-ac66-77a1c30c1e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:31.467498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa7e58-9759-4b92-ac66-77a1c30c1e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:31.467820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa7e58-9759-4b92-ac66-77a1c30c1e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:31.468094 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa7e58-9759-4b92-ac66-77a1c30c1e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:31.468791 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa7e58-9759-4b92-ac66-77a1c30c1e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:31.470669 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa7e58-9759-4b92-ac66-77a1c30c1e7b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:31.474286 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1124/2234] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:31.475703 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188a861-e1a2-4544-a233-c253d0868f11 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:31.475979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188a861-e1a2-4544-a233-c253d0868f11 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:31.476318 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188a861-e1a2-4544-a233-c253d0868f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:31.499184 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e188a861-e1a2-4544-a233-c253d0868f11 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:31.500768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e188a861-e1a2-4544-a233-c253d0868f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.503247 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1111/2235] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:31 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:31.504289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa7e58-9759-4b92-ac66-77a1c30c1e7b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:31.507089 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2afa7e58-9759-4b92-ac66-77a1c30c1e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.556836 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:31.567648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1125/2236] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:31.567648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188a861-e1a2-4544-a233-c253d0868f11 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:31.567648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e188a861-e1a2-4544-a233-c253d0868f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.579861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188a861-e1a2-4544-a233-c253d0868f11 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:31.580322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa7e58-9759-4b92-ac66-77a1c30c1e7b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:31.584864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05dba5-1d2c-41e6-bfcf-70352593006a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:31.585214 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f26e6-807a-47e9-ae88-e268868c17d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:31.585998 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05dba5-1d2c-41e6-bfcf-70352593006a service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:31.586243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f26e6-807a-47e9-ae88-e268868c17d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:31.586520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f26e6-807a-47e9-ae88-e268868c17d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:31.586797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f26e6-807a-47e9-ae88-e268868c17d2 admin admin] PATH_INFO: `/v3/users/aef868433d39495bbd3827beff290072` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:31.587176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05dba5-1d2c-41e6-bfcf-70352593006a service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:31.587681 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05dba5-1d2c-41e6-bfcf-70352593006a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:31.588380 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f26e6-807a-47e9-ae88-e268868c17d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef868433d39495bbd3827beff290072)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:31.590500 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ee05dba5-1d2c-41e6-bfcf-70352593006a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.590651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f26e6-807a-47e9-ae88-e268868c17d2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:31.656021 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a03f26e6-807a-47e9-ae88-e268868c17d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef868433d39495bbd3827beff290072'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:31.657013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a03f26e6-807a-47e9-ae88-e268868c17d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef868433d39495bbd3827beff290072'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:31.657992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a03f26e6-807a-47e9-ae88-e268868c17d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef868433d39495bbd3827beff290072'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:31.667087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a03f26e6-807a-47e9-ae88-e268868c17d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef868433d39495bbd3827beff290072'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:31.667419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05dba5-1d2c-41e6-bfcf-70352593006a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:31.669470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05dba5-1d2c-41e6-bfcf-70352593006a service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:31.678207 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a03f26e6-807a-47e9-ae88-e268868c17d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef868433d39495bbd3827beff290072'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:31.682839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1112/2237] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:31.683954 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05dba5-1d2c-41e6-bfcf-70352593006a service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:31.686752 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ee05dba5-1d2c-41e6-bfcf-70352593006a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.707716 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1126/2238] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:31 2022] DELETE /identity/v3/users/aef868433d39495bbd3827beff290072 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:31.707716 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f26e6-807a-47e9-ae88-e268868c17d2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:31.707716 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a03f26e6-807a-47e9-ae88-e268868c17d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.708502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05dba5-1d2c-41e6-bfcf-70352593006a service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:31.738964 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:31.793460 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:31.795275 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:31.795627 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:31.796192 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6 admin admin] PATH_INFO: `/v3/projects/b3e9a41ee2334f8f9512e5843b36a641` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:31.797290 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e9a41ee2334f8f9512e5843b36a641)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:31.800771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:31.813287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f26e6-807a-47e9-ae88-e268868c17d2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:31.822350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45971f7d-2130-40d1-acc3-0b7c962ad056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:31.823413 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45971f7d-2130-40d1-acc3-0b7c962ad056 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:31.823935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45971f7d-2130-40d1-acc3-0b7c962ad056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:31.824909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45971f7d-2130-40d1-acc3-0b7c962ad056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:31.826169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45971f7d-2130-40d1-acc3-0b7c962ad056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:31.828123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45971f7d-2130-40d1-acc3-0b7c962ad056 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:31.841622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1127/2239] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:31.842559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45971f7d-2130-40d1-acc3-0b7c962ad056 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:31.845676 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-45971f7d-2130-40d1-acc3-0b7c962ad056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.868781 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45971f7d-2130-40d1-acc3-0b7c962ad056 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:31.874962 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61540a38-7d3e-4069-ab8c-3fab91da9d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:31.875695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61540a38-7d3e-4069-ab8c-3fab91da9d0a admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:31.876034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61540a38-7d3e-4069-ab8c-3fab91da9d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:31.876310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61540a38-7d3e-4069-ab8c-3fab91da9d0a admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:31.877123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61540a38-7d3e-4069-ab8c-3fab91da9d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:31.879039 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61540a38-7d3e-4069-ab8c-3fab91da9d0a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:31.907778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e9a41ee2334f8f9512e5843b36a641', 'request_id': 'req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:31.910053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1128/2240] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:31 2022] POST /identity/v3/users => generated 298 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:31.911108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61540a38-7d3e-4069-ab8c-3fab91da9d0a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:31.915057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-61540a38-7d3e-4069-ab8c-3fab91da9d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.919981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e9a41ee2334f8f9512e5843b36a641', 'request_id': 'req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:31.931263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61540a38-7d3e-4069-ab8c-3fab91da9d0a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:31.937147 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e9a41ee2334f8f9512e5843b36a641', 'request_id': 'req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:31.954281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6 admin admin] The token cache is being invalidate because project b3e9a41ee2334f8f9512e5843b36a641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:31.955298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:31.956159 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:31.958439 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1113/2241] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:31 2022] DELETE /identity/v3/projects/b3e9a41ee2334f8f9512e5843b36a641 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:31.960811 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:31.962854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:31.994377 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:32.011052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32a7a8-3000-4652-ab28-12f262c88370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:32.013185 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32a7a8-3000-4652-ab28-12f262c88370 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.013857 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32a7a8-3000-4652-ab28-12f262c88370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.014145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32a7a8-3000-4652-ab28-12f262c88370 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.014937 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32a7a8-3000-4652-ab28-12f262c88370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:32.015253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32a7a8-3000-4652-ab28-12f262c88370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:32.017045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32a7a8-3000-4652-ab28-12f262c88370 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:32.032093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1129/2242] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:32.032093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32a7a8-3000-4652-ab28-12f262c88370 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:32.035161 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ba32a7a8-3000-4652-ab28-12f262c88370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:32.044868 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e4ed-acfd-4b47-adeb-961fdc0d28a6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:32.049226 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32a7a8-3000-4652-ab28-12f262c88370 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:32.049748 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76874a4f-96c9-4820-a6e8-2eba92c8de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:32.050712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76874a4f-96c9-4820-a6e8-2eba92c8de1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.051053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76874a4f-96c9-4820-a6e8-2eba92c8de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.051398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76874a4f-96c9-4820-a6e8-2eba92c8de1b admin admin] PATH_INFO: `/v3/users/36e41b00e30346578060a3002ca1fe9b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.052725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76874a4f-96c9-4820-a6e8-2eba92c8de1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e41b00e30346578060a3002ca1fe9b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:32.054127 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed50c1a-beff-4b66-a1d5-2656245f4fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:32.054812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed50c1a-beff-4b66-a1d5-2656245f4fbc admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.054914 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76874a4f-96c9-4820-a6e8-2eba92c8de1b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:32.055098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed50c1a-beff-4b66-a1d5-2656245f4fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.055373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed50c1a-beff-4b66-a1d5-2656245f4fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.056143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed50c1a-beff-4b66-a1d5-2656245f4fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:32.057952 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed50c1a-beff-4b66-a1d5-2656245f4fbc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:32.070097 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1130/2243] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:32.070939 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed50c1a-beff-4b66-a1d5-2656245f4fbc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:32.074386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2ed50c1a-beff-4b66-a1d5-2656245f4fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:32.087787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed50c1a-beff-4b66-a1d5-2656245f4fbc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:32.093667 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e12f6c-040d-49b1-9c71-0c4fffbd1ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:32.094387 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e12f6c-040d-49b1-9c71-0c4fffbd1ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.094805 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e12f6c-040d-49b1-9c71-0c4fffbd1ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.095042 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e12f6c-040d-49b1-9c71-0c4fffbd1ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.095812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e12f6c-040d-49b1-9c71-0c4fffbd1ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:32.097693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e12f6c-040d-49b1-9c71-0c4fffbd1ee4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:32.112247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1131/2244] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:32.112247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e12f6c-040d-49b1-9c71-0c4fffbd1ee4 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:32.112494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-73e12f6c-040d-49b1-9c71-0c4fffbd1ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:32.124813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-76874a4f-96c9-4820-a6e8-2eba92c8de1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e41b00e30346578060a3002ca1fe9b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:32.132763 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e12f6c-040d-49b1-9c71-0c4fffbd1ee4 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:32.140054 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-76874a4f-96c9-4820-a6e8-2eba92c8de1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e41b00e30346578060a3002ca1fe9b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:32.141537 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-76874a4f-96c9-4820-a6e8-2eba92c8de1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e41b00e30346578060a3002ca1fe9b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:32.142295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-76874a4f-96c9-4820-a6e8-2eba92c8de1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e41b00e30346578060a3002ca1fe9b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:32.147975 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10841176-fac0-4985-934e-cf412925f6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:32.149548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10841176-fac0-4985-934e-cf412925f6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.150141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10841176-fac0-4985-934e-cf412925f6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.150141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10841176-fac0-4985-934e-cf412925f6e7 admin admin] PATH_INFO: `/v3/users/7b76f7782b82434b925d7c5450414c5b` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.152097 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10841176-fac0-4985-934e-cf412925f6e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b76f7782b82434b925d7c5450414c5b)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:32.153548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-76874a4f-96c9-4820-a6e8-2eba92c8de1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e41b00e30346578060a3002ca1fe9b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:32.155167 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10841176-fac0-4985-934e-cf412925f6e7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:32.175742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1114/2245] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:31 2022] DELETE /identity/v3/users/36e41b00e30346578060a3002ca1fe9b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:32.180319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76874a4f-96c9-4820-a6e8-2eba92c8de1b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:32.182783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-76874a4f-96c9-4820-a6e8-2eba92c8de1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:32.226289 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-10841176-fac0-4985-934e-cf412925f6e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b76f7782b82434b925d7c5450414c5b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:32.226992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-10841176-fac0-4985-934e-cf412925f6e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b76f7782b82434b925d7c5450414c5b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:32.227685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-10841176-fac0-4985-934e-cf412925f6e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b76f7782b82434b925d7c5450414c5b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:32.236128 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-10841176-fac0-4985-934e-cf412925f6e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b76f7782b82434b925d7c5450414c5b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:32.247428 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-10841176-fac0-4985-934e-cf412925f6e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b76f7782b82434b925d7c5450414c5b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:32.250527 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:32.269725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76874a4f-96c9-4820-a6e8-2eba92c8de1b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:32.271942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1132/2246] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:32 2022] DELETE /identity/v3/users/7b76f7782b82434b925d7c5450414c5b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:32.273331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10841176-fac0-4985-934e-cf412925f6e7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:32.275755 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-10841176-fac0-4985-934e-cf412925f6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:32.339886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:32.375763 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10841176-fac0-4985-934e-cf412925f6e7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:32.383071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6a7be-e121-4246-8fb6-37c49d3fbd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:32.384149 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6a7be-e121-4246-8fb6-37c49d3fbd1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.384440 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6a7be-e121-4246-8fb6-37c49d3fbd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.384722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6a7be-e121-4246-8fb6-37c49d3fbd1d admin admin] PATH_INFO: `/v3/projects/76cdfcfcc75542db97386a6f1b69215a/users/a1283412627e4288a3eff6fc09fd5cb5/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.386428 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9921e8-302c-4767-b9e2-f9654f1b7046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:32.388713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9921e8-302c-4767-b9e2-f9654f1b7046 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.389368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9921e8-302c-4767-b9e2-f9654f1b7046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.390002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9921e8-302c-4767-b9e2-f9654f1b7046 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.390930 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9921e8-302c-4767-b9e2-f9654f1b7046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:32.393808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9921e8-302c-4767-b9e2-f9654f1b7046 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:32.406154 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6a7be-e121-4246-8fb6-37c49d3fbd1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76cdfcfcc75542db97386a6f1b69215a, user_id=a1283412627e4288a3eff6fc09fd5cb5, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:32.409203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6a7be-e121-4246-8fb6-37c49d3fbd1d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:32.426546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1133/2247] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:32 2022] PUT /identity/v3/projects/76cdfcfcc75542db97386a6f1b69215a/users/a1283412627e4288a3eff6fc09fd5cb5/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:32.427175 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6a7be-e121-4246-8fb6-37c49d3fbd1d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:32.428827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-67c6a7be-e121-4246-8fb6-37c49d3fbd1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:32.435327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1115/2248] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:32 2022] POST /identity/v3/projects => generated 373 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:32.440192 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15df3f-6e38-4397-9620-234cf88f7b37 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.440490 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15df3f-6e38-4397-9620-234cf88f7b37 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.440770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15df3f-6e38-4397-9620-234cf88f7b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.471062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0b15df3f-6e38-4397-9620-234cf88f7b37 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:32.471653 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0b15df3f-6e38-4397-9620-234cf88f7b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:32.520617 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6a7be-e121-4246-8fb6-37c49d3fbd1d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:32.558727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1116/2249] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:32.558727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15df3f-6e38-4397-9620-234cf88f7b37 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:32.560389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0b15df3f-6e38-4397-9620-234cf88f7b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:32.575889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15df3f-6e38-4397-9620-234cf88f7b37 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:32.580858 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e77ef2-6116-4f85-b10c-9acad89a19b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:32.581744 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77ef2-6116-4f85-b10c-9acad89a19b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.582028 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77ef2-6116-4f85-b10c-9acad89a19b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.582306 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77ef2-6116-4f85-b10c-9acad89a19b6 admin admin] PATH_INFO: `/v3/projects/e0e2c575380542eea28adcd0d14ff043` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.583524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e77ef2-6116-4f85-b10c-9acad89a19b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e2c575380542eea28adcd0d14ff043)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:32.585493 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e77ef2-6116-4f85-b10c-9acad89a19b6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:32.601104 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b24fe-2012-40fd-9bad-b59ae4a8d7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:32.603093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b24fe-2012-40fd-9bad-b59ae4a8d7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.603616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b24fe-2012-40fd-9bad-b59ae4a8d7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.604070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b24fe-2012-40fd-9bad-b59ae4a8d7a6 admin admin] PATH_INFO: `/v3/projects/efefe4e82fd64bc9abf0b98b921b90c5/users/2ec2f0a4332643feb978157190d8d92a/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.624579 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b24fe-2012-40fd-9bad-b59ae4a8d7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efefe4e82fd64bc9abf0b98b921b90c5, user_id=2ec2f0a4332643feb978157190d8d92a, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:32.626980 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b24fe-2012-40fd-9bad-b59ae4a8d7a6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:32.630339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:32.656062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1134/2250] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:32 2022] PUT /identity/v3/projects/efefe4e82fd64bc9abf0b98b921b90c5/users/2ec2f0a4332643feb978157190d8d92a/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:32.656316 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c3e77ef2-6116-4f85-b10c-9acad89a19b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e2c575380542eea28adcd0d14ff043', 'request_id': 'req-c3e77ef2-6116-4f85-b10c-9acad89a19b6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:32.659681 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d5557-3717-4935-adfa-46088b4f38dc None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.659681 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d5557-3717-4935-adfa-46088b4f38dc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.659681 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d5557-3717-4935-adfa-46088b4f38dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.676344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c3e77ef2-6116-4f85-b10c-9acad89a19b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e2c575380542eea28adcd0d14ff043', 'request_id': 'req-c3e77ef2-6116-4f85-b10c-9acad89a19b6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:32.691478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c3e77ef2-6116-4f85-b10c-9acad89a19b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e2c575380542eea28adcd0d14ff043', 'request_id': 'req-c3e77ef2-6116-4f85-b10c-9acad89a19b6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:32.702695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ac1d5557-3717-4935-adfa-46088b4f38dc None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:32.704025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ac1d5557-3717-4935-adfa-46088b4f38dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:32.706676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c3e77ef2-6116-4f85-b10c-9acad89a19b6 admin admin] The token cache is being invalidate because project e0e2c575380542eea28adcd0d14ff043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:32.707208 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c3e77ef2-6116-4f85-b10c-9acad89a19b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:32.708396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c3e77ef2-6116-4f85-b10c-9acad89a19b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:32.710727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1117/2251] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:32 2022] DELETE /identity/v3/projects/e0e2c575380542eea28adcd0d14ff043 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:32.711928 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e77ef2-6116-4f85-b10c-9acad89a19b6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:32.713534 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c3e77ef2-6116-4f85-b10c-9acad89a19b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:32.813655 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:32.825167 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e77ef2-6116-4f85-b10c-9acad89a19b6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:32.831193 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1135/2252] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:32.833033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d5557-3717-4935-adfa-46088b4f38dc None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:32.834648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ac1d5557-3717-4935-adfa-46088b4f38dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:32.845715 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4469523-3414-4320-a50e-1a0af7018f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:32.846411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4469523-3414-4320-a50e-1a0af7018f35 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.846697 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4469523-3414-4320-a50e-1a0af7018f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.846971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4469523-3414-4320-a50e-1a0af7018f35 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.847723 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4469523-3414-4320-a50e-1a0af7018f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:32.852733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4469523-3414-4320-a50e-1a0af7018f35 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:32.892534 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1118/2253] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:32 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:32.893579 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4469523-3414-4320-a50e-1a0af7018f35 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:32.897470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e4469523-3414-4320-a50e-1a0af7018f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:32.919202 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4469523-3414-4320-a50e-1a0af7018f35 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:32.927138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc355ab-85fb-4ea6-b4c4-f04a0b6bf374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:32.928122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc355ab-85fb-4ea6-b4c4-f04a0b6bf374 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.928544 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc355ab-85fb-4ea6-b4c4-f04a0b6bf374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.928825 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc355ab-85fb-4ea6-b4c4-f04a0b6bf374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.930422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc355ab-85fb-4ea6-b4c4-f04a0b6bf374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:32.932476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc355ab-85fb-4ea6-b4c4-f04a0b6bf374 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:32.950379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1119/2254] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:32.953175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aac46-e8cb-4923-ada6-27e5b44787b4 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.953418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aac46-e8cb-4923-ada6-27e5b44787b4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.953696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aac46-e8cb-4923-ada6-27e5b44787b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.956334 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d5557-3717-4935-adfa-46088b4f38dc None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:32.960425 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d3048-242e-4bad-ab94-665217a6638b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:32.961608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d3048-242e-4bad-ab94-665217a6638b service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.961608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d3048-242e-4bad-ab94-665217a6638b service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.961886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d3048-242e-4bad-ab94-665217a6638b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.964117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-566d3048-242e-4bad-ab94-665217a6638b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:32.979293 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-4e1aac46-e8cb-4923-ada6-27e5b44787b4 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:32.980936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4e1aac46-e8cb-4923-ada6-27e5b44787b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:32.983258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d3048-242e-4bad-ab94-665217a6638b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:32.984906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d3048-242e-4bad-ab94-665217a6638b service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:32.998129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1120/2255] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:32.999271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1aac46-e8cb-4923-ada6-27e5b44787b4 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:33.010069 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1aac46-e8cb-4923-ada6-27e5b44787b4 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:33.010737 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1136/2256] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:33.011735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d3048-242e-4bad-ab94-665217a6638b service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:33.023850 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d3048-242e-4bad-ab94-665217a6638b service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:33.029697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5ddee-950a-4ce1-acb4-ed4c4c45674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:33.030475 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5ddee-950a-4ce1-acb4-ed4c4c45674c admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:33.030870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5ddee-950a-4ce1-acb4-ed4c4c45674c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:33.031157 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5ddee-950a-4ce1-acb4-ed4c4c45674c admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:33.031927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5ddee-950a-4ce1-acb4-ed4c4c45674c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:33.032129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e341450-b898-4e76-9935-392c92235696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:33.032795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e341450-b898-4e76-9935-392c92235696 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:33.033073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e341450-b898-4e76-9935-392c92235696 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:33.033346 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e341450-b898-4e76-9935-392c92235696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:33.033827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5ddee-950a-4ce1-acb4-ed4c4c45674c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:33.051746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1137/2257] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:33.051746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5ddee-950a-4ce1-acb4-ed4c4c45674c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:33.054785 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a2e5ddee-950a-4ce1-acb4-ed4c4c45674c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:33.056781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e341450-b898-4e76-9935-392c92235696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:33.058245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e341450-b898-4e76-9935-392c92235696 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:33.078903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1121/2258] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:33.080321 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5ddee-950a-4ce1-acb4-ed4c4c45674c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:33.080443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e341450-b898-4e76-9935-392c92235696 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:33.086552 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38565e-36d5-4d18-8279-752cecc7c385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:33.088225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38565e-36d5-4d18-8279-752cecc7c385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:33.088509 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38565e-36d5-4d18-8279-752cecc7c385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:33.088954 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38565e-36d5-4d18-8279-752cecc7c385 admin admin] PATH_INFO: `/v3/projects/a0b344b541494af3911c6d9b1409c78a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:33.091308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38565e-36d5-4d18-8279-752cecc7c385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b344b541494af3911c6d9b1409c78a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:33.094514 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38565e-36d5-4d18-8279-752cecc7c385 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:33.103567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e341450-b898-4e76-9935-392c92235696 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:33.120843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6b6af-4492-48d5-a7b1-b50069263fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:33.122289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6b6af-4492-48d5-a7b1-b50069263fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:33.122289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6b6af-4492-48d5-a7b1-b50069263fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:33.122567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6b6af-4492-48d5-a7b1-b50069263fb5 admin admin] PATH_INFO: `/v3/projects/efefe4e82fd64bc9abf0b98b921b90c5/users/2ec2f0a4332643feb978157190d8d92a/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:33.128117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6b6af-4492-48d5-a7b1-b50069263fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efefe4e82fd64bc9abf0b98b921b90c5, user_id=2ec2f0a4332643feb978157190d8d92a, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:33.135226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6b6af-4492-48d5-a7b1-b50069263fb5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:33.149518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1122/2259] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:33 2022] PUT /identity/v3/projects/efefe4e82fd64bc9abf0b98b921b90c5/users/2ec2f0a4332643feb978157190d8d92a/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:33.151193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659c29c-365f-4daa-ba59-e4fd3e277489 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:33.151556 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659c29c-365f-4daa-ba59-e4fd3e277489 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:33.151942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659c29c-365f-4daa-ba59-e4fd3e277489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:33.165386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba38565e-36d5-4d18-8279-752cecc7c385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b344b541494af3911c6d9b1409c78a', 'request_id': 'req-ba38565e-36d5-4d18-8279-752cecc7c385'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:33.182680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a659c29c-365f-4daa-ba59-e4fd3e277489 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:33.184471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a659c29c-365f-4daa-ba59-e4fd3e277489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:33.189048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba38565e-36d5-4d18-8279-752cecc7c385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b344b541494af3911c6d9b1409c78a', 'request_id': 'req-ba38565e-36d5-4d18-8279-752cecc7c385'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:33.197224 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba38565e-36d5-4d18-8279-752cecc7c385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b344b541494af3911c6d9b1409c78a', 'request_id': 'req-ba38565e-36d5-4d18-8279-752cecc7c385'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:33.224291 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba38565e-36d5-4d18-8279-752cecc7c385 admin admin] The token cache is being invalidate because project a0b344b541494af3911c6d9b1409c78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:33.225690 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba38565e-36d5-4d18-8279-752cecc7c385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:33.226765 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba38565e-36d5-4d18-8279-752cecc7c385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:33.233864 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1138/2260] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:33 2022] DELETE /identity/v3/projects/a0b344b541494af3911c6d9b1409c78a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:33.234363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38565e-36d5-4d18-8279-752cecc7c385 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:33.237877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ba38565e-36d5-4d18-8279-752cecc7c385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:33.270697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:33.277931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1123/2261] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:33.279858 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4eeee5-3741-4fd5-a5da-1edfe318041d None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:33.280188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4eeee5-3741-4fd5-a5da-1edfe318041d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:33.280445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4eeee5-3741-4fd5-a5da-1edfe318041d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:33.320285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-ad4eeee5-3741-4fd5-a5da-1edfe318041d None None] MFA Rules not processed for user `2ec2f0a4332643feb978157190d8d92a`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:33.321562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ad4eeee5-3741-4fd5-a5da-1edfe318041d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:33.400994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38565e-36d5-4d18-8279-752cecc7c385 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:33.422311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1124/2262] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:33.422831 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa054bf-acb3-4959-a50d-38324067fcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:33.422831 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa054bf-acb3-4959-a50d-38324067fcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:33.422831 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa054bf-acb3-4959-a50d-38324067fcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:33.422831 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa054bf-acb3-4959-a50d-38324067fcb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:33.423182 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3bb35-1b68-4746-a6cd-0c2f04c75125 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:33.423256 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa054bf-acb3-4959-a50d-38324067fcb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:33.423705 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3bb35-1b68-4746-a6cd-0c2f04c75125 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:33.423705 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3bb35-1b68-4746-a6cd-0c2f04c75125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:33.428404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa054bf-acb3-4959-a50d-38324067fcb2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:33.460212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1139/2263] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:33.460992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa054bf-acb3-4959-a50d-38324067fcb2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:33.464411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-aaa3bb35-1b68-4746-a6cd-0c2f04c75125 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:33.465723 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-aaa3bb35-1b68-4746-a6cd-0c2f04c75125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:33.472755 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa054bf-acb3-4959-a50d-38324067fcb2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:33.478411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3a0be-e0e1-424e-bf67-c6dc776cb524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:33.479177 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3a0be-e0e1-424e-bf67-c6dc776cb524 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:33.479535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3a0be-e0e1-424e-bf67-c6dc776cb524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:33.479916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3a0be-e0e1-424e-bf67-c6dc776cb524 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:33.481221 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3a0be-e0e1-424e-bf67-c6dc776cb524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:33.481605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3a0be-e0e1-424e-bf67-c6dc776cb524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:33.483479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3a0be-e0e1-424e-bf67-c6dc776cb524 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:33.493176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1125/2264] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:33.494385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3bb35-1b68-4746-a6cd-0c2f04c75125 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:33.500562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1140/2265] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:33.501732 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3a0be-e0e1-424e-bf67-c6dc776cb524 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:33.502098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-aaa3bb35-1b68-4746-a6cd-0c2f04c75125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:33.515631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3a0be-e0e1-424e-bf67-c6dc776cb524 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:33.522333 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b4b0f-f2b1-4d97-bce6-a8a6f8a26c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:33.523418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b4b0f-f2b1-4d97-bce6-a8a6f8a26c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:33.523883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b4b0f-f2b1-4d97-bce6-a8a6f8a26c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:33.524300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b4b0f-f2b1-4d97-bce6-a8a6f8a26c50 admin admin] PATH_INFO: `/v3/projects/b3b665abe6ca4a359375096c35940f52/users/e870ec5ae9eb43b6bc650d730f778d02/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:33.545766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b4b0f-f2b1-4d97-bce6-a8a6f8a26c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b665abe6ca4a359375096c35940f52, user_id=e870ec5ae9eb43b6bc650d730f778d02, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:33.553204 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:33.561591 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b4b0f-f2b1-4d97-bce6-a8a6f8a26c50 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:33.585664 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1141/2266] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:33 2022] PUT /identity/v3/projects/b3b665abe6ca4a359375096c35940f52/users/e870ec5ae9eb43b6bc650d730f778d02/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:33.587060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362fcb0-7f52-434a-a732-f0a9695edbd7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:33.587330 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362fcb0-7f52-434a-a732-f0a9695edbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:33.587645 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362fcb0-7f52-434a-a732-f0a9695edbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:33.620706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7362fcb0-7f52-434a-a732-f0a9695edbd7 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:33.622240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7362fcb0-7f52-434a-a732-f0a9695edbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:33.641566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3bb35-1b68-4746-a6cd-0c2f04c75125 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:33.723399 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1142/2267] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:33.724601 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362fcb0-7f52-434a-a732-f0a9695edbd7 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:33.746241 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362fcb0-7f52-434a-a732-f0a9695edbd7 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:33.751968 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ec62d-4ae7-4655-8ef7-f51f1a0a460b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:33.753029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ec62d-4ae7-4655-8ef7-f51f1a0a460b admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:33.753317 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ec62d-4ae7-4655-8ef7-f51f1a0a460b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:33.753807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ec62d-4ae7-4655-8ef7-f51f1a0a460b admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:33.754651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ec62d-4ae7-4655-8ef7-f51f1a0a460b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:33.756659 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ec62d-4ae7-4655-8ef7-f51f1a0a460b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:33.764238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229a65e-2b8f-4a5e-bee1-9af43d8f3aed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:33.764979 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229a65e-2b8f-4a5e-bee1-9af43d8f3aed service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:33.765326 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229a65e-2b8f-4a5e-bee1-9af43d8f3aed service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:33.765604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229a65e-2b8f-4a5e-bee1-9af43d8f3aed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:33.818577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1143/2268] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:33 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:33.818577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493c36e-912f-414c-a578-79696f9ea5e0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:33.818577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493c36e-912f-414c-a578-79696f9ea5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:33.818577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493c36e-912f-414c-a578-79696f9ea5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:33.861168 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0493c36e-912f-414c-a578-79696f9ea5e0 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:33.862558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0493c36e-912f-414c-a578-79696f9ea5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:33.875577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229a65e-2b8f-4a5e-bee1-9af43d8f3aed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:33.877381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229a65e-2b8f-4a5e-bee1-9af43d8f3aed service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:33.893431 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1126/2269] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:33.894373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229a65e-2b8f-4a5e-bee1-9af43d8f3aed service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:33.919254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229a65e-2b8f-4a5e-bee1-9af43d8f3aed service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:33.956611 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:34.001846 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1144/2270] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:34.003286 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493c36e-912f-414c-a578-79696f9ea5e0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:34.005425 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0493c36e-912f-414c-a578-79696f9ea5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:34.064802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493c36e-912f-414c-a578-79696f9ea5e0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:34.081117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4528ef-ae18-43ef-800f-ba330757431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:34.084854 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4528ef-ae18-43ef-800f-ba330757431f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:34.085499 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a0a5d-521b-42fb-8988-81de71fdcad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:34.086190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a0a5d-521b-42fb-8988-81de71fdcad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:34.086474 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a0a5d-521b-42fb-8988-81de71fdcad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:34.086753 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a0a5d-521b-42fb-8988-81de71fdcad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:34.087312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4528ef-ae18-43ef-800f-ba330757431f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:34.087587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4528ef-ae18-43ef-800f-ba330757431f admin admin] PATH_INFO: `/v3/projects/56c893b8a05948628c2e31caf42d0fff` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:34.088909 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a0a5d-521b-42fb-8988-81de71fdcad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:34.089182 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a0a5d-521b-42fb-8988-81de71fdcad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:34.090269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4528ef-ae18-43ef-800f-ba330757431f admin admin] RBAC: Authorizing `identity:delete_project(project_id=56c893b8a05948628c2e31caf42d0fff)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:34.095656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4528ef-ae18-43ef-800f-ba330757431f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:34.096966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a0a5d-521b-42fb-8988-81de71fdcad8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:34.146787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1127/2271] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:34.150706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a0a5d-521b-42fb-8988-81de71fdcad8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:34.172528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a0a5d-521b-42fb-8988-81de71fdcad8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:34.189875 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdca00-0512-4916-9e3a-57aa4d0f43b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:34.190537 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdca00-0512-4916-9e3a-57aa4d0f43b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:34.190826 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdca00-0512-4916-9e3a-57aa4d0f43b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:34.191104 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdca00-0512-4916-9e3a-57aa4d0f43b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:34.197400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdca00-0512-4916-9e3a-57aa4d0f43b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:34.210486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7f4528ef-ae18-43ef-800f-ba330757431f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56c893b8a05948628c2e31caf42d0fff', 'request_id': 'req-7f4528ef-ae18-43ef-800f-ba330757431f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:34.213043 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdca00-0512-4916-9e3a-57aa4d0f43b3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:34.229682 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7f4528ef-ae18-43ef-800f-ba330757431f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56c893b8a05948628c2e31caf42d0fff', 'request_id': 'req-7f4528ef-ae18-43ef-800f-ba330757431f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:34.244758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7f4528ef-ae18-43ef-800f-ba330757431f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56c893b8a05948628c2e31caf42d0fff', 'request_id': 'req-7f4528ef-ae18-43ef-800f-ba330757431f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:34.262254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1128/2272] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:34 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:34.263660 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7f4528ef-ae18-43ef-800f-ba330757431f admin admin] The token cache is being invalidate because project 56c893b8a05948628c2e31caf42d0fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:34.264814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7f4528ef-ae18-43ef-800f-ba330757431f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:34.264921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdca00-0512-4916-9e3a-57aa4d0f43b3 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:34.265448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7f4528ef-ae18-43ef-800f-ba330757431f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:34.268546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1145/2273] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:34 2022] DELETE /identity/v3/projects/56c893b8a05948628c2e31caf42d0fff => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:34.269853 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4528ef-ae18-43ef-800f-ba330757431f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:34.270903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-6ebdca00-0512-4916-9e3a-57aa4d0f43b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:34.273063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7f4528ef-ae18-43ef-800f-ba330757431f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:34.280173 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:34.357946 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdca00-0512-4916-9e3a-57aa4d0f43b3 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:34.365276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4528ef-ae18-43ef-800f-ba330757431f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:34.370493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a4e39-e673-4d67-bf4b-1fb5af11f5ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:34.371272 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a4e39-e673-4d67-bf4b-1fb5af11f5ae service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:34.371693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a4e39-e673-4d67-bf4b-1fb5af11f5ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:34.372045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a4e39-e673-4d67-bf4b-1fb5af11f5ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:34.374230 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-618a4e39-e673-4d67-bf4b-1fb5af11f5ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:34.424647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdd332-6b9a-4c90-b3b3-c4b8ef404796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:34.425391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd332-6b9a-4c90-b3b3-c4b8ef404796 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:34.425747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd332-6b9a-4c90-b3b3-c4b8ef404796 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:34.426255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd332-6b9a-4c90-b3b3-c4b8ef404796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:34.428239 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-eafdd332-6b9a-4c90-b3b3-c4b8ef404796 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:34.488498 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a4e39-e673-4d67-bf4b-1fb5af11f5ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:34.493612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a4e39-e673-4d67-bf4b-1fb5af11f5ae service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:34.509868 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1146/2274] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:34.510803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a4e39-e673-4d67-bf4b-1fb5af11f5ae service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:34.512226 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-618a4e39-e673-4d67-bf4b-1fb5af11f5ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:34.526058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a4e39-e673-4d67-bf4b-1fb5af11f5ae service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:34.533686 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b853f3-7095-432f-bb00-e408495e27b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:34.534380 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b853f3-7095-432f-bb00-e408495e27b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:34.534707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b853f3-7095-432f-bb00-e408495e27b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:34.534984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b853f3-7095-432f-bb00-e408495e27b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:34.535732 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b853f3-7095-432f-bb00-e408495e27b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:34.537730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b853f3-7095-432f-bb00-e408495e27b4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:34.554123 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdd332-6b9a-4c90-b3b3-c4b8ef404796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:34.556468 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdd332-6b9a-4c90-b3b3-c4b8ef404796 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:34.572142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:34.573416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1129/2275] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:34.574923 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdd332-6b9a-4c90-b3b3-c4b8ef404796 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:34.577601 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-eafdd332-6b9a-4c90-b3b3-c4b8ef404796 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:34.598408 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdd332-6b9a-4c90-b3b3-c4b8ef404796 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:34.599890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1147/2276] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:34 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:34.601423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89bc19-9a20-4bc3-bb32-f351bd8bf29b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:34.601753 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89bc19-9a20-4bc3-bb32-f351bd8bf29b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:34.602182 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89bc19-9a20-4bc3-bb32-f351bd8bf29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:34.643324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-de89bc19-9a20-4bc3-bb32-f351bd8bf29b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:34.647139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-de89bc19-9a20-4bc3-bb32-f351bd8bf29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:34.720219 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee11712-10f9-40bd-89f2-494f66d46465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:34.720916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee11712-10f9-40bd-89f2-494f66d46465 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:34.721202 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee11712-10f9-40bd-89f2-494f66d46465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:34.721469 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee11712-10f9-40bd-89f2-494f66d46465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:34.722220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee11712-10f9-40bd-89f2-494f66d46465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:34.724063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee11712-10f9-40bd-89f2-494f66d46465 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:34.765652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1130/2277] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:34.770150 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f3500-528a-46a9-bb0f-462c7c4096a1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:34.779161 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f3500-528a-46a9-bb0f-462c7c4096a1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:34.779698 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f3500-528a-46a9-bb0f-462c7c4096a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:34.820491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:34.833887 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1148/2278] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:34.835460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89bc19-9a20-4bc3-bb32-f351bd8bf29b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:34.835968 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b40f3500-528a-46a9-bb0f-462c7c4096a1 None None] MFA Rules not processed for user `a1283412627e4288a3eff6fc09fd5cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:34.837407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b40f3500-528a-46a9-bb0f-462c7c4096a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:34.853849 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89bc19-9a20-4bc3-bb32-f351bd8bf29b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:34.867264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498b9ed-7850-458f-9952-500c068b6891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:34.869016 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498b9ed-7850-458f-9952-500c068b6891 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:34.869520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498b9ed-7850-458f-9952-500c068b6891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:34.870019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498b9ed-7850-458f-9952-500c068b6891 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:34.871700 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498b9ed-7850-458f-9952-500c068b6891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:34.874289 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498b9ed-7850-458f-9952-500c068b6891 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:34.917401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1149/2279] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:34 2022] POST /identity/v3/users => generated 287 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:34.917401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498b9ed-7850-458f-9952-500c068b6891 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:34.945978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1131/2280] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:34.947519 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284544a-a704-488d-8d79-209a868e6414 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:34.947841 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284544a-a704-488d-8d79-209a868e6414 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:34.948110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284544a-a704-488d-8d79-209a868e6414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:34.950870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498b9ed-7850-458f-9952-500c068b6891 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:34.973878 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3284544a-a704-488d-8d79-209a868e6414 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:34.975366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3284544a-a704-488d-8d79-209a868e6414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:34.977485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dc4a0-f4a6-4246-b245-0aa94f37dcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:34.978188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dc4a0-f4a6-4246-b245-0aa94f37dcfa admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:34.978478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dc4a0-f4a6-4246-b245-0aa94f37dcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:34.978803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dc4a0-f4a6-4246-b245-0aa94f37dcfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:34.979706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dc4a0-f4a6-4246-b245-0aa94f37dcfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:34.981397 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dc4a0-f4a6-4246-b245-0aa94f37dcfa admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:34.987351 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1132/2281] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:34.988757 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284544a-a704-488d-8d79-209a868e6414 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:35.003921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284544a-a704-488d-8d79-209a868e6414 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:35.013662 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1150/2282] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:35.014593 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dc4a0-f4a6-4246-b245-0aa94f37dcfa admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:35.015181 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04d46a-ca6a-4b30-9876-5771cdccecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:35.015956 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04d46a-ca6a-4b30-9876-5771cdccecbc admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:35.016416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04d46a-ca6a-4b30-9876-5771cdccecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:35.017955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04d46a-ca6a-4b30-9876-5771cdccecbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:35.020743 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8d5dc4a0-f4a6-4246-b245-0aa94f37dcfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:35.023262 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04d46a-ca6a-4b30-9876-5771cdccecbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:35.025111 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04d46a-ca6a-4b30-9876-5771cdccecbc admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:35.054783 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dc4a0-f4a6-4246-b245-0aa94f37dcfa admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:35.057846 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1133/2283] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:35.058883 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04d46a-ca6a-4b30-9876-5771cdccecbc admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:35.080862 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04d46a-ca6a-4b30-9876-5771cdccecbc admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:35.087425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5e4fe-04db-4c71-9066-66585d39eea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:35.088109 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5e4fe-04db-4c71-9066-66585d39eea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:35.088921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5e4fe-04db-4c71-9066-66585d39eea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:35.088921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5e4fe-04db-4c71-9066-66585d39eea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:35.089407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5e4fe-04db-4c71-9066-66585d39eea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:35.089808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5e4fe-04db-4c71-9066-66585d39eea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:35.093903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05730cce-7f5a-4fca-a914-e3fbeb146321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:35.097040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05730cce-7f5a-4fca-a914-e3fbeb146321 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:35.097481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5e4fe-04db-4c71-9066-66585d39eea4 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:35.098768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05730cce-7f5a-4fca-a914-e3fbeb146321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:35.100772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05730cce-7f5a-4fca-a914-e3fbeb146321 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:35.102477 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05730cce-7f5a-4fca-a914-e3fbeb146321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:35.107632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05730cce-7f5a-4fca-a914-e3fbeb146321 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:35.113557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1134/2284] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:35.114833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5e4fe-04db-4c71-9066-66585d39eea4 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:35.130033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5e4fe-04db-4c71-9066-66585d39eea4 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:35.135330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64006679-9b20-4313-9d20-5e82a98ede04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:35.136294 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64006679-9b20-4313-9d20-5e82a98ede04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:35.136793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64006679-9b20-4313-9d20-5e82a98ede04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:35.137075 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64006679-9b20-4313-9d20-5e82a98ede04 admin admin] PATH_INFO: `/v3/projects/fc54361f98ed4cc5b475ba70f58647af/users/b48cb724d0c44cf08288722b75f5f6df/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:35.157780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64006679-9b20-4313-9d20-5e82a98ede04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc54361f98ed4cc5b475ba70f58647af, user_id=b48cb724d0c44cf08288722b75f5f6df, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:35.160648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64006679-9b20-4313-9d20-5e82a98ede04 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:35.167484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1151/2285] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:35 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:35.169184 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05730cce-7f5a-4fca-a914-e3fbeb146321 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:35.186982 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1135/2286] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:35 2022] PUT /identity/v3/projects/fc54361f98ed4cc5b475ba70f58647af/users/b48cb724d0c44cf08288722b75f5f6df/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:35.187929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64006679-9b20-4313-9d20-5e82a98ede04 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:35.255216 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05730cce-7f5a-4fca-a914-e3fbeb146321 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:35.286055 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64006679-9b20-4313-9d20-5e82a98ede04 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:35.293401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06229b-15f2-4283-ba3c-9db35fc32de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:35.294914 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06229b-15f2-4283-ba3c-9db35fc32de6 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:35.295666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06229b-15f2-4283-ba3c-9db35fc32de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:35.296317 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06229b-15f2-4283-ba3c-9db35fc32de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:35.297135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06229b-15f2-4283-ba3c-9db35fc32de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:35.300641 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06229b-15f2-4283-ba3c-9db35fc32de6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:35.329326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:35.337897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba395a-6e8d-46b8-9f10-2fd0826d8046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:35.338987 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba395a-6e8d-46b8-9f10-2fd0826d8046 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:35.339457 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba395a-6e8d-46b8-9f10-2fd0826d8046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:35.340367 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba395a-6e8d-46b8-9f10-2fd0826d8046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:35.341334 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba395a-6e8d-46b8-9f10-2fd0826d8046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:35.343273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba395a-6e8d-46b8-9f10-2fd0826d8046 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:35.351809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1136/2287] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:35 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:35.352997 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06229b-15f2-4283-ba3c-9db35fc32de6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:35.358457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fb06229b-15f2-4283-ba3c-9db35fc32de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:35.362097 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1152/2288] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:35.362970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba395a-6e8d-46b8-9f10-2fd0826d8046 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:35.382746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba395a-6e8d-46b8-9f10-2fd0826d8046 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:35.445049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:35.514962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06229b-15f2-4283-ba3c-9db35fc32de6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:35.518786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5e23d-f443-4c3d-b2a9-cc17aa69ae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:35.519964 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5e23d-f443-4c3d-b2a9-cc17aa69ae59 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:35.521020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5e23d-f443-4c3d-b2a9-cc17aa69ae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:35.521305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5e23d-f443-4c3d-b2a9-cc17aa69ae59 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:35.522023 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5e23d-f443-4c3d-b2a9-cc17aa69ae59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:35.535715 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5e23d-f443-4c3d-b2a9-cc17aa69ae59 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:35.537645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd4618-5290-43db-91a1-76ec9c6fb108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:35.538281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd4618-5290-43db-91a1-76ec9c6fb108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:35.538566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd4618-5290-43db-91a1-76ec9c6fb108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:35.538848 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd4618-5290-43db-91a1-76ec9c6fb108 admin admin] PATH_INFO: `/v3/users/6c2d8e0d59b64f508829dff6f9e8b574` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:35.541310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd4618-5290-43db-91a1-76ec9c6fb108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2d8e0d59b64f508829dff6f9e8b574)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:35.543347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd4618-5290-43db-91a1-76ec9c6fb108 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:35.593074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1153/2289] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:35 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:35.594326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca3fac-265d-4af8-bf0e-cfbced9dc8fa None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:35.594619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca3fac-265d-4af8-bf0e-cfbced9dc8fa None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:35.594935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca3fac-265d-4af8-bf0e-cfbced9dc8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:35.655895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-74ca3fac-265d-4af8-bf0e-cfbced9dc8fa None None] MFA Rules not processed for user `b48cb724d0c44cf08288722b75f5f6df`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:35.658372 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-74ca3fac-265d-4af8-bf0e-cfbced9dc8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:35.669746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2abd4618-5290-43db-91a1-76ec9c6fb108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2d8e0d59b64f508829dff6f9e8b574'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:35.703127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2abd4618-5290-43db-91a1-76ec9c6fb108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2d8e0d59b64f508829dff6f9e8b574'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:35.705125 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2abd4618-5290-43db-91a1-76ec9c6fb108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2d8e0d59b64f508829dff6f9e8b574'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:35.708362 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2abd4618-5290-43db-91a1-76ec9c6fb108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2d8e0d59b64f508829dff6f9e8b574'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:35.723756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2abd4618-5290-43db-91a1-76ec9c6fb108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2d8e0d59b64f508829dff6f9e8b574'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:35.750631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1137/2290] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:35 2022] DELETE /identity/v3/users/6c2d8e0d59b64f508829dff6f9e8b574 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:35.751553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd4618-5290-43db-91a1-76ec9c6fb108 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:35.753624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2abd4618-5290-43db-91a1-76ec9c6fb108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:35.780443 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1154/2291] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:35.782660 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca3fac-265d-4af8-bf0e-cfbced9dc8fa None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:35.789201 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-74ca3fac-265d-4af8-bf0e-cfbced9dc8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:35.828707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca3fac-265d-4af8-bf0e-cfbced9dc8fa None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:35.936674 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd4618-5290-43db-91a1-76ec9c6fb108 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:35.943523 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c22bf-2198-4f6a-a1e7-b6b939c3969b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:35.944557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c22bf-2198-4f6a-a1e7-b6b939c3969b admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:35.944849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c22bf-2198-4f6a-a1e7-b6b939c3969b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:35.945130 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c22bf-2198-4f6a-a1e7-b6b939c3969b admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:35.945848 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c22bf-2198-4f6a-a1e7-b6b939c3969b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:35.961929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c22bf-2198-4f6a-a1e7-b6b939c3969b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:35.980750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0de0f3-f6d5-4392-916b-affd0bd4d340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:35.984058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0de0f3-f6d5-4392-916b-affd0bd4d340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:35.986804 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0de0f3-f6d5-4392-916b-affd0bd4d340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:35.986804 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0de0f3-f6d5-4392-916b-affd0bd4d340 admin admin] PATH_INFO: `/v3/projects/3b92352bc47f4699b2fe38b8f26096c9/users/1e774104d255434cb72f3e579998568c/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.023683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1138/2292] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:35 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:36.025322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c22bf-2198-4f6a-a1e7-b6b939c3969b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:36.026622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0de0f3-f6d5-4392-916b-affd0bd4d340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b92352bc47f4699b2fe38b8f26096c9, user_id=1e774104d255434cb72f3e579998568c, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:36.028063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a78c22bf-2198-4f6a-a1e7-b6b939c3969b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:36.031656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0de0f3-f6d5-4392-916b-affd0bd4d340 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:36.041758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:36.046809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c22bf-2198-4f6a-a1e7-b6b939c3969b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:36.054341 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4e510-ef1c-4c93-8e9a-bc27ec8d939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:36.055589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4e510-ef1c-4c93-8e9a-bc27ec8d939c admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:36.056108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4e510-ef1c-4c93-8e9a-bc27ec8d939c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:36.056601 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4e510-ef1c-4c93-8e9a-bc27ec8d939c admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.057699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4e510-ef1c-4c93-8e9a-bc27ec8d939c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:36.059910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4e510-ef1c-4c93-8e9a-bc27ec8d939c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:36.064552 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1155/2293] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:35 2022] PUT /identity/v3/projects/3b92352bc47f4699b2fe38b8f26096c9/users/1e774104d255434cb72f3e579998568c/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:36.074153 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1139/2294] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:36.075906 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4e510-ef1c-4c93-8e9a-bc27ec8d939c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:36.076148 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41403f75-fc56-4ce7-ac68-561504cdbbf7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:36.076517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41403f75-fc56-4ce7-ac68-561504cdbbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:36.076838 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41403f75-fc56-4ce7-ac68-561504cdbbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.078019 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c4d4e510-ef1c-4c93-8e9a-bc27ec8d939c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:36.107697 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4e510-ef1c-4c93-8e9a-bc27ec8d939c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:36.111695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-41403f75-fc56-4ce7-ac68-561504cdbbf7 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:36.114990 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-41403f75-fc56-4ce7-ac68-561504cdbbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:36.141193 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:36.181654 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fae6f6-3713-4fa3-9d42-6c0de9a4d272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:36.182331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae6f6-3713-4fa3-9d42-6c0de9a4d272 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:36.182679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae6f6-3713-4fa3-9d42-6c0de9a4d272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:36.183021 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae6f6-3713-4fa3-9d42-6c0de9a4d272 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.183888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fae6f6-3713-4fa3-9d42-6c0de9a4d272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:36.186351 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fae6f6-3713-4fa3-9d42-6c0de9a4d272 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:36.190287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1156/2295] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:36.191885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c29b77-738e-4120-8d30-f66f24dd2a34 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:36.192351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c29b77-738e-4120-8d30-f66f24dd2a34 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:36.192823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c29b77-738e-4120-8d30-f66f24dd2a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.223999 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1140/2296] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:36 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:36.223999 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fae6f6-3713-4fa3-9d42-6c0de9a4d272 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:36.228229 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-33c29b77-738e-4120-8d30-f66f24dd2a34 None None] MFA Rules not processed for user `e870ec5ae9eb43b6bc650d730f778d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:36.230404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-33c29b77-738e-4120-8d30-f66f24dd2a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:36.303633 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fae6f6-3713-4fa3-9d42-6c0de9a4d272 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:36.309296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fa956-f9ef-4d36-98f7-f29894e8638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:36.310215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fa956-f9ef-4d36-98f7-f29894e8638d admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:36.310829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fa956-f9ef-4d36-98f7-f29894e8638d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:36.310948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fa956-f9ef-4d36-98f7-f29894e8638d admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.312149 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fa956-f9ef-4d36-98f7-f29894e8638d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:36.314141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fa956-f9ef-4d36-98f7-f29894e8638d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:36.326401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1141/2297] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:36.328016 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a29107-a6c3-4848-9bb6-4be61fd0fadd None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:36.328409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a29107-a6c3-4848-9bb6-4be61fd0fadd None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:36.328750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a29107-a6c3-4848-9bb6-4be61fd0fadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.341110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1157/2298] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:36.342253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c29b77-738e-4120-8d30-f66f24dd2a34 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:36.357130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c29b77-738e-4120-8d30-f66f24dd2a34 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:36.363401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59200716-ec4c-447e-8d5a-faefb9e4be23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:36.363788 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-22a29107-a6c3-4848-9bb6-4be61fd0fadd None None] MFA Rules not processed for user `1e774104d255434cb72f3e579998568c`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:36.364872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59200716-ec4c-447e-8d5a-faefb9e4be23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:36.364982 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-22a29107-a6c3-4848-9bb6-4be61fd0fadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:36.365424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59200716-ec4c-447e-8d5a-faefb9e4be23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:36.366239 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59200716-ec4c-447e-8d5a-faefb9e4be23 admin admin] PATH_INFO: `/v3/projects/8f57047507424c93a1a3774dd63f76a9/users/3fd184b7a5b0463ca9e14375dea63439/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.387115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59200716-ec4c-447e-8d5a-faefb9e4be23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f57047507424c93a1a3774dd63f76a9, user_id=3fd184b7a5b0463ca9e14375dea63439, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:36.390774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59200716-ec4c-447e-8d5a-faefb9e4be23 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:36.420854 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1158/2299] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:36 2022] PUT /identity/v3/projects/8f57047507424c93a1a3774dd63f76a9/users/3fd184b7a5b0463ca9e14375dea63439/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:36.422103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59200716-ec4c-447e-8d5a-faefb9e4be23 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:36.424566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-59200716-ec4c-447e-8d5a-faefb9e4be23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:36.470760 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1142/2300] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:36.471784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a29107-a6c3-4848-9bb6-4be61fd0fadd None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:36.487307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a29107-a6c3-4848-9bb6-4be61fd0fadd None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:36.531397 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59200716-ec4c-447e-8d5a-faefb9e4be23 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:36.538423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741da49-2a37-45f5-9231-14c9a7fc482a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:36.539456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741da49-2a37-45f5-9231-14c9a7fc482a service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:36.539933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741da49-2a37-45f5-9231-14c9a7fc482a service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:36.540921 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741da49-2a37-45f5-9231-14c9a7fc482a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.549174 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:36.565608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:36.583079 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3178e-13bb-47e9-9064-3261f05a6cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:36.584135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3178e-13bb-47e9-9064-3261f05a6cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:36.585531 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3178e-13bb-47e9-9064-3261f05a6cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:36.586296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3178e-13bb-47e9-9064-3261f05a6cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.588139 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3178e-13bb-47e9-9064-3261f05a6cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:36.590842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3178e-13bb-47e9-9064-3261f05a6cf5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:36.630520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1143/2301] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:36 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:36.632716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3178e-13bb-47e9-9064-3261f05a6cf5 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:36.651522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3178e-13bb-47e9-9064-3261f05a6cf5 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:36.658878 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67ebc9-cd1d-4f9c-a6b6-8e0622c9e917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:36.660105 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67ebc9-cd1d-4f9c-a6b6-8e0622c9e917 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:36.660773 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67ebc9-cd1d-4f9c-a6b6-8e0622c9e917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:36.662005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67ebc9-cd1d-4f9c-a6b6-8e0622c9e917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.670970 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67ebc9-cd1d-4f9c-a6b6-8e0622c9e917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:36.675178 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67ebc9-cd1d-4f9c-a6b6-8e0622c9e917 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:36.688915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741da49-2a37-45f5-9231-14c9a7fc482a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:36.692865 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741da49-2a37-45f5-9231-14c9a7fc482a service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:36.704817 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1144/2302] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:36.712602 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1159/2303] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:36.713463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741da49-2a37-45f5-9231-14c9a7fc482a service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:36.714285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67ebc9-cd1d-4f9c-a6b6-8e0622c9e917 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:36.716595 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1b67ebc9-cd1d-4f9c-a6b6-8e0622c9e917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:36.727376 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741da49-2a37-45f5-9231-14c9a7fc482a service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:36.732817 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f91e3-d74f-4a88-af77-2d26449b7496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:36.733958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f91e3-d74f-4a88-af77-2d26449b7496 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:36.734444 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f91e3-d74f-4a88-af77-2d26449b7496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:36.734978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f91e3-d74f-4a88-af77-2d26449b7496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.735938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f91e3-d74f-4a88-af77-2d26449b7496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:36.737779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f91e3-d74f-4a88-af77-2d26449b7496 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:36.749673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1160/2304] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:36.750930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f91e3-d74f-4a88-af77-2d26449b7496 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:36.752720 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6d6f91e3-d74f-4a88-af77-2d26449b7496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:36.783947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67ebc9-cd1d-4f9c-a6b6-8e0622c9e917 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:36.787948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfa5c1-04b2-4649-b200-7a187430342c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:36.788724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfa5c1-04b2-4649-b200-7a187430342c service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:36.789005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfa5c1-04b2-4649-b200-7a187430342c service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:36.789277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfa5c1-04b2-4649-b200-7a187430342c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.829547 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f91e3-d74f-4a88-af77-2d26449b7496 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:36.835533 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca6d47-8774-4a3f-ae3d-ba7c4b0d5beb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:36.836287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca6d47-8774-4a3f-ae3d-ba7c4b0d5beb service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:36.836575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca6d47-8774-4a3f-ae3d-ba7c4b0d5beb service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:36.836842 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca6d47-8774-4a3f-ae3d-ba7c4b0d5beb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.866987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfa5c1-04b2-4649-b200-7a187430342c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:36.868794 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfa5c1-04b2-4649-b200-7a187430342c service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:36.879717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1145/2305] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:36.880706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfa5c1-04b2-4649-b200-7a187430342c service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:36.893603 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfa5c1-04b2-4649-b200-7a187430342c service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:36.899631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d578b4-76ad-4677-8932-a08c876f0aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:36.900663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d578b4-76ad-4677-8932-a08c876f0aae admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:36.901499 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d578b4-76ad-4677-8932-a08c876f0aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:36.901499 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d578b4-76ad-4677-8932-a08c876f0aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.902093 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d578b4-76ad-4677-8932-a08c876f0aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:36.904569 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d578b4-76ad-4677-8932-a08c876f0aae admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:36.917082 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1146/2306] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:36.918156 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d578b4-76ad-4677-8932-a08c876f0aae admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:36.931088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca6d47-8774-4a3f-ae3d-ba7c4b0d5beb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:36.933954 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca6d47-8774-4a3f-ae3d-ba7c4b0d5beb service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:36.940042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d578b4-76ad-4677-8932-a08c876f0aae admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:36.952075 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469cc18-d883-4448-8d8e-522110c7076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:36.952908 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469cc18-d883-4448-8d8e-522110c7076f admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:36.953191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469cc18-d883-4448-8d8e-522110c7076f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:36.953467 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469cc18-d883-4448-8d8e-522110c7076f admin admin] PATH_INFO: `/v3/projects/eea49fc05a6d49d0bed2faa2b17a08db/users/11215cd11388472c9e410f5721dd9800/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:36.986211 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1161/2307] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:36.989055 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca6d47-8774-4a3f-ae3d-ba7c4b0d5beb service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:36.990640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469cc18-d883-4448-8d8e-522110c7076f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea49fc05a6d49d0bed2faa2b17a08db, user_id=11215cd11388472c9e410f5721dd9800, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:37.014550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469cc18-d883-4448-8d8e-522110c7076f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:37.028482 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca6d47-8774-4a3f-ae3d-ba7c4b0d5beb service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:37.041671 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dce16e-a2ea-4fa0-8f00-086f7e729122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:37.042756 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dce16e-a2ea-4fa0-8f00-086f7e729122 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:37.045837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dce16e-a2ea-4fa0-8f00-086f7e729122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:37.046271 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dce16e-a2ea-4fa0-8f00-086f7e729122 admin admin] PATH_INFO: `/v3/projects/8f57047507424c93a1a3774dd63f76a9/users/3fd184b7a5b0463ca9e14375dea63439/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:37.047477 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1147/2308] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:36 2022] PUT /identity/v3/projects/eea49fc05a6d49d0bed2faa2b17a08db/users/11215cd11388472c9e410f5721dd9800/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:37.048523 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469cc18-d883-4448-8d8e-522110c7076f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:37.050554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dce16e-a2ea-4fa0-8f00-086f7e729122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f57047507424c93a1a3774dd63f76a9, user_id=3fd184b7a5b0463ca9e14375dea63439, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:37.053848 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dce16e-a2ea-4fa0-8f00-086f7e729122 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:37.084059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1162/2309] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:36 2022] PUT /identity/v3/projects/8f57047507424c93a1a3774dd63f76a9/users/3fd184b7a5b0463ca9e14375dea63439/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:37.084994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dce16e-a2ea-4fa0-8f00-086f7e729122 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:37.144472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:37.196785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469cc18-d883-4448-8d8e-522110c7076f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:37.215019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:37.254308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dce16e-a2ea-4fa0-8f00-086f7e729122 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:37.270790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6bd88-934b-4822-bed7-e73dfa7a4d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:37.272013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6bd88-934b-4822-bed7-e73dfa7a4d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:37.272355 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6bd88-934b-4822-bed7-e73dfa7a4d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:37.272667 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6bd88-934b-4822-bed7-e73dfa7a4d7f admin admin] PATH_INFO: `/v3/users/1e774104d255434cb72f3e579998568c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:37.279707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6bd88-934b-4822-bed7-e73dfa7a4d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e774104d255434cb72f3e579998568c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:37.281829 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6bd88-934b-4822-bed7-e73dfa7a4d7f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:37.344672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905349d2-9419-453f-b305-5ce2c4c9b5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:37.344672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905349d2-9419-453f-b305-5ce2c4c9b5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:37.346808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905349d2-9419-453f-b305-5ce2c4c9b5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:37.348158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905349d2-9419-453f-b305-5ce2c4c9b5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:37.349063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905349d2-9419-453f-b305-5ce2c4c9b5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:37.351370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905349d2-9419-453f-b305-5ce2c4c9b5d9 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:37.381933 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1148/2310] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:37.383931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2ea9b-c5fc-4076-894e-7f7a2e1b7ebc None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:37.384225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2ea9b-c5fc-4076-894e-7f7a2e1b7ebc None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:37.384502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2ea9b-c5fc-4076-894e-7f7a2e1b7ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:37.387177 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1ab6bd88-934b-4822-bed7-e73dfa7a4d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e774104d255434cb72f3e579998568c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:37.388091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1ab6bd88-934b-4822-bed7-e73dfa7a4d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e774104d255434cb72f3e579998568c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:37.389133 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1ab6bd88-934b-4822-bed7-e73dfa7a4d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e774104d255434cb72f3e579998568c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:37.409873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1ab6bd88-934b-4822-bed7-e73dfa7a4d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e774104d255434cb72f3e579998568c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:37.435809 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-1ab6bd88-934b-4822-bed7-e73dfa7a4d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e774104d255434cb72f3e579998568c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:37.486302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-13f2ea9b-c5fc-4076-894e-7f7a2e1b7ebc None None] MFA Rules not processed for user `11215cd11388472c9e410f5721dd9800`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:37.489741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-13f2ea9b-c5fc-4076-894e-7f7a2e1b7ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:37.490322 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1163/2311] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:37 2022] DELETE /identity/v3/users/1e774104d255434cb72f3e579998568c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:37.491620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6bd88-934b-4822-bed7-e73dfa7a4d7f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:37.495188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1ab6bd88-934b-4822-bed7-e73dfa7a4d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:37.640129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1149/2312] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:37.641831 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b29f08-73d8-4c07-95b5-9abaa355dbdd None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:37.642207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b29f08-73d8-4c07-95b5-9abaa355dbdd None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:37.642759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b29f08-73d8-4c07-95b5-9abaa355dbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:37.643434 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6bd88-934b-4822-bed7-e73dfa7a4d7f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:37.661234 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bcdcb-90a0-4219-b138-95425d97d372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:37.662655 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bcdcb-90a0-4219-b138-95425d97d372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:37.662938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bcdcb-90a0-4219-b138-95425d97d372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:37.663224 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bcdcb-90a0-4219-b138-95425d97d372 admin admin] PATH_INFO: `/v3/projects/fd06159c983d4c52a599d5c1e55bb266/users/9856a5058213437982f49b50d98e2add/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:37.663341 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-95b29f08-73d8-4c07-95b5-9abaa355dbdd None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:37.665162 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-95b29f08-73d8-4c07-95b5-9abaa355dbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:37.674435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1150/2313] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:37.678865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b29f08-73d8-4c07-95b5-9abaa355dbdd None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:37.680461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-95b29f08-73d8-4c07-95b5-9abaa355dbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:37.686629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bcdcb-90a0-4219-b138-95425d97d372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd06159c983d4c52a599d5c1e55bb266, user_id=9856a5058213437982f49b50d98e2add, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:37.691523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bcdcb-90a0-4219-b138-95425d97d372 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:37.714868 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1164/2314] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:37 2022] PUT /identity/v3/projects/fd06159c983d4c52a599d5c1e55bb266/users/9856a5058213437982f49b50d98e2add/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:37.725534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279761-52dd-47a2-932e-be2491feb803 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:37.726037 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279761-52dd-47a2-932e-be2491feb803 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:37.726395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279761-52dd-47a2-932e-be2491feb803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:37.780154 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b3279761-52dd-47a2-932e-be2491feb803 None None] MFA Rules not processed for user `9856a5058213437982f49b50d98e2add`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:37.782550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b3279761-52dd-47a2-932e-be2491feb803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:37.784993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b29f08-73d8-4c07-95b5-9abaa355dbdd None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:37.826783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:37.832351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:37.915288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1165/2315] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:37.916112 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279761-52dd-47a2-932e-be2491feb803 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:37.921269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b3279761-52dd-47a2-932e-be2491feb803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:37.937635 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1876a82-a1f9-4cd6-a736-c31a60bbc535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:37.938506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1876a82-a1f9-4cd6-a736-c31a60bbc535 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:37.938917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1876a82-a1f9-4cd6-a736-c31a60bbc535 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:37.939341 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1876a82-a1f9-4cd6-a736-c31a60bbc535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:38.066680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279761-52dd-47a2-932e-be2491feb803 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:38.076148 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61975c4-3e98-4a0c-a78f-1865d694786f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:38.077493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61975c4-3e98-4a0c-a78f-1865d694786f service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:38.077782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61975c4-3e98-4a0c-a78f-1865d694786f service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:38.078067 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61975c4-3e98-4a0c-a78f-1865d694786f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:38.091789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1876a82-a1f9-4cd6-a736-c31a60bbc535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:38.093265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1876a82-a1f9-4cd6-a736-c31a60bbc535 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:38.120673 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1151/2316] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:38.121000 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1876a82-a1f9-4cd6-a736-c31a60bbc535 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:38.272058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61975c4-3e98-4a0c-a78f-1865d694786f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:38.274253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1876a82-a1f9-4cd6-a736-c31a60bbc535 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:38.275338 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61975c4-3e98-4a0c-a78f-1865d694786f service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:38.286519 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555c6bd-6c4a-4831-b8f8-06e66af907da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:38.287221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555c6bd-6c4a-4831-b8f8-06e66af907da admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:38.287510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555c6bd-6c4a-4831-b8f8-06e66af907da admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:38.287817 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555c6bd-6c4a-4831-b8f8-06e66af907da admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:38.288889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555c6bd-6c4a-4831-b8f8-06e66af907da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:38.292453 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555c6bd-6c4a-4831-b8f8-06e66af907da admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:38.303711 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1166/2317] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:38.304660 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61975c4-3e98-4a0c-a78f-1865d694786f service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:38.308861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b61975c4-3e98-4a0c-a78f-1865d694786f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:38.336489 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61975c4-3e98-4a0c-a78f-1865d694786f service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:38.348875 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1152/2318] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:38 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:38.349936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555c6bd-6c4a-4831-b8f8-06e66af907da admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:38.352670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b14f2e-8efd-47b0-bab8-fba5ef239e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:38.353905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b14f2e-8efd-47b0-bab8-fba5ef239e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:38.354406 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b14f2e-8efd-47b0-bab8-fba5ef239e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:38.354855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b14f2e-8efd-47b0-bab8-fba5ef239e35 admin admin] PATH_INFO: `/v3/projects/37d9782f0f0a40939eb95e5641823161` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:38.356404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b14f2e-8efd-47b0-bab8-fba5ef239e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d9782f0f0a40939eb95e5641823161)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:38.359302 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b14f2e-8efd-47b0-bab8-fba5ef239e35 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:38.453240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-13b14f2e-8efd-47b0-bab8-fba5ef239e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d9782f0f0a40939eb95e5641823161', 'request_id': 'req-13b14f2e-8efd-47b0-bab8-fba5ef239e35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:38.473955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-13b14f2e-8efd-47b0-bab8-fba5ef239e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d9782f0f0a40939eb95e5641823161', 'request_id': 'req-13b14f2e-8efd-47b0-bab8-fba5ef239e35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:38.487034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-13b14f2e-8efd-47b0-bab8-fba5ef239e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d9782f0f0a40939eb95e5641823161', 'request_id': 'req-13b14f2e-8efd-47b0-bab8-fba5ef239e35'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:38.512009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555c6bd-6c4a-4831-b8f8-06e66af907da admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:38.519856 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:38.532827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-13b14f2e-8efd-47b0-bab8-fba5ef239e35 admin admin] The token cache is being invalidate because project 37d9782f0f0a40939eb95e5641823161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:38.533480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-13b14f2e-8efd-47b0-bab8-fba5ef239e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:38.534833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-13b14f2e-8efd-47b0-bab8-fba5ef239e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:38.538034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1167/2319] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:38 2022] DELETE /identity/v3/projects/37d9782f0f0a40939eb95e5641823161 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:38.540005 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949a8cb-04c4-4713-86b7-f9df5bf79b19 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:38.540837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949a8cb-04c4-4713-86b7-f9df5bf79b19 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:38.540837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949a8cb-04c4-4713-86b7-f9df5bf79b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:38.567943 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:38.627308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7949a8cb-04c4-4713-86b7-f9df5bf79b19 None None] MFA Rules not processed for user `29aac2ddd3e04ee3b0c68ba2457a8b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:38.631017 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7949a8cb-04c4-4713-86b7-f9df5bf79b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:38.681634 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c568f5-e790-48ad-8b22-84b99a048a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:38.683785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c568f5-e790-48ad-8b22-84b99a048a24 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:38.684921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c568f5-e790-48ad-8b22-84b99a048a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:38.685672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c568f5-e790-48ad-8b22-84b99a048a24 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:38.688600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c568f5-e790-48ad-8b22-84b99a048a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:38.690927 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c568f5-e790-48ad-8b22-84b99a048a24 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:38.771918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1168/2320] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:38.772926 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949a8cb-04c4-4713-86b7-f9df5bf79b19 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:38.774341 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7949a8cb-04c4-4713-86b7-f9df5bf79b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:38.795461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1153/2321] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:38 2022] POST /identity/v3/users => generated 295 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:38.797371 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20327b-1cc3-42cc-8b4a-33acc098b1b7 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:38.797662 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20327b-1cc3-42cc-8b4a-33acc098b1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:38.797965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20327b-1cc3-42cc-8b4a-33acc098b1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:38.807407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949a8cb-04c4-4713-86b7-f9df5bf79b19 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:38.820446 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748630e-2253-4ba0-bd5f-32d5f0582e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:38.822331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748630e-2253-4ba0-bd5f-32d5f0582e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:38.823078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748630e-2253-4ba0-bd5f-32d5f0582e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:38.823461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748630e-2253-4ba0-bd5f-32d5f0582e42 admin admin] PATH_INFO: `/v3/users/2ec2f0a4332643feb978157190d8d92a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:38.827805 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748630e-2253-4ba0-bd5f-32d5f0582e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ec2f0a4332643feb978157190d8d92a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:38.831470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748630e-2253-4ba0-bd5f-32d5f0582e42 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:38.835118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1b20327b-1cc3-42cc-8b4a-33acc098b1b7 None None] MFA Rules not processed for user `e870ec5ae9eb43b6bc650d730f778d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:38.836497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1b20327b-1cc3-42cc-8b4a-33acc098b1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:38.948163 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1154/2322] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:38.950185 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20327b-1cc3-42cc-8b4a-33acc098b1b7 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:38.953007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5748630e-2253-4ba0-bd5f-32d5f0582e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ec2f0a4332643feb978157190d8d92a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:38.953723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5748630e-2253-4ba0-bd5f-32d5f0582e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ec2f0a4332643feb978157190d8d92a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:38.954353 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5748630e-2253-4ba0-bd5f-32d5f0582e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ec2f0a4332643feb978157190d8d92a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:38.955376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1b20327b-1cc3-42cc-8b4a-33acc098b1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:38.994923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5748630e-2253-4ba0-bd5f-32d5f0582e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ec2f0a4332643feb978157190d8d92a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:39.011951 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-5748630e-2253-4ba0-bd5f-32d5f0582e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ec2f0a4332643feb978157190d8d92a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:39.073573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1169/2323] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:38 2022] DELETE /identity/v3/users/2ec2f0a4332643feb978157190d8d92a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:39.074218 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748630e-2253-4ba0-bd5f-32d5f0582e42 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:39.086571 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5748630e-2253-4ba0-bd5f-32d5f0582e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:39.100862 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20327b-1cc3-42cc-8b4a-33acc098b1b7 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:39.200113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:39.214847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748630e-2253-4ba0-bd5f-32d5f0582e42 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:39.229228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1377d19-2dc3-47e4-9d73-6ef048d910bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:39.230255 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1377d19-2dc3-47e4-9d73-6ef048d910bc admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:39.230372 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1377d19-2dc3-47e4-9d73-6ef048d910bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:39.230716 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1377d19-2dc3-47e4-9d73-6ef048d910bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:39.231406 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1377d19-2dc3-47e4-9d73-6ef048d910bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:39.235817 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1377d19-2dc3-47e4-9d73-6ef048d910bc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:39.245259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb6475-2e3f-49c3-8d60-83a71dfc66c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:39.246887 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb6475-2e3f-49c3-8d60-83a71dfc66c5 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:39.247200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb6475-2e3f-49c3-8d60-83a71dfc66c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:39.247675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb6475-2e3f-49c3-8d60-83a71dfc66c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:39.249827 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a2eb6475-2e3f-49c3-8d60-83a71dfc66c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:39.264152 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1170/2324] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:39.265074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1377d19-2dc3-47e4-9d73-6ef048d910bc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:39.268766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a1377d19-2dc3-47e4-9d73-6ef048d910bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:39.289097 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:39.298804 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1377d19-2dc3-47e4-9d73-6ef048d910bc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:39.322857 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc258-5759-4410-96c5-11957f423cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:39.328613 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc258-5759-4410-96c5-11957f423cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:39.328910 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc258-5759-4410-96c5-11957f423cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:39.329198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc258-5759-4410-96c5-11957f423cb2 admin admin] PATH_INFO: `/v3/projects/3b92352bc47f4699b2fe38b8f26096c9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:39.332833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfc258-5759-4410-96c5-11957f423cb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b92352bc47f4699b2fe38b8f26096c9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:39.346098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfc258-5759-4410-96c5-11957f423cb2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:39.378122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb6475-2e3f-49c3-8d60-83a71dfc66c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:39.379809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb6475-2e3f-49c3-8d60-83a71dfc66c5 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:39.401394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1155/2325] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:39.402461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb6475-2e3f-49c3-8d60-83a71dfc66c5 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:39.427163 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb6475-2e3f-49c3-8d60-83a71dfc66c5 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:39.441668 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951fb4b-3d12-4e07-9a45-2a8027f96553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:39.443354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951fb4b-3d12-4e07-9a45-2a8027f96553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:39.444024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951fb4b-3d12-4e07-9a45-2a8027f96553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:39.444493 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951fb4b-3d12-4e07-9a45-2a8027f96553 admin admin] PATH_INFO: `/v3/projects/970ca3ed85c94b53a75e61647b1a9715/users/a87d8ce737f0462bab23ca6a85ccd237/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:39.469484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951fb4b-3d12-4e07-9a45-2a8027f96553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=970ca3ed85c94b53a75e61647b1a9715, user_id=a87d8ce737f0462bab23ca6a85ccd237, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:39.472779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951fb4b-3d12-4e07-9a45-2a8027f96553 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:39.505164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1156/2326] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:39 2022] PUT /identity/v3/projects/970ca3ed85c94b53a75e61647b1a9715/users/a87d8ce737f0462bab23ca6a85ccd237/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:39.507548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3200d1-3991-48e2-ba91-a523dd7660a3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:39.507934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3200d1-3991-48e2-ba91-a523dd7660a3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:39.508249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3200d1-3991-48e2-ba91-a523dd7660a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:39.510195 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-13cfc258-5759-4410-96c5-11957f423cb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b92352bc47f4699b2fe38b8f26096c9', 'request_id': 'req-13cfc258-5759-4410-96c5-11957f423cb2'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:39.529732 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-13cfc258-5759-4410-96c5-11957f423cb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b92352bc47f4699b2fe38b8f26096c9', 'request_id': 'req-13cfc258-5759-4410-96c5-11957f423cb2'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:39.538147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-13cfc258-5759-4410-96c5-11957f423cb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b92352bc47f4699b2fe38b8f26096c9', 'request_id': 'req-13cfc258-5759-4410-96c5-11957f423cb2'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:39.569422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-13cfc258-5759-4410-96c5-11957f423cb2 admin admin] The token cache is being invalidate because project 3b92352bc47f4699b2fe38b8f26096c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:39.569985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-13cfc258-5759-4410-96c5-11957f423cb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:39.570820 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-13cfc258-5759-4410-96c5-11957f423cb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:39.578560 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1171/2327] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:39 2022] DELETE /identity/v3/projects/3b92352bc47f4699b2fe38b8f26096c9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:39.579964 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc258-5759-4410-96c5-11957f423cb2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:39.583323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-13cfc258-5759-4410-96c5-11957f423cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:39.587784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-7b3200d1-3991-48e2-ba91-a523dd7660a3 None None] MFA Rules not processed for user `3fd184b7a5b0463ca9e14375dea63439`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:39.590676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7b3200d1-3991-48e2-ba91-a523dd7660a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:39.757472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc258-5759-4410-96c5-11957f423cb2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:39.783549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1157/2328] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:39 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:39.784875 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfe19d-b6ef-4c9f-85a6-267bca04aa47 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:39.785241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfe19d-b6ef-4c9f-85a6-267bca04aa47 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:39.786022 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfe19d-b6ef-4c9f-85a6-267bca04aa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:39.818732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-40dfe19d-b6ef-4c9f-85a6-267bca04aa47 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:39.820135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-40dfe19d-b6ef-4c9f-85a6-267bca04aa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:39.941039 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b079c0-3e36-4e15-b0b7-ac844db1814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:39.959094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b079c0-3e36-4e15-b0b7-ac844db1814b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:39.959094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b079c0-3e36-4e15-b0b7-ac844db1814b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:39.959094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b079c0-3e36-4e15-b0b7-ac844db1814b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:39.959094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b079c0-3e36-4e15-b0b7-ac844db1814b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:39.959094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b079c0-3e36-4e15-b0b7-ac844db1814b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:39.959741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:39.998845 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1172/2329] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:39.999153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a15a76-d3d3-4130-a439-e726a6d1911b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:40.000326 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a15a76-d3d3-4130-a439-e726a6d1911b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:40.000618 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a15a76-d3d3-4130-a439-e726a6d1911b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:40.084201 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1158/2330] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:40.084201 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfe19d-b6ef-4c9f-85a6-267bca04aa47 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:40.088240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f0a15a76-d3d3-4130-a439-e726a6d1911b None None] MFA Rules not processed for user `a1283412627e4288a3eff6fc09fd5cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:40.090992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f0a15a76-d3d3-4130-a439-e726a6d1911b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:40.137184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfe19d-b6ef-4c9f-85a6-267bca04aa47 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:40.150261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d14dc-c3f1-4e01-81fe-e94150479efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:40.151184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d14dc-c3f1-4e01-81fe-e94150479efe admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:40.151490 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d14dc-c3f1-4e01-81fe-e94150479efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:40.151983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d14dc-c3f1-4e01-81fe-e94150479efe admin admin] PATH_INFO: `/v3/projects/970ca3ed85c94b53a75e61647b1a9715/users/a87d8ce737f0462bab23ca6a85ccd237/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:40.158964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d14dc-c3f1-4e01-81fe-e94150479efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=970ca3ed85c94b53a75e61647b1a9715, user_id=a87d8ce737f0462bab23ca6a85ccd237, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:40.162002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d14dc-c3f1-4e01-81fe-e94150479efe admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:40.164178 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:40.197567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1159/2331] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:40 2022] PUT /identity/v3/projects/970ca3ed85c94b53a75e61647b1a9715/users/a87d8ce737f0462bab23ca6a85ccd237/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:40.208596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcde06-0c4e-44d7-a271-0501f9ae1453 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:40.208915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcde06-0c4e-44d7-a271-0501f9ae1453 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:40.209225 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcde06-0c4e-44d7-a271-0501f9ae1453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:40.272680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a2fcde06-0c4e-44d7-a271-0501f9ae1453 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:40.274309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a2fcde06-0c4e-44d7-a271-0501f9ae1453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:40.296155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1173/2332] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:40.296155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7689206-b936-4096-aff6-e428bddbb205 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:40.296155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7689206-b936-4096-aff6-e428bddbb205 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:40.296155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7689206-b936-4096-aff6-e428bddbb205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:40.378320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1160/2333] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:40.382465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcde06-0c4e-44d7-a271-0501f9ae1453 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:40.384384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a2fcde06-0c4e-44d7-a271-0501f9ae1453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:40.437341 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f7689206-b936-4096-aff6-e428bddbb205 None None] MFA Rules not processed for user `a87d8ce737f0462bab23ca6a85ccd237`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:40.439051 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f7689206-b936-4096-aff6-e428bddbb205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:40.549811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1174/2334] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:40.550939 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7689206-b936-4096-aff6-e428bddbb205 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:40.592526 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7689206-b936-4096-aff6-e428bddbb205 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:40.603736 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0faa17-b00f-46ff-9a47-58b149981fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:40.604651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0faa17-b00f-46ff-9a47-58b149981fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:40.610078 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcde06-0c4e-44d7-a271-0501f9ae1453 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:40.610963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0faa17-b00f-46ff-9a47-58b149981fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:40.611410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0faa17-b00f-46ff-9a47-58b149981fb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:40.613497 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0faa17-b00f-46ff-9a47-58b149981fb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:40.613819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0faa17-b00f-46ff-9a47-58b149981fb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:40.617368 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0faa17-b00f-46ff-9a47-58b149981fb1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:40.627071 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4cdc1-aa79-46f9-a753-db655a6b5c64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:40.627932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4cdc1-aa79-46f9-a753-db655a6b5c64 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:40.629464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4cdc1-aa79-46f9-a753-db655a6b5c64 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:40.631532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4cdc1-aa79-46f9-a753-db655a6b5c64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:40.639724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4ef4cdc1-aa79-46f9-a753-db655a6b5c64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:40.645030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1175/2335] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:40.646683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0faa17-b00f-46ff-9a47-58b149981fb1 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:40.648670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1f0faa17-b00f-46ff-9a47-58b149981fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:40.702214 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0faa17-b00f-46ff-9a47-58b149981fb1 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:40.716896 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17533e-d311-42fa-b41c-eae07927fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:40.720088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17533e-d311-42fa-b41c-eae07927fa8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:40.720521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17533e-d311-42fa-b41c-eae07927fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:40.722696 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17533e-d311-42fa-b41c-eae07927fa8d admin admin] PATH_INFO: `/v3/projects/efefe4e82fd64bc9abf0b98b921b90c5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:40.725564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17533e-d311-42fa-b41c-eae07927fa8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=efefe4e82fd64bc9abf0b98b921b90c5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:40.729927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17533e-d311-42fa-b41c-eae07927fa8d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:40.782332 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4cdc1-aa79-46f9-a753-db655a6b5c64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:40.784368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4cdc1-aa79-46f9-a753-db655a6b5c64 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:40.802441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1161/2336] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:40.803022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8d17533e-d311-42fa-b41c-eae07927fa8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efefe4e82fd64bc9abf0b98b921b90c5', 'request_id': 'req-8d17533e-d311-42fa-b41c-eae07927fa8d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:40.805263 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4cdc1-aa79-46f9-a753-db655a6b5c64 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:40.806726 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4ef4cdc1-aa79-46f9-a753-db655a6b5c64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:40.818287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8d17533e-d311-42fa-b41c-eae07927fa8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efefe4e82fd64bc9abf0b98b921b90c5', 'request_id': 'req-8d17533e-d311-42fa-b41c-eae07927fa8d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:40.821517 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:40.826635 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8d17533e-d311-42fa-b41c-eae07927fa8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efefe4e82fd64bc9abf0b98b921b90c5', 'request_id': 'req-8d17533e-d311-42fa-b41c-eae07927fa8d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:40.846638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8d17533e-d311-42fa-b41c-eae07927fa8d admin admin] The token cache is being invalidate because project efefe4e82fd64bc9abf0b98b921b90c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:40.846935 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8d17533e-d311-42fa-b41c-eae07927fa8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:40.848836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8d17533e-d311-42fa-b41c-eae07927fa8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:40.857058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1176/2337] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:40 2022] DELETE /identity/v3/projects/efefe4e82fd64bc9abf0b98b921b90c5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:40.857058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17533e-d311-42fa-b41c-eae07927fa8d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:40.857058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8d17533e-d311-42fa-b41c-eae07927fa8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:40.905566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:40.947659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4cdc1-aa79-46f9-a753-db655a6b5c64 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:40.957166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17533e-d311-42fa-b41c-eae07927fa8d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:40.970117 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244870c-cf8a-404b-9d15-23bc5eabe3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:40.971108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244870c-cf8a-404b-9d15-23bc5eabe3e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:40.971108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244870c-cf8a-404b-9d15-23bc5eabe3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:40.971390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244870c-cf8a-404b-9d15-23bc5eabe3e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:40.972148 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244870c-cf8a-404b-9d15-23bc5eabe3e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:40.974534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244870c-cf8a-404b-9d15-23bc5eabe3e4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:41.020697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1177/2338] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:40 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:41.021874 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666b341-d835-446a-bbdd-594045d2023f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:41.022164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666b341-d835-446a-bbdd-594045d2023f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:41.022926 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666b341-d835-446a-bbdd-594045d2023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:41.048859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4dfb9-b2ef-453d-b00e-b092ac3b2af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:41.050183 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4dfb9-b2ef-453d-b00e-b092ac3b2af0 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:41.050592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4dfb9-b2ef-453d-b00e-b092ac3b2af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:41.050837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5666b341-d835-446a-bbdd-594045d2023f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:41.051009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4dfb9-b2ef-453d-b00e-b092ac3b2af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:41.052411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5666b341-d835-446a-bbdd-594045d2023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:41.053895 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-58f4dfb9-b2ef-453d-b00e-b092ac3b2af0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:41.128880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4dfb9-b2ef-453d-b00e-b092ac3b2af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:41.130534 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4dfb9-b2ef-453d-b00e-b092ac3b2af0 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:41.137517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1178/2339] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:41.138370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666b341-d835-446a-bbdd-594045d2023f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:41.150965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1162/2340] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:41.152566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666b341-d835-446a-bbdd-594045d2023f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:41.153135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5c303-e399-45fd-ab7a-bb9010ca4c2e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:41.153433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5c303-e399-45fd-ab7a-bb9010ca4c2e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:41.153716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5c303-e399-45fd-ab7a-bb9010ca4c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:41.159247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81095c02-824b-4e52-aed9-4939e5395d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:41.160166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81095c02-824b-4e52-aed9-4939e5395d80 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:41.162396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81095c02-824b-4e52-aed9-4939e5395d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:41.163002 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81095c02-824b-4e52-aed9-4939e5395d80 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:41.163990 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81095c02-824b-4e52-aed9-4939e5395d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:41.167160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81095c02-824b-4e52-aed9-4939e5395d80 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:41.174306 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0aa5c303-e399-45fd-ab7a-bb9010ca4c2e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:41.175535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0aa5c303-e399-45fd-ab7a-bb9010ca4c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:41.185063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1163/2341] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:41.189628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5c303-e399-45fd-ab7a-bb9010ca4c2e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:41.201787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5c303-e399-45fd-ab7a-bb9010ca4c2e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:41.203491 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1179/2342] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:41 2022] POST /identity/v3/users => generated 281 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:41.207443 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81095c02-824b-4e52-aed9-4939e5395d80 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:41.210631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791f69e-7ce9-4838-bbe2-8eadeda6aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:41.211313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791f69e-7ce9-4838-bbe2-8eadeda6aabf admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:41.211618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791f69e-7ce9-4838-bbe2-8eadeda6aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:41.211910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791f69e-7ce9-4838-bbe2-8eadeda6aabf admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:41.212820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791f69e-7ce9-4838-bbe2-8eadeda6aabf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:41.213135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791f69e-7ce9-4838-bbe2-8eadeda6aabf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:41.215537 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791f69e-7ce9-4838-bbe2-8eadeda6aabf admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:41.223780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81095c02-824b-4e52-aed9-4939e5395d80 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:41.229742 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac602ae-df87-486d-b2b1-d6b02b231664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:41.230908 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac602ae-df87-486d-b2b1-d6b02b231664 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:41.232065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac602ae-df87-486d-b2b1-d6b02b231664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:41.232817 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac602ae-df87-486d-b2b1-d6b02b231664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:41.234226 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac602ae-df87-486d-b2b1-d6b02b231664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:41.234359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1164/2343] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:41.235196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791f69e-7ce9-4838-bbe2-8eadeda6aabf admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:41.237125 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac602ae-df87-486d-b2b1-d6b02b231664 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:41.247079 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791f69e-7ce9-4838-bbe2-8eadeda6aabf admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:41.251969 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1180/2344] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:41.256124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac602ae-df87-486d-b2b1-d6b02b231664 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:41.256261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a0147-65d0-428a-a128-c1c9a0cec5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:41.257025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a0147-65d0-428a-a128-c1c9a0cec5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:41.257456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a0147-65d0-428a-a128-c1c9a0cec5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:41.257746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a0147-65d0-428a-a128-c1c9a0cec5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:41.258455 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a0147-65d0-428a-a128-c1c9a0cec5a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:41.260671 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a0147-65d0-428a-a128-c1c9a0cec5a1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:41.275796 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac602ae-df87-486d-b2b1-d6b02b231664 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:41.283242 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac81a02-b857-44be-b769-f96224f03526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:41.284018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac81a02-b857-44be-b769-f96224f03526 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:41.284340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac81a02-b857-44be-b769-f96224f03526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:41.284639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac81a02-b857-44be-b769-f96224f03526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:41.285385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac81a02-b857-44be-b769-f96224f03526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:41.288198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac81a02-b857-44be-b769-f96224f03526 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:41.307134 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1181/2345] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:41.307479 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1165/2346] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:41 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:41.308082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac81a02-b857-44be-b769-f96224f03526 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:41.309627 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a0147-65d0-428a-a128-c1c9a0cec5a1 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:41.319193 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac81a02-b857-44be-b769-f96224f03526 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:41.395556 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:41.466559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56495be-8984-4b3b-a05a-218ab66a64e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:41.468285 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56495be-8984-4b3b-a05a-218ab66a64e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:41.468632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56495be-8984-4b3b-a05a-218ab66a64e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:41.468918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56495be-8984-4b3b-a05a-218ab66a64e8 admin admin] PATH_INFO: `/v3/projects/fb41fc5bae6a4adc92efb17d579bee4b/users/3716c4963c254da78f652ca78b3ba3d6/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:41.509549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a0147-65d0-428a-a128-c1c9a0cec5a1 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:41.519353 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56495be-8984-4b3b-a05a-218ab66a64e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb41fc5bae6a4adc92efb17d579bee4b, user_id=3716c4963c254da78f652ca78b3ba3d6, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:41.525890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb3a0f-b4ea-405f-9a1a-aa7b247b1f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:41.526698 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb3a0f-b4ea-405f-9a1a-aa7b247b1f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:41.526952 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56495be-8984-4b3b-a05a-218ab66a64e8 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:41.527239 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb3a0f-b4ea-405f-9a1a-aa7b247b1f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:41.527579 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb3a0f-b4ea-405f-9a1a-aa7b247b1f8a admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:41.529915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb3a0f-b4ea-405f-9a1a-aa7b247b1f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:41.532060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb3a0f-b4ea-405f-9a1a-aa7b247b1f8a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:41.552834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:41.556566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1182/2347] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:41 2022] PUT /identity/v3/projects/fb41fc5bae6a4adc92efb17d579bee4b/users/3716c4963c254da78f652ca78b3ba3d6/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:41.563802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56495be-8984-4b3b-a05a-218ab66a64e8 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:41.569689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f56495be-8984-4b3b-a05a-218ab66a64e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:41.593929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1166/2348] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:41 2022] POST /identity/v3/users => generated 292 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:41.595281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a0fb2-6a8c-4630-a7ac-593bb188b23e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:41.595880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a0fb2-6a8c-4630-a7ac-593bb188b23e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:41.596223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a0fb2-6a8c-4630-a7ac-593bb188b23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:41.664683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-962a0fb2-6a8c-4630-a7ac-593bb188b23e None None] MFA Rules not processed for user `3716c4963c254da78f652ca78b3ba3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:41.668642 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-962a0fb2-6a8c-4630-a7ac-593bb188b23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:41.758793 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56495be-8984-4b3b-a05a-218ab66a64e8 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:41.771470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f072170-50ae-4a64-a94e-c0e5dc5657f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:41.773648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072170-50ae-4a64-a94e-c0e5dc5657f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:41.773941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072170-50ae-4a64-a94e-c0e5dc5657f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:41.774228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072170-50ae-4a64-a94e-c0e5dc5657f0 admin admin] PATH_INFO: `/v3/users/11215cd11388472c9e410f5721dd9800` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:41.777294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f072170-50ae-4a64-a94e-c0e5dc5657f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11215cd11388472c9e410f5721dd9800)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:41.780407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f072170-50ae-4a64-a94e-c0e5dc5657f0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:41.870098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0f072170-50ae-4a64-a94e-c0e5dc5657f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11215cd11388472c9e410f5721dd9800'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:41.871947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0f072170-50ae-4a64-a94e-c0e5dc5657f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11215cd11388472c9e410f5721dd9800'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:41.872684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0f072170-50ae-4a64-a94e-c0e5dc5657f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11215cd11388472c9e410f5721dd9800'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:41.893352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1167/2349] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:41.894595 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a0fb2-6a8c-4630-a7ac-593bb188b23e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:41.907800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0f072170-50ae-4a64-a94e-c0e5dc5657f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11215cd11388472c9e410f5721dd9800'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:41.913546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a0fb2-6a8c-4630-a7ac-593bb188b23e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:41.922682 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df17a9e-4541-453b-bb87-af11dcd99261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:41.924732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df17a9e-4541-453b-bb87-af11dcd99261 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:41.924732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df17a9e-4541-453b-bb87-af11dcd99261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:41.924958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df17a9e-4541-453b-bb87-af11dcd99261 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:41.925818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df17a9e-4541-453b-bb87-af11dcd99261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:41.928128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df17a9e-4541-453b-bb87-af11dcd99261 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:41.931344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0f072170-50ae-4a64-a94e-c0e5dc5657f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11215cd11388472c9e410f5721dd9800'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:41.939897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1168/2350] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:41.941236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df17a9e-4541-453b-bb87-af11dcd99261 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:41.943234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0df17a9e-4541-453b-bb87-af11dcd99261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:41.965099 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1183/2351] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:41 2022] DELETE /identity/v3/users/11215cd11388472c9e410f5721dd9800 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:41.966375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f072170-50ae-4a64-a94e-c0e5dc5657f0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:41.968670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0f072170-50ae-4a64-a94e-c0e5dc5657f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:42.046376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df17a9e-4541-453b-bb87-af11dcd99261 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:42.077179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f072170-50ae-4a64-a94e-c0e5dc5657f0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:42.109661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b2233-bce5-4bed-923f-e87c634e5600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:42.110420 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b2233-bce5-4bed-923f-e87c634e5600 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:42.110770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b2233-bce5-4bed-923f-e87c634e5600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:42.110964 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b2233-bce5-4bed-923f-e87c634e5600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:42.112076 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b2233-bce5-4bed-923f-e87c634e5600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:42.117240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b2233-bce5-4bed-923f-e87c634e5600 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:42.138563 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1184/2352] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:42.146548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf11956-6051-4d8b-ba06-dd73b98b1677 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:42.146839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf11956-6051-4d8b-ba06-dd73b98b1677 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:42.150007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf11956-6051-4d8b-ba06-dd73b98b1677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:42.179423 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab832a5b-c925-4ce5-baa8-e9f066c132ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:42.181329 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab832a5b-c925-4ce5-baa8-e9f066c132ff service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:42.183745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab832a5b-c925-4ce5-baa8-e9f066c132ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:42.184296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab832a5b-c925-4ce5-baa8-e9f066c132ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:42.194090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ab832a5b-c925-4ce5-baa8-e9f066c132ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:42.199485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ccf11956-6051-4d8b-ba06-dd73b98b1677 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:42.200814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ccf11956-6051-4d8b-ba06-dd73b98b1677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:42.220426 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:42.228323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1185/2353] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:42.228323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf11956-6051-4d8b-ba06-dd73b98b1677 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:42.253912 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf11956-6051-4d8b-ba06-dd73b98b1677 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:42.260401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95de15-24bc-4df6-82a5-643eef3ced88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:42.262325 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95de15-24bc-4df6-82a5-643eef3ced88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:42.262836 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95de15-24bc-4df6-82a5-643eef3ced88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:42.263023 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95de15-24bc-4df6-82a5-643eef3ced88 admin admin] PATH_INFO: `/v3/projects/e7007711efb54d18931135d26348a900/users/7274cf6b89cc4e13ae2881c999388ff5/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:42.266865 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:42.290409 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95de15-24bc-4df6-82a5-643eef3ced88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7007711efb54d18931135d26348a900, user_id=7274cf6b89cc4e13ae2881c999388ff5, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:42.294239 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95de15-24bc-4df6-82a5-643eef3ced88 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:42.320245 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1186/2354] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:42 2022] PUT /identity/v3/projects/e7007711efb54d18931135d26348a900/users/7274cf6b89cc4e13ae2881c999388ff5/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:42.321427 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95de15-24bc-4df6-82a5-643eef3ced88 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:42.325355 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8c95de15-24bc-4df6-82a5-643eef3ced88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:42.346506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab832a5b-c925-4ce5-baa8-e9f066c132ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:42.365564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab832a5b-c925-4ce5-baa8-e9f066c132ff service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:42.405946 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1169/2355] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:42.409652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fed2e7-fe26-470a-8889-0c7f8f9addf8 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:42.409953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fed2e7-fe26-470a-8889-0c7f8f9addf8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:42.413749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fed2e7-fe26-470a-8889-0c7f8f9addf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:42.473857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c4fed2e7-fe26-470a-8889-0c7f8f9addf8 None None] MFA Rules not processed for user `7274cf6b89cc4e13ae2881c999388ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:42.475196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c4fed2e7-fe26-470a-8889-0c7f8f9addf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:42.497000 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95de15-24bc-4df6-82a5-643eef3ced88 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:42.501239 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a03c8f-7fea-4f00-9c48-81392520ade1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:42.502314 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a03c8f-7fea-4f00-9c48-81392520ade1 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:42.502648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a03c8f-7fea-4f00-9c48-81392520ade1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:42.502995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a03c8f-7fea-4f00-9c48-81392520ade1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:42.588210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a03c8f-7fea-4f00-9c48-81392520ade1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:42.590411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a03c8f-7fea-4f00-9c48-81392520ade1 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:42.607175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1170/2356] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:42.608542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fed2e7-fe26-470a-8889-0c7f8f9addf8 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:42.610141 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c4fed2e7-fe26-470a-8889-0c7f8f9addf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:42.620232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1187/2357] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:42.625460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a03c8f-7fea-4f00-9c48-81392520ade1 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:42.627914 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-76a03c8f-7fea-4f00-9c48-81392520ade1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:42.628522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fed2e7-fe26-470a-8889-0c7f8f9addf8 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:42.634213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dda50-b019-46b3-aab2-962225dbc703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:42.635763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dda50-b019-46b3-aab2-962225dbc703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:42.636375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dda50-b019-46b3-aab2-962225dbc703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:42.637040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dda50-b019-46b3-aab2-962225dbc703 admin admin] PATH_INFO: `/v3/users/3716c4963c254da78f652ca78b3ba3d6` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:42.638896 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dda50-b019-46b3-aab2-962225dbc703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3716c4963c254da78f652ca78b3ba3d6)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:42.641435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dda50-b019-46b3-aab2-962225dbc703 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:42.727624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5b5dda50-b019-46b3-aab2-962225dbc703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3716c4963c254da78f652ca78b3ba3d6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:42.753344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5b5dda50-b019-46b3-aab2-962225dbc703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3716c4963c254da78f652ca78b3ba3d6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:42.756389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5b5dda50-b019-46b3-aab2-962225dbc703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3716c4963c254da78f652ca78b3ba3d6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:42.756389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5b5dda50-b019-46b3-aab2-962225dbc703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3716c4963c254da78f652ca78b3ba3d6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:42.780366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-5b5dda50-b019-46b3-aab2-962225dbc703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3716c4963c254da78f652ca78b3ba3d6'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:42.781086 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a03c8f-7fea-4f00-9c48-81392520ade1 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:42.789888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d05c7-789d-48bc-a2d7-d3b44d6bbbb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:42.791251 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d05c7-789d-48bc-a2d7-d3b44d6bbbb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:42.792172 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d05c7-789d-48bc-a2d7-d3b44d6bbbb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:42.793473 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d05c7-789d-48bc-a2d7-d3b44d6bbbb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:42.799052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3e3d05c7-789d-48bc-a2d7-d3b44d6bbbb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:42.834196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d05c7-789d-48bc-a2d7-d3b44d6bbbb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:42.836807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d05c7-789d-48bc-a2d7-d3b44d6bbbb8 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:42.858339 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1171/2358] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:42 2022] DELETE /identity/v3/users/3716c4963c254da78f652ca78b3ba3d6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:42.885174 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61a091-ab26-416d-8cc9-ce42c2182061 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:42.885471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61a091-ab26-416d-8cc9-ce42c2182061 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:42.888088 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61a091-ab26-416d-8cc9-ce42c2182061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:42.912548 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1188/2359] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:42.961537 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-4c61a091-ab26-416d-8cc9-ce42c2182061 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:42.962936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4c61a091-ab26-416d-8cc9-ce42c2182061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:43.001319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:43.123558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d05c7-789d-48bc-a2d7-d3b44d6bbbb8 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:43.125366 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3e3d05c7-789d-48bc-a2d7-d3b44d6bbbb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:43.143745 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d05c7-789d-48bc-a2d7-d3b44d6bbbb8 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:43.166896 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1172/2360] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:43.232534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:43.256313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61a091-ab26-416d-8cc9-ce42c2182061 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:43.258285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4c61a091-ab26-416d-8cc9-ce42c2182061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:43.283251 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5dfb5-b4b6-4bab-8be6-62d7ea9e9ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:43.284423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5dfb5-b4b6-4bab-8be6-62d7ea9e9ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:43.284900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5dfb5-b4b6-4bab-8be6-62d7ea9e9ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:43.285688 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5dfb5-b4b6-4bab-8be6-62d7ea9e9ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:43.287562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3fd5dfb5-b4b6-4bab-8be6-62d7ea9e9ab4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:43.380549 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5dfb5-b4b6-4bab-8be6-62d7ea9e9ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:43.382797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5dfb5-b4b6-4bab-8be6-62d7ea9e9ab4 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:43.403941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1189/2361] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:43.408381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036144c3-c1e3-48ab-8496-cbe7af2e6676 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:43.408701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036144c3-c1e3-48ab-8496-cbe7af2e6676 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:43.408993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036144c3-c1e3-48ab-8496-cbe7af2e6676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:43.468327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61a091-ab26-416d-8cc9-ce42c2182061 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:43.491418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a160a-374c-4bb7-96db-aec6e6908dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:43.493638 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a160a-374c-4bb7-96db-aec6e6908dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:43.497248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a160a-374c-4bb7-96db-aec6e6908dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:43.497725 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a160a-374c-4bb7-96db-aec6e6908dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:43.500210 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-036144c3-c1e3-48ab-8496-cbe7af2e6676 None None] MFA Rules not processed for user `29aac2ddd3e04ee3b0c68ba2457a8b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:43.502634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-036144c3-c1e3-48ab-8496-cbe7af2e6676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:43.540668 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a160a-374c-4bb7-96db-aec6e6908dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:43.545129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a160a-374c-4bb7-96db-aec6e6908dd9 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:43.564995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1173/2362] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:31:43.667288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1190/2363] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:44.813533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a160a-374c-4bb7-96db-aec6e6908dd9 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:44.815714 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d12a160a-374c-4bb7-96db-aec6e6908dd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:44.834171 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a160a-374c-4bb7-96db-aec6e6908dd9 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:44.843435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cb792-ab06-4fd9-acf4-fb66a5ac8555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:44.844231 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cb792-ab06-4fd9-acf4-fb66a5ac8555 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:44.844607 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cb792-ab06-4fd9-acf4-fb66a5ac8555 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:44.845003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cb792-ab06-4fd9-acf4-fb66a5ac8555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:44.847368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0a0cb792-ab06-4fd9-acf4-fb66a5ac8555 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:45.016269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cb792-ab06-4fd9-acf4-fb66a5ac8555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:45.016793 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036144c3-c1e3-48ab-8496-cbe7af2e6676 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:45.018103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cb792-ab06-4fd9-acf4-fb66a5ac8555 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:45.018950 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-036144c3-c1e3-48ab-8496-cbe7af2e6676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:45.032648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1174/2364] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:45.052817 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036144c3-c1e3-48ab-8496-cbe7af2e6676 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:45.068088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2eca1-113b-47be-8155-25443fca7408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:45.069196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2eca1-113b-47be-8155-25443fca7408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:45.069487 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2eca1-113b-47be-8155-25443fca7408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:45.069747 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2eca1-113b-47be-8155-25443fca7408 admin admin] PATH_INFO: `/v3/projects/eea49fc05a6d49d0bed2faa2b17a08db` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:45.081415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2eca1-113b-47be-8155-25443fca7408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea49fc05a6d49d0bed2faa2b17a08db)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:45.086335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2eca1-113b-47be-8155-25443fca7408 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:45.258070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e5d2eca1-113b-47be-8155-25443fca7408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea49fc05a6d49d0bed2faa2b17a08db', 'request_id': 'req-e5d2eca1-113b-47be-8155-25443fca7408'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:45.298696 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e5d2eca1-113b-47be-8155-25443fca7408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea49fc05a6d49d0bed2faa2b17a08db', 'request_id': 'req-e5d2eca1-113b-47be-8155-25443fca7408'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:45.318428 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e5d2eca1-113b-47be-8155-25443fca7408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea49fc05a6d49d0bed2faa2b17a08db', 'request_id': 'req-e5d2eca1-113b-47be-8155-25443fca7408'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:45.337571 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e5d2eca1-113b-47be-8155-25443fca7408 admin admin] The token cache is being invalidate because project eea49fc05a6d49d0bed2faa2b17a08db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:45.338009 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e5d2eca1-113b-47be-8155-25443fca7408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:45.338936 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e5d2eca1-113b-47be-8155-25443fca7408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:45.340947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1191/2365] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:45 2022] DELETE /identity/v3/projects/eea49fc05a6d49d0bed2faa2b17a08db => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:45.346689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a367af-f012-42d9-8fa9-862b84f8a160 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:45.346989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a367af-f012-42d9-8fa9-862b84f8a160 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:45.347282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a367af-f012-42d9-8fa9-862b84f8a160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:45.373009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-43a367af-f012-42d9-8fa9-862b84f8a160 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:45.373366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-43a367af-f012-42d9-8fa9-862b84f8a160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:45.463449 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2eca1-113b-47be-8155-25443fca7408 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:45.465531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e5d2eca1-113b-47be-8155-25443fca7408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:45.493448 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:45.524350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:45.529298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1175/2366] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:45.540798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39ed49-d69b-451e-a100-d84029a7b501 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:45.541100 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39ed49-d69b-451e-a100-d84029a7b501 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:45.541365 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39ed49-d69b-451e-a100-d84029a7b501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:45.580424 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1e39ed49-d69b-451e-a100-d84029a7b501 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:45.581991 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1e39ed49-d69b-451e-a100-d84029a7b501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:45.603419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1176/2367] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:45.604744 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39ed49-d69b-451e-a100-d84029a7b501 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:45.618202 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39ed49-d69b-451e-a100-d84029a7b501 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:45.633007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e70465-4e50-4813-b45d-5eb6800d98f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:45.635399 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e70465-4e50-4813-b45d-5eb6800d98f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:45.635854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e70465-4e50-4813-b45d-5eb6800d98f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:45.637121 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e70465-4e50-4813-b45d-5eb6800d98f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:45.638005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e70465-4e50-4813-b45d-5eb6800d98f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:45.639863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e70465-4e50-4813-b45d-5eb6800d98f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:45.641811 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e70465-4e50-4813-b45d-5eb6800d98f2 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:45.642779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2eca1-113b-47be-8155-25443fca7408 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:45.650667 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550a265-e732-4f0f-9983-eed3b0529799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:45.651847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550a265-e732-4f0f-9983-eed3b0529799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:45.652352 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550a265-e732-4f0f-9983-eed3b0529799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:45.652587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550a265-e732-4f0f-9983-eed3b0529799 admin admin] PATH_INFO: `/v3/projects/fb41fc5bae6a4adc92efb17d579bee4b` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:45.653856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550a265-e732-4f0f-9983-eed3b0529799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb41fc5bae6a4adc92efb17d579bee4b)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:45.655838 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550a265-e732-4f0f-9983-eed3b0529799 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:45.661664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1177/2368] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:45.663002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e70465-4e50-4813-b45d-5eb6800d98f2 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:45.683035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e70465-4e50-4813-b45d-5eb6800d98f2 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:45.683035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce398a20-be60-49d3-82dd-f69ee6dfa872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:45.683035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce398a20-be60-49d3-82dd-f69ee6dfa872 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:45.683366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce398a20-be60-49d3-82dd-f69ee6dfa872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:45.685683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce398a20-be60-49d3-82dd-f69ee6dfa872 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:45.685683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce398a20-be60-49d3-82dd-f69ee6dfa872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:45.689296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce398a20-be60-49d3-82dd-f69ee6dfa872 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:45.734512 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1178/2369] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:45 2022] POST /identity/v3/projects => generated 363 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:45.738799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce398a20-be60-49d3-82dd-f69ee6dfa872 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:45.765171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a550a265-e732-4f0f-9983-eed3b0529799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb41fc5bae6a4adc92efb17d579bee4b', 'request_id': 'req-a550a265-e732-4f0f-9983-eed3b0529799'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:45.780391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a550a265-e732-4f0f-9983-eed3b0529799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb41fc5bae6a4adc92efb17d579bee4b', 'request_id': 'req-a550a265-e732-4f0f-9983-eed3b0529799'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:45.796116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a550a265-e732-4f0f-9983-eed3b0529799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb41fc5bae6a4adc92efb17d579bee4b', 'request_id': 'req-a550a265-e732-4f0f-9983-eed3b0529799'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:45.815189 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a550a265-e732-4f0f-9983-eed3b0529799 admin admin] The token cache is being invalidate because project fb41fc5bae6a4adc92efb17d579bee4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:45.815487 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a550a265-e732-4f0f-9983-eed3b0529799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:45.818596 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a550a265-e732-4f0f-9983-eed3b0529799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:45.824915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1192/2370] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:45 2022] DELETE /identity/v3/projects/fb41fc5bae6a4adc92efb17d579bee4b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:45.827744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4eda1-fdec-46c7-b38b-a4eaaef05b31 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:45.828160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4eda1-fdec-46c7-b38b-a4eaaef05b31 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:45.829461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4eda1-fdec-46c7-b38b-a4eaaef05b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:45.849283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce398a20-be60-49d3-82dd-f69ee6dfa872 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:45.857695 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa52693-d946-4df4-9809-6d03171c594c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:45.858395 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa52693-d946-4df4-9809-6d03171c594c admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:45.858862 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa52693-d946-4df4-9809-6d03171c594c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:45.858967 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa52693-d946-4df4-9809-6d03171c594c admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:45.863491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa52693-d946-4df4-9809-6d03171c594c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:45.863491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa52693-d946-4df4-9809-6d03171c594c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:45.864678 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-14b4eda1-fdec-46c7-b38b-a4eaaef05b31 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:45.867318 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-14b4eda1-fdec-46c7-b38b-a4eaaef05b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:45.879968 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1193/2371] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:31:45.895974 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21248e-1862-460d-9d95-1b58e638feef None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:45.896377 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21248e-1862-460d-9d95-1b58e638feef None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:45.896757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21248e-1862-460d-9d95-1b58e638feef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:45.904475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1179/2372] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:45 2022] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:31:45.905463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa52693-d946-4df4-9809-6d03171c594c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:45.907184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3fa52693-d946-4df4-9809-6d03171c594c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:45.921854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa52693-d946-4df4-9809-6d03171c594c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:45.926987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e86fbb-91e2-4d85-8766-7ce98eace239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:45.927840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e86fbb-91e2-4d85-8766-7ce98eace239 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:45.928127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e86fbb-91e2-4d85-8766-7ce98eace239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:45.928402 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e86fbb-91e2-4d85-8766-7ce98eace239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:45.929147 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e86fbb-91e2-4d85-8766-7ce98eace239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:45.930689 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9a21248e-1862-460d-9d95-1b58e638feef None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:45.931010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e86fbb-91e2-4d85-8766-7ce98eace239 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:45.932294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9a21248e-1862-460d-9d95-1b58e638feef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:45.963469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1194/2373] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:45.964921 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21248e-1862-460d-9d95-1b58e638feef None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:46.003374 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21248e-1862-460d-9d95-1b58e638feef None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:46.010427 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1180/2374] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:46.012042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e86fbb-91e2-4d85-8766-7ce98eace239 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:46.027158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cb516-cb67-4e5e-9b08-d791c5abd62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:46.030182 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cb516-cb67-4e5e-9b08-d791c5abd62a admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:46.031165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cb516-cb67-4e5e-9b08-d791c5abd62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:46.031645 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cb516-cb67-4e5e-9b08-d791c5abd62a admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:46.034896 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cb516-cb67-4e5e-9b08-d791c5abd62a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:46.037173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cb516-cb67-4e5e-9b08-d791c5abd62a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:46.038912 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cb516-cb67-4e5e-9b08-d791c5abd62a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:46.048192 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e86fbb-91e2-4d85-8766-7ce98eace239 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:46.066139 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ed0c1-f70c-4b6e-9984-0f88a26b9608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:46.067073 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ed0c1-f70c-4b6e-9984-0f88a26b9608 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:46.067870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ed0c1-f70c-4b6e-9984-0f88a26b9608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:46.067870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ed0c1-f70c-4b6e-9984-0f88a26b9608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:46.068750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ed0c1-f70c-4b6e-9984-0f88a26b9608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:46.074245 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1195/2375] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:46.075413 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cb516-cb67-4e5e-9b08-d791c5abd62a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:46.077184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ed0c1-f70c-4b6e-9984-0f88a26b9608 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:46.098239 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cb516-cb67-4e5e-9b08-d791c5abd62a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:46.110678 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a518a-b479-4275-acbe-d42ee324cb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:46.111625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a518a-b479-4275-acbe-d42ee324cb0c admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:46.112055 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a518a-b479-4275-acbe-d42ee324cb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:46.112815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a518a-b479-4275-acbe-d42ee324cb0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:46.113253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a518a-b479-4275-acbe-d42ee324cb0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:46.115256 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a518a-b479-4275-acbe-d42ee324cb0c admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:46.119281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1181/2376] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:46.121692 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ed0c1-f70c-4b6e-9984-0f88a26b9608 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:46.142623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ed0c1-f70c-4b6e-9984-0f88a26b9608 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:46.149780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fee46-dccc-49cb-9b4f-a3c64305b896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:46.152810 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fee46-dccc-49cb-9b4f-a3c64305b896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:46.153155 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fee46-dccc-49cb-9b4f-a3c64305b896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:46.153505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fee46-dccc-49cb-9b4f-a3c64305b896 admin admin] PATH_INFO: `/v3/projects/1448801bfbe84213aa62de48670ec4d9/users/533f30f382d74be58d1cee632bceb942/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:46.165018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1196/2377] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:46 2022] POST /identity/v3/projects => generated 371 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:46.169270 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a518a-b479-4275-acbe-d42ee324cb0c admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:46.174676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fee46-dccc-49cb-9b4f-a3c64305b896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1448801bfbe84213aa62de48670ec4d9, user_id=533f30f382d74be58d1cee632bceb942, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:46.177884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fee46-dccc-49cb-9b4f-a3c64305b896 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:46.202719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1182/2378] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:46 2022] PUT /identity/v3/projects/1448801bfbe84213aa62de48670ec4d9/users/533f30f382d74be58d1cee632bceb942/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:46.213042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f52c9-215c-41ae-b10a-271d40fa0ef0 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:46.213581 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f52c9-215c-41ae-b10a-271d40fa0ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:46.214383 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f52c9-215c-41ae-b10a-271d40fa0ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:46.264256 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b34f52c9-215c-41ae-b10a-271d40fa0ef0 None None] MFA Rules not processed for user `533f30f382d74be58d1cee632bceb942`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:46.265689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b34f52c9-215c-41ae-b10a-271d40fa0ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:46.328137 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a518a-b479-4275-acbe-d42ee324cb0c admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:46.342637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:46.358327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:46.424937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1183/2379] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:31:46.478038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8151476-e43c-4282-96d5-0d116772f045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:46.478930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8151476-e43c-4282-96d5-0d116772f045 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:46.479495 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8151476-e43c-4282-96d5-0d116772f045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:46.480090 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8151476-e43c-4282-96d5-0d116772f045 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:46.481379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8151476-e43c-4282-96d5-0d116772f045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:46.484799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8151476-e43c-4282-96d5-0d116772f045 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:46.502822 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f52c9-215c-41ae-b10a-271d40fa0ef0 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:46.504726 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b34f52c9-215c-41ae-b10a-271d40fa0ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:46.527705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1197/2380] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:46 2022] POST /identity/v3/users => generated 286 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:31:46.531835 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8151476-e43c-4282-96d5-0d116772f045 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:46.547332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8151476-e43c-4282-96d5-0d116772f045 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:46.558787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28855a-6800-49d8-bde7-4972b0675f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:46.559493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28855a-6800-49d8-bde7-4972b0675f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:46.563698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28855a-6800-49d8-bde7-4972b0675f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:46.564010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28855a-6800-49d8-bde7-4972b0675f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:46.566930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28855a-6800-49d8-bde7-4972b0675f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:46.572249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28855a-6800-49d8-bde7-4972b0675f77 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:46.597021 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1198/2381] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:46.597960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28855a-6800-49d8-bde7-4972b0675f77 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:46.617902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f52c9-215c-41ae-b10a-271d40fa0ef0 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:46.625984 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd05936-4c65-4028-ae64-402bf96029ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:46.626547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd05936-4c65-4028-ae64-402bf96029ea service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:46.626832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd05936-4c65-4028-ae64-402bf96029ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:46.627104 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd05936-4c65-4028-ae64-402bf96029ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:46.631969 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28855a-6800-49d8-bde7-4972b0675f77 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:46.638434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd05936-4c65-4028-ae64-402bf96029ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:46.639962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd05936-4c65-4028-ae64-402bf96029ea service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:46.644484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a2a72-bd6f-48d5-af98-c22e0391a479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:46.646027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a2a72-bd6f-48d5-af98-c22e0391a479 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:46.646565 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a2a72-bd6f-48d5-af98-c22e0391a479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:46.647033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a2a72-bd6f-48d5-af98-c22e0391a479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:46.648007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a2a72-bd6f-48d5-af98-c22e0391a479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:46.649731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a2a72-bd6f-48d5-af98-c22e0391a479 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:46.649853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1184/2382] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:46 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:31:46.673235 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1199/2383] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:46.677067 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd05936-4c65-4028-ae64-402bf96029ea service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:46.707164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd05936-4c65-4028-ae64-402bf96029ea service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:46.722591 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65344a8-03fe-4b0e-93a7-64724d6969e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:46.724372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65344a8-03fe-4b0e-93a7-64724d6969e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:46.725579 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65344a8-03fe-4b0e-93a7-64724d6969e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:46.726015 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65344a8-03fe-4b0e-93a7-64724d6969e5 admin admin] PATH_INFO: `/v3/projects/bf82b52aa10a4c9d9c99587d86fa13b5/users/16b252c81be54053b4fca113e4b9f58b/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:46.767727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65344a8-03fe-4b0e-93a7-64724d6969e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf82b52aa10a4c9d9c99587d86fa13b5, user_id=16b252c81be54053b4fca113e4b9f58b, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:46.772435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65344a8-03fe-4b0e-93a7-64724d6969e5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:46.811238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1185/2384] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:46 2022] PUT /identity/v3/projects/bf82b52aa10a4c9d9c99587d86fa13b5/users/16b252c81be54053b4fca113e4b9f58b/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:46.822976 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c73ff6-5c2a-4d87-9b85-cf714069f4c5 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:46.823807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c73ff6-5c2a-4d87-9b85-cf714069f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:46.824765 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c73ff6-5c2a-4d87-9b85-cf714069f4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:46.892907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b3c73ff6-5c2a-4d87-9b85-cf714069f4c5 None None] MFA Rules not processed for user `16b252c81be54053b4fca113e4b9f58b`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:46.900403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b3c73ff6-5c2a-4d87-9b85-cf714069f4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:47.066306 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1200/2385] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:47.071735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65344a8-03fe-4b0e-93a7-64724d6969e5 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:47.075537 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f65344a8-03fe-4b0e-93a7-64724d6969e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:47.259854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65344a8-03fe-4b0e-93a7-64724d6969e5 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:47.265489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a5c41-abb0-4133-aaa2-cff0fc31e746 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a57dc68aeb5482a86d5983b466d933d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:47.266344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5c41-abb0-4133-aaa2-cff0fc31e746 service glance] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:47.266795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5c41-abb0-4133-aaa2-cff0fc31e746 service glance] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:47.267174 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5c41-abb0-4133-aaa2-cff0fc31e746 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:47.294958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5c41-abb0-4133-aaa2-cff0fc31e746 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:47.299514 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5c41-abb0-4133-aaa2-cff0fc31e746 service glance] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:47.329134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1186/2386] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:49.979239 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c73ff6-5c2a-4d87-9b85-cf714069f4c5 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:49.981742 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b3c73ff6-5c2a-4d87-9b85-cf714069f4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:50.089276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c73ff6-5c2a-4d87-9b85-cf714069f4c5 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:50.095734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca19b6-7345-477a-9b8a-6478a6ce06da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:50.099208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca19b6-7345-477a-9b8a-6478a6ce06da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:50.099972 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca19b6-7345-477a-9b8a-6478a6ce06da admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:50.100403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca19b6-7345-477a-9b8a-6478a6ce06da admin admin] PATH_INFO: `/v3/users/b48cb724d0c44cf08288722b75f5f6df` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:50.102393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca19b6-7345-477a-9b8a-6478a6ce06da admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48cb724d0c44cf08288722b75f5f6df)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:50.105448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca19b6-7345-477a-9b8a-6478a6ce06da admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:50.123861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:50.189748 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cbca19b6-7345-477a-9b8a-6478a6ce06da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48cb724d0c44cf08288722b75f5f6df'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:50.190471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cbca19b6-7345-477a-9b8a-6478a6ce06da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48cb724d0c44cf08288722b75f5f6df'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:50.191144 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cbca19b6-7345-477a-9b8a-6478a6ce06da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48cb724d0c44cf08288722b75f5f6df'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:50.200254 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cbca19b6-7345-477a-9b8a-6478a6ce06da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48cb724d0c44cf08288722b75f5f6df'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:50.209708 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-cbca19b6-7345-477a-9b8a-6478a6ce06da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48cb724d0c44cf08288722b75f5f6df'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:50.229669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1201/2387] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:49 2022] DELETE /identity/v3/users/b48cb724d0c44cf08288722b75f5f6df => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:50.234628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b22221-5ae2-4e03-aef3-6a4aecb82d7b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:50.235222 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b22221-5ae2-4e03-aef3-6a4aecb82d7b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:50.235222 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b22221-5ae2-4e03-aef3-6a4aecb82d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:50.255216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-62b22221-5ae2-4e03-aef3-6a4aecb82d7b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:50.256509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-62b22221-5ae2-4e03-aef3-6a4aecb82d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:50.353768 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1187/2388] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:50.373397 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca19b6-7345-477a-9b8a-6478a6ce06da admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:50.375203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cbca19b6-7345-477a-9b8a-6478a6ce06da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:50.380116 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b22221-5ae2-4e03-aef3-6a4aecb82d7b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:50.381778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-62b22221-5ae2-4e03-aef3-6a4aecb82d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:50.392216 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:50.415461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca19b6-7345-477a-9b8a-6478a6ce06da admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:50.427661 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43111314-02de-4a18-a727-2912fcf1137d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:50.428971 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43111314-02de-4a18-a727-2912fcf1137d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:50.429355 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43111314-02de-4a18-a727-2912fcf1137d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:50.429733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43111314-02de-4a18-a727-2912fcf1137d admin admin] PATH_INFO: `/v3/users/7274cf6b89cc4e13ae2881c999388ff5` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:50.431800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43111314-02de-4a18-a727-2912fcf1137d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7274cf6b89cc4e13ae2881c999388ff5)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:50.435619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43111314-02de-4a18-a727-2912fcf1137d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:50.509500 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b22221-5ae2-4e03-aef3-6a4aecb82d7b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:50.517724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab233-0b85-4c38-bb1f-f864e3237c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:50.518553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab233-0b85-4c38-bb1f-f864e3237c91 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:50.518808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab233-0b85-4c38-bb1f-f864e3237c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:50.519097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab233-0b85-4c38-bb1f-f864e3237c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:50.556769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebab233-0b85-4c38-bb1f-f864e3237c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:50.558551 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebab233-0b85-4c38-bb1f-f864e3237c91 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:50.563913 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-43111314-02de-4a18-a727-2912fcf1137d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7274cf6b89cc4e13ae2881c999388ff5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:50.564674 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-43111314-02de-4a18-a727-2912fcf1137d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7274cf6b89cc4e13ae2881c999388ff5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:50.565417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-43111314-02de-4a18-a727-2912fcf1137d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7274cf6b89cc4e13ae2881c999388ff5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:50.583309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-43111314-02de-4a18-a727-2912fcf1137d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7274cf6b89cc4e13ae2881c999388ff5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:50.587286 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1188/2389] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:50.599147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-43111314-02de-4a18-a727-2912fcf1137d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7274cf6b89cc4e13ae2881c999388ff5'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:50.657504 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1202/2390] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:50 2022] DELETE /identity/v3/users/7274cf6b89cc4e13ae2881c999388ff5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:50.664397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd94f23-ca76-4a01-92cb-3d3bd2b68ba8 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:50.665511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd94f23-ca76-4a01-92cb-3d3bd2b68ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:50.666057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd94f23-ca76-4a01-92cb-3d3bd2b68ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:50.723143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-bbd94f23-ca76-4a01-92cb-3d3bd2b68ba8 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:50.723143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bbd94f23-ca76-4a01-92cb-3d3bd2b68ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:50.873638 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1189/2391] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:50.905729 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43111314-02de-4a18-a727-2912fcf1137d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:50.911998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-43111314-02de-4a18-a727-2912fcf1137d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:50.986656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43111314-02de-4a18-a727-2912fcf1137d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:50.991872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae0d61-5778-4e2b-88d8-b1d6aa76fff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:50.992477 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae0d61-5778-4e2b-88d8-b1d6aa76fff0 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:50.992956 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae0d61-5778-4e2b-88d8-b1d6aa76fff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:50.993232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae0d61-5778-4e2b-88d8-b1d6aa76fff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:51.004120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae0d61-5778-4e2b-88d8-b1d6aa76fff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:51.005593 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae0d61-5778-4e2b-88d8-b1d6aa76fff0 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:51.011271 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:51.018531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1203/2392] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:51.211470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd94f23-ca76-4a01-92cb-3d3bd2b68ba8 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:51.213356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bbd94f23-ca76-4a01-92cb-3d3bd2b68ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:51.241109 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd94f23-ca76-4a01-92cb-3d3bd2b68ba8 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:51.258908 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:51.261188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:51.263851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:51.264133 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01 admin admin] PATH_INFO: `/v3/projects/fc54361f98ed4cc5b475ba70f58647af` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:51.268164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc54361f98ed4cc5b475ba70f58647af)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:51.272070 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:51.362053 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc54361f98ed4cc5b475ba70f58647af', 'request_id': 'req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:51.377192 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc54361f98ed4cc5b475ba70f58647af', 'request_id': 'req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:51.392046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc54361f98ed4cc5b475ba70f58647af', 'request_id': 'req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:51.404439 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01 admin admin] The token cache is being invalidate because project fc54361f98ed4cc5b475ba70f58647af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:51.404727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:51.405364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:51.406985 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1190/2393] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:51 2022] DELETE /identity/v3/projects/fc54361f98ed4cc5b475ba70f58647af => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:51.412684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae0d61-5778-4e2b-88d8-b1d6aa76fff0 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:51.428658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae0d61-5778-4e2b-88d8-b1d6aa76fff0 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:51.470601 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:51.482883 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:51.512565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:51.530446 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3e011-cd2f-48b5-baba-ee7b95657a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:51.531052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3e011-cd2f-48b5-baba-ee7b95657a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:51.531342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3e011-cd2f-48b5-baba-ee7b95657a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:51.531643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3e011-cd2f-48b5-baba-ee7b95657a0b admin admin] PATH_INFO: `/v3/users/9856a5058213437982f49b50d98e2add` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:51.533414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3e011-cd2f-48b5-baba-ee7b95657a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9856a5058213437982f49b50d98e2add)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:51.535653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3e011-cd2f-48b5-baba-ee7b95657a0b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:51.551891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef6ae3-e617-4b25-91b1-8d4f3b6b1d01 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:51.556668 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae30f3-3d4c-441b-b0e2-135952f9ba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:51.557589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae30f3-3d4c-441b-b0e2-135952f9ba35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:51.557935 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae30f3-3d4c-441b-b0e2-135952f9ba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:51.558404 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae30f3-3d4c-441b-b0e2-135952f9ba35 admin admin] PATH_INFO: `/v3/projects/e7007711efb54d18931135d26348a900` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:51.559828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae30f3-3d4c-441b-b0e2-135952f9ba35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7007711efb54d18931135d26348a900)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:51.561845 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae30f3-3d4c-441b-b0e2-135952f9ba35 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:51.586292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2db3e011-cd2f-48b5-baba-ee7b95657a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9856a5058213437982f49b50d98e2add'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:51.586961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2db3e011-cd2f-48b5-baba-ee7b95657a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9856a5058213437982f49b50d98e2add'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:51.587570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2db3e011-cd2f-48b5-baba-ee7b95657a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9856a5058213437982f49b50d98e2add'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:51.595088 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2db3e011-cd2f-48b5-baba-ee7b95657a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9856a5058213437982f49b50d98e2add'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:51.606258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2db3e011-cd2f-48b5-baba-ee7b95657a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9856a5058213437982f49b50d98e2add'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:51.622618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80ae30f3-3d4c-441b-b0e2-135952f9ba35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7007711efb54d18931135d26348a900', 'request_id': 'req-80ae30f3-3d4c-441b-b0e2-135952f9ba35'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:51.631062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1204/2394] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:51 2022] DELETE /identity/v3/users/9856a5058213437982f49b50d98e2add => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:51.631565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80ae30f3-3d4c-441b-b0e2-135952f9ba35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7007711efb54d18931135d26348a900', 'request_id': 'req-80ae30f3-3d4c-441b-b0e2-135952f9ba35'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:51.643399 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80ae30f3-3d4c-441b-b0e2-135952f9ba35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7007711efb54d18931135d26348a900', 'request_id': 'req-80ae30f3-3d4c-441b-b0e2-135952f9ba35'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:51.656250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80ae30f3-3d4c-441b-b0e2-135952f9ba35 admin admin] The token cache is being invalidate because project e7007711efb54d18931135d26348a900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:51.656594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80ae30f3-3d4c-441b-b0e2-135952f9ba35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:51.657832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80ae30f3-3d4c-441b-b0e2-135952f9ba35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:51.659933 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1191/2395] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:51 2022] DELETE /identity/v3/projects/e7007711efb54d18931135d26348a900 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:51.664728 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4dd54-981b-4dc3-a115-c7404a59d6f2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:51.665022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4dd54-981b-4dc3-a115-c7404a59d6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:51.665304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4dd54-981b-4dc3-a115-c7404a59d6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:51.684252 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5ee4dd54-981b-4dc3-a115-c7404a59d6f2 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:51.685436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5ee4dd54-981b-4dc3-a115-c7404a59d6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:51.801517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1205/2396] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:51.801711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbdecb-b2e9-4a45-b19a-a61df2703a46 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:51.801711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbdecb-b2e9-4a45-b19a-a61df2703a46 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:51.801711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbdecb-b2e9-4a45-b19a-a61df2703a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:51.824065 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-82bbdecb-b2e9-4a45-b19a-a61df2703a46 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:51.825426 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-82bbdecb-b2e9-4a45-b19a-a61df2703a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:51.842739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1192/2397] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:51.845918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4dd54-981b-4dc3-a115-c7404a59d6f2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:51.874381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4dd54-981b-4dc3-a115-c7404a59d6f2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:51.886618 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072588f-aaf3-4bf1-af03-4f4e0e65ee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:51.889726 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072588f-aaf3-4bf1-af03-4f4e0e65ee52 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:51.890198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072588f-aaf3-4bf1-af03-4f4e0e65ee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:51.893357 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072588f-aaf3-4bf1-af03-4f4e0e65ee52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:51.894625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072588f-aaf3-4bf1-af03-4f4e0e65ee52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:51.895379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072588f-aaf3-4bf1-af03-4f4e0e65ee52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:51.902379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072588f-aaf3-4bf1-af03-4f4e0e65ee52 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:51.935075 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1206/2398] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:51.939660 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbdecb-b2e9-4a45-b19a-a61df2703a46 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:51.956117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbdecb-b2e9-4a45-b19a-a61df2703a46 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:51.982103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405a48d-ed07-4cf6-b33f-8b87562d5374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:51.983982 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405a48d-ed07-4cf6-b33f-8b87562d5374 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:51.984371 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405a48d-ed07-4cf6-b33f-8b87562d5374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:51.984752 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405a48d-ed07-4cf6-b33f-8b87562d5374 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:51.985689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405a48d-ed07-4cf6-b33f-8b87562d5374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:51.987934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405a48d-ed07-4cf6-b33f-8b87562d5374 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:52.032990 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1193/2399] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:51 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:52.037101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072588f-aaf3-4bf1-af03-4f4e0e65ee52 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:52.049273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072588f-aaf3-4bf1-af03-4f4e0e65ee52 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:52.063885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:52.165313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597abef-7dab-4fd1-9ae3-8a12391a3961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:52.166224 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597abef-7dab-4fd1-9ae3-8a12391a3961 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:52.166729 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597abef-7dab-4fd1-9ae3-8a12391a3961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:52.167276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597abef-7dab-4fd1-9ae3-8a12391a3961 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:52.168490 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597abef-7dab-4fd1-9ae3-8a12391a3961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:52.172789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597abef-7dab-4fd1-9ae3-8a12391a3961 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:52.202543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1207/2400] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:52 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:52.206854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405a48d-ed07-4cf6-b33f-8b87562d5374 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:52.221168 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405a48d-ed07-4cf6-b33f-8b87562d5374 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:52.226057 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b267ee1-682b-4096-aed7-37d2af461056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:52.227175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b267ee1-682b-4096-aed7-37d2af461056 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:52.227175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b267ee1-682b-4096-aed7-37d2af461056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:52.227354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b267ee1-682b-4096-aed7-37d2af461056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:52.228192 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b267ee1-682b-4096-aed7-37d2af461056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:52.230784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b267ee1-682b-4096-aed7-37d2af461056 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:52.245933 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1194/2401] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:31:52.250057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597abef-7dab-4fd1-9ae3-8a12391a3961 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:52.266224 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597abef-7dab-4fd1-9ae3-8a12391a3961 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:52.272143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99273adb-71dc-4f21-8b7e-7f448050ea01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:52.273155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99273adb-71dc-4f21-8b7e-7f448050ea01 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:52.273953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99273adb-71dc-4f21-8b7e-7f448050ea01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:52.274333 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99273adb-71dc-4f21-8b7e-7f448050ea01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:52.275450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99273adb-71dc-4f21-8b7e-7f448050ea01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:52.278465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99273adb-71dc-4f21-8b7e-7f448050ea01 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:52.299320 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1208/2402] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:52.301067 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b267ee1-682b-4096-aed7-37d2af461056 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:52.314189 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b267ee1-682b-4096-aed7-37d2af461056 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:52.331780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838aa3ac-b56d-4fd7-8ac4-d32f50240af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:52.332320 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838aa3ac-b56d-4fd7-8ac4-d32f50240af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:52.332677 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838aa3ac-b56d-4fd7-8ac4-d32f50240af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:52.333028 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838aa3ac-b56d-4fd7-8ac4-d32f50240af9 admin admin] PATH_INFO: `/v3/projects/19de153409e64f6189f412063bef3bd4/users/2e0d7fe99e344a44a23bc9653e8e51bf/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:52.367235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838aa3ac-b56d-4fd7-8ac4-d32f50240af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19de153409e64f6189f412063bef3bd4, user_id=2e0d7fe99e344a44a23bc9653e8e51bf, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:52.370154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838aa3ac-b56d-4fd7-8ac4-d32f50240af9 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:52.407501 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1195/2403] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:52 2022] PUT /identity/v3/projects/19de153409e64f6189f412063bef3bd4/users/2e0d7fe99e344a44a23bc9653e8e51bf/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:52.421308 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d4dc-1745-45b1-9b37-a1593f2d70d0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:52.421649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d4dc-1745-45b1-9b37-a1593f2d70d0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:52.421934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d4dc-1745-45b1-9b37-a1593f2d70d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:52.470557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9019d4dc-1745-45b1-9b37-a1593f2d70d0 None None] MFA Rules not processed for user `2e0d7fe99e344a44a23bc9653e8e51bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:52.472138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9019d4dc-1745-45b1-9b37-a1593f2d70d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:52.565796 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838aa3ac-b56d-4fd7-8ac4-d32f50240af9 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:52.567651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-838aa3ac-b56d-4fd7-8ac4-d32f50240af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:52.667958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1209/2404] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:52.679734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019d4dc-1745-45b1-9b37-a1593f2d70d0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:52.681529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9019d4dc-1745-45b1-9b37-a1593f2d70d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:52.723448 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:52.734613 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838aa3ac-b56d-4fd7-8ac4-d32f50240af9 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:52.751647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:52.752839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:52.753129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:52.753409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f admin admin] PATH_INFO: `/v3/projects/fd06159c983d4c52a599d5c1e55bb266` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:52.757444 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd06159c983d4c52a599d5c1e55bb266)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:52.759418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:52.785852 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019d4dc-1745-45b1-9b37-a1593f2d70d0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:52.796801 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f264503-6657-4755-a458-e9d53ad140a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:52.797496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f264503-6657-4755-a458-e9d53ad140a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:52.797782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f264503-6657-4755-a458-e9d53ad140a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:52.798061 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f264503-6657-4755-a458-e9d53ad140a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:52.809587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f264503-6657-4755-a458-e9d53ad140a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:52.811213 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f264503-6657-4755-a458-e9d53ad140a6 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:52.824029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1210/2405] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:52.861075 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd06159c983d4c52a599d5c1e55bb266', 'request_id': 'req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:52.869380 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd06159c983d4c52a599d5c1e55bb266', 'request_id': 'req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:52.881590 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd06159c983d4c52a599d5c1e55bb266', 'request_id': 'req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:52.899112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f admin admin] The token cache is being invalidate because project fd06159c983d4c52a599d5c1e55bb266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:52.899403 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:52.900491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:52.904658 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1196/2406] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:52 2022] DELETE /identity/v3/projects/fd06159c983d4c52a599d5c1e55bb266 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:52.914832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f264503-6657-4755-a458-e9d53ad140a6 service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:52.933625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f264503-6657-4755-a458-e9d53ad140a6 service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:52.950578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:53.074987 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f4546-a07b-4514-b68d-ab39795f0745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:53.078818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f4546-a07b-4514-b68d-ab39795f0745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:53.080011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f4546-a07b-4514-b68d-ab39795f0745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:53.080371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f4546-a07b-4514-b68d-ab39795f0745 admin admin] PATH_INFO: `/v3/users/a87d8ce737f0462bab23ca6a85ccd237` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:53.090753 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f4546-a07b-4514-b68d-ab39795f0745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a87d8ce737f0462bab23ca6a85ccd237)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:53.100456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f4546-a07b-4514-b68d-ab39795f0745 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:53.188226 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0d4f4546-a07b-4514-b68d-ab39795f0745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a87d8ce737f0462bab23ca6a85ccd237'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:53.189257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0d4f4546-a07b-4514-b68d-ab39795f0745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a87d8ce737f0462bab23ca6a85ccd237'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:53.190332 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0d4f4546-a07b-4514-b68d-ab39795f0745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a87d8ce737f0462bab23ca6a85ccd237'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:53.214062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0d4f4546-a07b-4514-b68d-ab39795f0745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a87d8ce737f0462bab23ca6a85ccd237'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:53.226002 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-0d4f4546-a07b-4514-b68d-ab39795f0745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a87d8ce737f0462bab23ca6a85ccd237'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:53.292462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1211/2407] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:52 2022] DELETE /identity/v3/users/a87d8ce737f0462bab23ca6a85ccd237 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:53.705841 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:53.707977 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:53.723736 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d62a4b-47ae-41f6-a7b3-7b37ea46641f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:53.826590 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec536a68-5853-418c-9407-52084bc8e79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:53.827509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec536a68-5853-418c-9407-52084bc8e79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:53.827882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec536a68-5853-418c-9407-52084bc8e79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:53.828102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec536a68-5853-418c-9407-52084bc8e79d admin admin] PATH_INFO: `/v3/projects/970ca3ed85c94b53a75e61647b1a9715` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:53.829361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec536a68-5853-418c-9407-52084bc8e79d admin admin] RBAC: Authorizing `identity:delete_project(project_id=970ca3ed85c94b53a75e61647b1a9715)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:53.831589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec536a68-5853-418c-9407-52084bc8e79d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:53.915968 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ec536a68-5853-418c-9407-52084bc8e79d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970ca3ed85c94b53a75e61647b1a9715', 'request_id': 'req-ec536a68-5853-418c-9407-52084bc8e79d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:53.926544 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ec536a68-5853-418c-9407-52084bc8e79d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970ca3ed85c94b53a75e61647b1a9715', 'request_id': 'req-ec536a68-5853-418c-9407-52084bc8e79d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:53.942303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ec536a68-5853-418c-9407-52084bc8e79d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970ca3ed85c94b53a75e61647b1a9715', 'request_id': 'req-ec536a68-5853-418c-9407-52084bc8e79d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:53.971038 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ec536a68-5853-418c-9407-52084bc8e79d admin admin] The token cache is being invalidate because project 970ca3ed85c94b53a75e61647b1a9715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:53.971338 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ec536a68-5853-418c-9407-52084bc8e79d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:53.972097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ec536a68-5853-418c-9407-52084bc8e79d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:53.974809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1197/2408] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:53 2022] DELETE /identity/v3/projects/970ca3ed85c94b53a75e61647b1a9715 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:53.980467 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c7ba9-acba-46b4-9d5f-8db357217c13 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:53.980918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c7ba9-acba-46b4-9d5f-8db357217c13 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:53.981388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c7ba9-acba-46b4-9d5f-8db357217c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:54.006257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-816c7ba9-acba-46b4-9d5f-8db357217c13 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:54.007855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-816c7ba9-acba-46b4-9d5f-8db357217c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:54.082712 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1212/2409] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:54.090592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8476e5d-ca41-4812-943b-a1e1ea4ae93d None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:54.090893 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8476e5d-ca41-4812-943b-a1e1ea4ae93d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:54.091176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8476e5d-ca41-4812-943b-a1e1ea4ae93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:54.114418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-b8476e5d-ca41-4812-943b-a1e1ea4ae93d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:54.116062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b8476e5d-ca41-4812-943b-a1e1ea4ae93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:54.124549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1198/2410] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:54.129654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c7ba9-acba-46b4-9d5f-8db357217c13 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:54.140186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c7ba9-acba-46b4-9d5f-8db357217c13 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:54.152099 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0cab5-5b7c-428d-a246-40368774128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:54.153021 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cab5-5b7c-428d-a246-40368774128d admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:54.153312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cab5-5b7c-428d-a246-40368774128d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:54.153591 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cab5-5b7c-428d-a246-40368774128d admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:54.154350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0cab5-5b7c-428d-a246-40368774128d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:54.154715 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0cab5-5b7c-428d-a246-40368774128d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:54.157016 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0cab5-5b7c-428d-a246-40368774128d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:54.169609 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1213/2411] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:31:54.174177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8476e5d-ca41-4812-943b-a1e1ea4ae93d None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:54.184048 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8476e5d-ca41-4812-943b-a1e1ea4ae93d None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:54.194214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51222dcb-4091-4870-a8af-5b9343f6e886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:54.196090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51222dcb-4091-4870-a8af-5b9343f6e886 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:54.196090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51222dcb-4091-4870-a8af-5b9343f6e886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:54.196090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51222dcb-4091-4870-a8af-5b9343f6e886 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:54.196359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51222dcb-4091-4870-a8af-5b9343f6e886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:54.198144 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51222dcb-4091-4870-a8af-5b9343f6e886 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:54.203126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:54.234454 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1199/2412] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:54 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:54.238347 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0cab5-5b7c-428d-a246-40368774128d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:54.249856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0cab5-5b7c-428d-a246-40368774128d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:54.272761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:54.316395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d261a-2312-4f47-a1d2-2f609051a7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:54.317084 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d261a-2312-4f47-a1d2-2f609051a7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:54.317368 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d261a-2312-4f47-a1d2-2f609051a7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:54.317645 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d261a-2312-4f47-a1d2-2f609051a7b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:54.318363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d261a-2312-4f47-a1d2-2f609051a7b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:54.320463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d261a-2312-4f47-a1d2-2f609051a7b2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:54.341176 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1214/2413] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:54 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:54.345780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51222dcb-4091-4870-a8af-5b9343f6e886 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:54.356914 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51222dcb-4091-4870-a8af-5b9343f6e886 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:54.362033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0adc1-b4bb-498c-8fc4-6cecf09bd7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:54.362748 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0adc1-b4bb-498c-8fc4-6cecf09bd7ec admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:54.363037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0adc1-b4bb-498c-8fc4-6cecf09bd7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:54.363316 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0adc1-b4bb-498c-8fc4-6cecf09bd7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:54.364117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0adc1-b4bb-498c-8fc4-6cecf09bd7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:54.366190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0adc1-b4bb-498c-8fc4-6cecf09bd7ec admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:54.379631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1200/2414] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:54.384071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d261a-2312-4f47-a1d2-2f609051a7b2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:54.395422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d261a-2312-4f47-a1d2-2f609051a7b2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:54.406656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4f1d9-39ae-4fdb-b353-9249f3afb8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:54.407364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4f1d9-39ae-4fdb-b353-9249f3afb8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:54.407640 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4f1d9-39ae-4fdb-b353-9249f3afb8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:54.407925 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4f1d9-39ae-4fdb-b353-9249f3afb8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:54.408683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4f1d9-39ae-4fdb-b353-9249f3afb8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:54.422129 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4f1d9-39ae-4fdb-b353-9249f3afb8ed admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:54.444054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1215/2415] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:54.448140 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0adc1-b4bb-498c-8fc4-6cecf09bd7ec admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:54.465414 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0adc1-b4bb-498c-8fc4-6cecf09bd7ec admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:54.481582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f2599-860b-4542-b7e2-70d9cb1338e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:54.482494 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f2599-860b-4542-b7e2-70d9cb1338e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:54.482784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f2599-860b-4542-b7e2-70d9cb1338e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:54.483049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f2599-860b-4542-b7e2-70d9cb1338e7 admin admin] PATH_INFO: `/v3/projects/b1018acd67534b9d8ebd4725e9228c92/users/50a5ac8297ee4e3ca04ba29cc25263c3/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:54.523307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f2599-860b-4542-b7e2-70d9cb1338e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1018acd67534b9d8ebd4725e9228c92, user_id=50a5ac8297ee4e3ca04ba29cc25263c3, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:54.523307 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f2599-860b-4542-b7e2-70d9cb1338e7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:54.558039 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1201/2416] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:54 2022] PUT /identity/v3/projects/b1018acd67534b9d8ebd4725e9228c92/users/50a5ac8297ee4e3ca04ba29cc25263c3/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:54.562929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07017104-a738-451a-9112-f6bb687afc2d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:54.563203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07017104-a738-451a-9112-f6bb687afc2d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:54.563484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07017104-a738-451a-9112-f6bb687afc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:54.622631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-07017104-a738-451a-9112-f6bb687afc2d None None] MFA Rules not processed for user `50a5ac8297ee4e3ca04ba29cc25263c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:54.624030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-07017104-a738-451a-9112-f6bb687afc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:54.725565 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1216/2417] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:31:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:54.735357 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f2599-860b-4542-b7e2-70d9cb1338e7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:54.737461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ea3f2599-860b-4542-b7e2-70d9cb1338e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:54.840081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f2599-860b-4542-b7e2-70d9cb1338e7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:54.849652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8690cd-8976-4844-ae86-f89cb348d932 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a57dc68aeb5482a86d5983b466d933d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:54.850618 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8690cd-8976-4844-ae86-f89cb348d932 service glance] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:54.851350 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8690cd-8976-4844-ae86-f89cb348d932 service glance] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:54.852110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8690cd-8976-4844-ae86-f89cb348d932 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:54.870691 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8690cd-8976-4844-ae86-f89cb348d932 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:54.874143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8690cd-8976-4844-ae86-f89cb348d932 service glance] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:54.899123 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1202/2418] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:32:01.834419 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07017104-a738-451a-9112-f6bb687afc2d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:01.836612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-07017104-a738-451a-9112-f6bb687afc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:01.900590 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07017104-a738-451a-9112-f6bb687afc2d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:01.904267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b72224-8c32-40f0-8157-0b47d443c4ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:01.904898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b72224-8c32-40f0-8157-0b47d443c4ba service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:01.905214 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b72224-8c32-40f0-8157-0b47d443c4ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:01.905489 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b72224-8c32-40f0-8157-0b47d443c4ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:01.907329 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b3b72224-8c32-40f0-8157-0b47d443c4ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:01.954061 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:01.976550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b72224-8c32-40f0-8157-0b47d443c4ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:01.978107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b72224-8c32-40f0-8157-0b47d443c4ba service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:01.988871 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1217/2419] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:02.114691 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd3bc3-a223-483d-af72-413390524bc3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:02.115560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd3bc3-a223-483d-af72-413390524bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:02.115560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd3bc3-a223-483d-af72-413390524bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:02.139583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-89fd3bc3-a223-483d-af72-413390524bc3 None None] MFA Rules not processed for user `e870ec5ae9eb43b6bc650d730f778d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:02.140724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-89fd3bc3-a223-483d-af72-413390524bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:02.198706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1203/2420] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:06.426963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b72224-8c32-40f0-8157-0b47d443c4ba service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:06.431090 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b3b72224-8c32-40f0-8157-0b47d443c4ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:06.606303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b72224-8c32-40f0-8157-0b47d443c4ba service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:06.617465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4223c6-b4e1-4a81-a6ad-1d52c0fa3c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:06.618404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4223c6-b4e1-4a81-a6ad-1d52c0fa3c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:06.618984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4223c6-b4e1-4a81-a6ad-1d52c0fa3c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:06.619282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4223c6-b4e1-4a81-a6ad-1d52c0fa3c04 admin admin] PATH_INFO: `/v3/users/2e0d7fe99e344a44a23bc9653e8e51bf` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:06.631363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4223c6-b4e1-4a81-a6ad-1d52c0fa3c04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e0d7fe99e344a44a23bc9653e8e51bf)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:06.638562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4223c6-b4e1-4a81-a6ad-1d52c0fa3c04 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:06.713937 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fd4223c6-b4e1-4a81-a6ad-1d52c0fa3c04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e0d7fe99e344a44a23bc9653e8e51bf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:06.714304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fd4223c6-b4e1-4a81-a6ad-1d52c0fa3c04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e0d7fe99e344a44a23bc9653e8e51bf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:06.715738 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fd4223c6-b4e1-4a81-a6ad-1d52c0fa3c04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e0d7fe99e344a44a23bc9653e8e51bf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:06.727672 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fd4223c6-b4e1-4a81-a6ad-1d52c0fa3c04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e0d7fe99e344a44a23bc9653e8e51bf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:06.742363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-fd4223c6-b4e1-4a81-a6ad-1d52c0fa3c04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e0d7fe99e344a44a23bc9653e8e51bf'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:06.770042 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1218/2421] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:06 2022] DELETE /identity/v3/users/2e0d7fe99e344a44a23bc9653e8e51bf => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:06.774572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098456b9-f1a0-4175-9881-816cec490a6c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:06.775110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098456b9-f1a0-4175-9881-816cec490a6c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:06.775204 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098456b9-f1a0-4175-9881-816cec490a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:06.797218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-098456b9-f1a0-4175-9881-816cec490a6c None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:06.798649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-098456b9-f1a0-4175-9881-816cec490a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:06.870683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:06.887210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1204/2422] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:06.893941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4223c6-b4e1-4a81-a6ad-1d52c0fa3c04 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:06.895902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fd4223c6-b4e1-4a81-a6ad-1d52c0fa3c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:06.966822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4223c6-b4e1-4a81-a6ad-1d52c0fa3c04 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:06.974011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12247011-7de7-4439-b9b0-25bb31c84d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:06.974011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12247011-7de7-4439-b9b0-25bb31c84d2b service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:06.974199 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12247011-7de7-4439-b9b0-25bb31c84d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:06.974607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12247011-7de7-4439-b9b0-25bb31c84d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:06.987567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12247011-7de7-4439-b9b0-25bb31c84d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:06.989084 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12247011-7de7-4439-b9b0-25bb31c84d2b service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:07.000527 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1219/2423] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:32:07.445095 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098456b9-f1a0-4175-9881-816cec490a6c None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:07.457488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-098456b9-f1a0-4175-9881-816cec490a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:07.494198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098456b9-f1a0-4175-9881-816cec490a6c None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:07.503711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a89be-46d7-4b20-86fa-1f508367b278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:07.515506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a89be-46d7-4b20-86fa-1f508367b278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:07.515844 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a89be-46d7-4b20-86fa-1f508367b278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:07.516133 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a89be-46d7-4b20-86fa-1f508367b278 admin admin] PATH_INFO: `/v3/projects/19de153409e64f6189f412063bef3bd4` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:07.534559 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a89be-46d7-4b20-86fa-1f508367b278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19de153409e64f6189f412063bef3bd4)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:07.541907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a89be-46d7-4b20-86fa-1f508367b278 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:07.650573 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7d1a89be-46d7-4b20-86fa-1f508367b278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19de153409e64f6189f412063bef3bd4', 'request_id': 'req-7d1a89be-46d7-4b20-86fa-1f508367b278'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:07.685553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7d1a89be-46d7-4b20-86fa-1f508367b278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19de153409e64f6189f412063bef3bd4', 'request_id': 'req-7d1a89be-46d7-4b20-86fa-1f508367b278'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:07.699227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7d1a89be-46d7-4b20-86fa-1f508367b278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19de153409e64f6189f412063bef3bd4', 'request_id': 'req-7d1a89be-46d7-4b20-86fa-1f508367b278'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:07.717580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7d1a89be-46d7-4b20-86fa-1f508367b278 admin admin] The token cache is being invalidate because project 19de153409e64f6189f412063bef3bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:07.718179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7d1a89be-46d7-4b20-86fa-1f508367b278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:07.719104 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-7d1a89be-46d7-4b20-86fa-1f508367b278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:07.720978 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1205/2424] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:07 2022] DELETE /identity/v3/projects/19de153409e64f6189f412063bef3bd4 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:07.726938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e366d-2b6d-4677-9125-2f03b252a39b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:07.727830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e366d-2b6d-4677-9125-2f03b252a39b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:07.728324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e366d-2b6d-4677-9125-2f03b252a39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:07.737889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:07.767958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-260e366d-2b6d-4677-9125-2f03b252a39b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:07.770355 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-260e366d-2b6d-4677-9125-2f03b252a39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:07.845027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1220/2425] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:07.854661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110caba-ab09-4822-8293-aa30b33d6b25 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:07.855223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110caba-ab09-4822-8293-aa30b33d6b25 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:07.855223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110caba-ab09-4822-8293-aa30b33d6b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:07.878009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1110caba-ab09-4822-8293-aa30b33d6b25 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:07.880025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1110caba-ab09-4822-8293-aa30b33d6b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:07.889831 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1206/2426] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:07.894755 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e366d-2b6d-4677-9125-2f03b252a39b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:07.906588 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e366d-2b6d-4677-9125-2f03b252a39b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:07.915107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979b64e-982a-46a2-9e09-ca34d634e917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:07.916099 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979b64e-982a-46a2-9e09-ca34d634e917 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:07.916534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979b64e-982a-46a2-9e09-ca34d634e917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:07.916824 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979b64e-982a-46a2-9e09-ca34d634e917 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:07.917647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979b64e-982a-46a2-9e09-ca34d634e917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:32:07.918011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979b64e-982a-46a2-9e09-ca34d634e917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:07.919758 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979b64e-982a-46a2-9e09-ca34d634e917 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:07.935231 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1221/2427] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:32:07.940772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110caba-ab09-4822-8293-aa30b33d6b25 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:07.951378 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110caba-ab09-4822-8293-aa30b33d6b25 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:07.956496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e5903-44c9-4481-9b3a-51685539f0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:07.957287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5903-44c9-4481-9b3a-51685539f0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:07.957571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5903-44c9-4481-9b3a-51685539f0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:07.957955 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5903-44c9-4481-9b3a-51685539f0e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:07.958663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e5903-44c9-4481-9b3a-51685539f0e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:07.960859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e5903-44c9-4481-9b3a-51685539f0e5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:07.993508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1207/2428] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:07 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:32:07.997551 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979b64e-982a-46a2-9e09-ca34d634e917 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:08.011196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979b64e-982a-46a2-9e09-ca34d634e917 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:08.078861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83ad7e-192b-4945-8efe-64955bafdc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:08.079555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83ad7e-192b-4945-8efe-64955bafdc35 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:08.079840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83ad7e-192b-4945-8efe-64955bafdc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:08.080205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83ad7e-192b-4945-8efe-64955bafdc35 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:08.080923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83ad7e-192b-4945-8efe-64955bafdc35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:08.083580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83ad7e-192b-4945-8efe-64955bafdc35 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:08.106669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1222/2429] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:07 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:32:08.110823 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e5903-44c9-4481-9b3a-51685539f0e5 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:08.121934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e5903-44c9-4481-9b3a-51685539f0e5 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:08.127584 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c4821-f554-42a2-95ff-e2ea83c0d693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:08.128293 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c4821-f554-42a2-95ff-e2ea83c0d693 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:08.128572 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c4821-f554-42a2-95ff-e2ea83c0d693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:08.128852 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c4821-f554-42a2-95ff-e2ea83c0d693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:08.129667 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c4821-f554-42a2-95ff-e2ea83c0d693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:08.131297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c4821-f554-42a2-95ff-e2ea83c0d693 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:08.142771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1208/2430] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:08.147544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83ad7e-192b-4945-8efe-64955bafdc35 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:08.162116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83ad7e-192b-4945-8efe-64955bafdc35 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:08.168351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a58ba2-69b6-4b65-a865-dad8a2bca4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:08.169041 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a58ba2-69b6-4b65-a865-dad8a2bca4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:08.169301 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a58ba2-69b6-4b65-a865-dad8a2bca4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:08.169605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a58ba2-69b6-4b65-a865-dad8a2bca4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:08.170457 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a58ba2-69b6-4b65-a865-dad8a2bca4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:08.173098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a58ba2-69b6-4b65-a865-dad8a2bca4e0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:08.184694 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1223/2431] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:08.188919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c4821-f554-42a2-95ff-e2ea83c0d693 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:08.199071 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c4821-f554-42a2-95ff-e2ea83c0d693 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:08.203622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a4226-f6b5-4d35-bad2-108f5e8206bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:08.204515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a4226-f6b5-4d35-bad2-108f5e8206bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:08.204798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a4226-f6b5-4d35-bad2-108f5e8206bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:08.205148 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a4226-f6b5-4d35-bad2-108f5e8206bd admin admin] PATH_INFO: `/v3/projects/cd7baf98bd5f42f3b5de024c02637ef4/users/a983a48f47be4db48a7046f89443ac6c/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:08.220531 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a4226-f6b5-4d35-bad2-108f5e8206bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7baf98bd5f42f3b5de024c02637ef4, user_id=a983a48f47be4db48a7046f89443ac6c, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:08.223474 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a4226-f6b5-4d35-bad2-108f5e8206bd admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:08.240108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1209/2432] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:08 2022] PUT /identity/v3/projects/cd7baf98bd5f42f3b5de024c02637ef4/users/a983a48f47be4db48a7046f89443ac6c/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:08.251357 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f60778-3a48-4dca-98d5-806aa539f6d5 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:08.251626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f60778-3a48-4dca-98d5-806aa539f6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:08.253456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f60778-3a48-4dca-98d5-806aa539f6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:08.282616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-20f60778-3a48-4dca-98d5-806aa539f6d5 None None] MFA Rules not processed for user `a983a48f47be4db48a7046f89443ac6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:08.284331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-20f60778-3a48-4dca-98d5-806aa539f6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:08.353865 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:08.359195 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1224/2433] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:08.372866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a4226-f6b5-4d35-bad2-108f5e8206bd admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:08.375885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9d9a4226-f6b5-4d35-bad2-108f5e8206bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:08.457533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a4226-f6b5-4d35-bad2-108f5e8206bd admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:08.461520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b7048-9f96-421f-8412-b9b50e9f14de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:08.462202 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7048-9f96-421f-8412-b9b50e9f14de service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:08.462490 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7048-9f96-421f-8412-b9b50e9f14de service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:08.462736 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7048-9f96-421f-8412-b9b50e9f14de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:08.476821 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b7048-9f96-421f-8412-b9b50e9f14de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:08.478821 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b7048-9f96-421f-8412-b9b50e9f14de service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:08.489236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1210/2434] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:18.484353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:19.247617 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f60778-3a48-4dca-98d5-806aa539f6d5 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:19.324121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f60778-3a48-4dca-98d5-806aa539f6d5 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:19.329696 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3b82d-8810-4796-8013-4e3fbe9b0dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:19.330866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b82d-8810-4796-8013-4e3fbe9b0dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:19.331146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b82d-8810-4796-8013-4e3fbe9b0dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:19.331423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b82d-8810-4796-8013-4e3fbe9b0dc3 admin admin] PATH_INFO: `/v3/users/a983a48f47be4db48a7046f89443ac6c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:19.334108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3b82d-8810-4796-8013-4e3fbe9b0dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a983a48f47be4db48a7046f89443ac6c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:19.336142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3b82d-8810-4796-8013-4e3fbe9b0dc3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:19.398274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e4c3b82d-8810-4796-8013-4e3fbe9b0dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a983a48f47be4db48a7046f89443ac6c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:19.399014 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e4c3b82d-8810-4796-8013-4e3fbe9b0dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a983a48f47be4db48a7046f89443ac6c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:19.399731 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e4c3b82d-8810-4796-8013-4e3fbe9b0dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a983a48f47be4db48a7046f89443ac6c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:19.406819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e4c3b82d-8810-4796-8013-4e3fbe9b0dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a983a48f47be4db48a7046f89443ac6c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:19.416212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e4c3b82d-8810-4796-8013-4e3fbe9b0dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a983a48f47be4db48a7046f89443ac6c'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:19.439703 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b7048-9f96-421f-8412-b9b50e9f14de service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:19.442168 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f04b7048-9f96-421f-8412-b9b50e9f14de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:19.450404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1225/2435] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:19 2022] DELETE /identity/v3/users/a983a48f47be4db48a7046f89443ac6c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:19.450404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70230aaa-33cf-4f63-a9d8-02df9749c63a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:19.450404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70230aaa-33cf-4f63-a9d8-02df9749c63a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:19.450404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70230aaa-33cf-4f63-a9d8-02df9749c63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:19.463953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b7048-9f96-421f-8412-b9b50e9f14de service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:19.472021 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-70230aaa-33cf-4f63-a9d8-02df9749c63a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:19.473314 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-70230aaa-33cf-4f63-a9d8-02df9749c63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:19.539023 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1226/2436] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:32:19.545058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dcf91-e192-447e-b4e7-50611cd72f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:19.546583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dcf91-e192-447e-b4e7-50611cd72f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:19.546866 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dcf91-e192-447e-b4e7-50611cd72f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:19.547138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dcf91-e192-447e-b4e7-50611cd72f7d admin admin] PATH_INFO: `/v3/users/16b252c81be54053b4fca113e4b9f58b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:19.552498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dcf91-e192-447e-b4e7-50611cd72f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=16b252c81be54053b4fca113e4b9f58b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:19.554658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70230aaa-33cf-4f63-a9d8-02df9749c63a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:19.554849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dcf91-e192-447e-b4e7-50611cd72f7d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:19.556106 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-70230aaa-33cf-4f63-a9d8-02df9749c63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:19.582646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:19.618201 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-027dcf91-e192-447e-b4e7-50611cd72f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16b252c81be54053b4fca113e4b9f58b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:19.633776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-027dcf91-e192-447e-b4e7-50611cd72f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16b252c81be54053b4fca113e4b9f58b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:19.634661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-027dcf91-e192-447e-b4e7-50611cd72f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16b252c81be54053b4fca113e4b9f58b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:19.635291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-027dcf91-e192-447e-b4e7-50611cd72f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16b252c81be54053b4fca113e4b9f58b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:19.636432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70230aaa-33cf-4f63-a9d8-02df9749c63a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:19.640331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6e2c6-d054-472f-8c66-a500e238d108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:19.641162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6e2c6-d054-472f-8c66-a500e238d108 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:19.641401 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6e2c6-d054-472f-8c66-a500e238d108 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:19.641733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6e2c6-d054-472f-8c66-a500e238d108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:19.643883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f3d6e2c6-d054-472f-8c66-a500e238d108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:19.645479 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-027dcf91-e192-447e-b4e7-50611cd72f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16b252c81be54053b4fca113e4b9f58b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:19.657881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6e2c6-d054-472f-8c66-a500e238d108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:19.659550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6e2c6-d054-472f-8c66-a500e238d108 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:19.664013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1211/2437] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:19 2022] DELETE /identity/v3/users/16b252c81be54053b4fca113e4b9f58b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:19.668545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b12401-f371-466a-8428-6acd82d744ed None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:19.668997 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b12401-f371-466a-8428-6acd82d744ed None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:19.669505 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b12401-f371-466a-8428-6acd82d744ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:19.674035 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1227/2438] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:19.688222 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-33b12401-f371-466a-8428-6acd82d744ed None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:19.689523 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-33b12401-f371-466a-8428-6acd82d744ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:19.762859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1212/2439] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:19.772416 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6e2c6-d054-472f-8c66-a500e238d108 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:19.774985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f3d6e2c6-d054-472f-8c66-a500e238d108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:19.788663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6e2c6-d054-472f-8c66-a500e238d108 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:19.866516 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6e4cf-6c6e-4061-b192-c8e5e41edf81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:19.867779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e4cf-6c6e-4061-b192-c8e5e41edf81 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:19.868063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e4cf-6c6e-4061-b192-c8e5e41edf81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:19.868338 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e4cf-6c6e-4061-b192-c8e5e41edf81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:19.881897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6e4cf-6c6e-4061-b192-c8e5e41edf81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:19.883861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6e4cf-6c6e-4061-b192-c8e5e41edf81 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:19.900206 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1228/2440] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:20.193894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b12401-f371-466a-8428-6acd82d744ed None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:20.195830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-33b12401-f371-466a-8428-6acd82d744ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:20.210832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b12401-f371-466a-8428-6acd82d744ed None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:20.219784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d35e5-9e00-46a8-9933-349820a16b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:20.220683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d35e5-9e00-46a8-9933-349820a16b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.220966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d35e5-9e00-46a8-9933-349820a16b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.221273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d35e5-9e00-46a8-9933-349820a16b1e admin admin] PATH_INFO: `/v3/projects/cd7baf98bd5f42f3b5de024c02637ef4` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.222920 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d35e5-9e00-46a8-9933-349820a16b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7baf98bd5f42f3b5de024c02637ef4)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:20.225254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d35e5-9e00-46a8-9933-349820a16b1e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:20.247803 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:20.287570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a56d35e5-9e00-46a8-9933-349820a16b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7baf98bd5f42f3b5de024c02637ef4', 'request_id': 'req-a56d35e5-9e00-46a8-9933-349820a16b1e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:20.294097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a56d35e5-9e00-46a8-9933-349820a16b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7baf98bd5f42f3b5de024c02637ef4', 'request_id': 'req-a56d35e5-9e00-46a8-9933-349820a16b1e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:20.304247 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a56d35e5-9e00-46a8-9933-349820a16b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7baf98bd5f42f3b5de024c02637ef4', 'request_id': 'req-a56d35e5-9e00-46a8-9933-349820a16b1e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:20.316102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a56d35e5-9e00-46a8-9933-349820a16b1e admin admin] The token cache is being invalidate because project cd7baf98bd5f42f3b5de024c02637ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:20.316412 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a56d35e5-9e00-46a8-9933-349820a16b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:20.322993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-a56d35e5-9e00-46a8-9933-349820a16b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:20.324735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1213/2441] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:20 2022] DELETE /identity/v3/projects/cd7baf98bd5f42f3b5de024c02637ef4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:20.329901 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e415d3f-697f-4702-86b1-c4eb8b644b6d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.330464 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e415d3f-697f-4702-86b1-c4eb8b644b6d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.330644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e415d3f-697f-4702-86b1-c4eb8b644b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.350232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6e415d3f-697f-4702-86b1-c4eb8b644b6d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:20.351437 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6e415d3f-697f-4702-86b1-c4eb8b644b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:20.362379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d35e5-9e00-46a8-9933-349820a16b1e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:20.365629 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a56d35e5-9e00-46a8-9933-349820a16b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:20.431659 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1229/2442] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:20.437405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd998b7-dda4-40ba-942c-3c51e3b6d50f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.437833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd998b7-dda4-40ba-942c-3c51e3b6d50f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.437958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd998b7-dda4-40ba-942c-3c51e3b6d50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.458033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6dd998b7-dda4-40ba-942c-3c51e3b6d50f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:20.459395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6dd998b7-dda4-40ba-942c-3c51e3b6d50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:20.465325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d35e5-9e00-46a8-9933-349820a16b1e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:20.468503 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1230/2443] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:32:20.470747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61651af4-ee72-4d60-abfb-5073045e3087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:20.472064 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61651af4-ee72-4d60-abfb-5073045e3087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.472349 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61651af4-ee72-4d60-abfb-5073045e3087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.472652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61651af4-ee72-4d60-abfb-5073045e3087 admin admin] PATH_INFO: `/v3/projects/bf82b52aa10a4c9d9c99587d86fa13b5` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.473952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61651af4-ee72-4d60-abfb-5073045e3087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf82b52aa10a4c9d9c99587d86fa13b5)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:20.474101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd998b7-dda4-40ba-942c-3c51e3b6d50f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:20.476114 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61651af4-ee72-4d60-abfb-5073045e3087 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:20.483826 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd998b7-dda4-40ba-942c-3c51e3b6d50f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:20.488811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f992d-8f8a-460b-9c79-0d48bad40dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:20.489857 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f992d-8f8a-460b-9c79-0d48bad40dda admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.490148 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f992d-8f8a-460b-9c79-0d48bad40dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.490462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f992d-8f8a-460b-9c79-0d48bad40dda admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.491166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f992d-8f8a-460b-9c79-0d48bad40dda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:32:20.491474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f992d-8f8a-460b-9c79-0d48bad40dda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:20.493207 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f992d-8f8a-460b-9c79-0d48bad40dda admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:20.510115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1231/2444] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:32:20.511144 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f992d-8f8a-460b-9c79-0d48bad40dda admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:20.522574 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f992d-8f8a-460b-9c79-0d48bad40dda admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:20.527659 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e25966-fd55-404d-b7dd-08ca8d9fa2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:20.528412 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e25966-fd55-404d-b7dd-08ca8d9fa2eb admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.528763 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e25966-fd55-404d-b7dd-08ca8d9fa2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.529107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e25966-fd55-404d-b7dd-08ca8d9fa2eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.529877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e25966-fd55-404d-b7dd-08ca8d9fa2eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:20.532064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e25966-fd55-404d-b7dd-08ca8d9fa2eb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:20.540358 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-61651af4-ee72-4d60-abfb-5073045e3087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf82b52aa10a4c9d9c99587d86fa13b5', 'request_id': 'req-61651af4-ee72-4d60-abfb-5073045e3087'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:20.547137 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-61651af4-ee72-4d60-abfb-5073045e3087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf82b52aa10a4c9d9c99587d86fa13b5', 'request_id': 'req-61651af4-ee72-4d60-abfb-5073045e3087'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:20.564087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1232/2445] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:20 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:20.566916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-61651af4-ee72-4d60-abfb-5073045e3087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf82b52aa10a4c9d9c99587d86fa13b5', 'request_id': 'req-61651af4-ee72-4d60-abfb-5073045e3087'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:20.570050 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e25966-fd55-404d-b7dd-08ca8d9fa2eb admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:20.583708 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-61651af4-ee72-4d60-abfb-5073045e3087 admin admin] The token cache is being invalidate because project bf82b52aa10a4c9d9c99587d86fa13b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:20.584006 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-61651af4-ee72-4d60-abfb-5073045e3087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:20.584762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-61651af4-ee72-4d60-abfb-5073045e3087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:20.586828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1214/2446] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:20 2022] DELETE /identity/v3/projects/bf82b52aa10a4c9d9c99587d86fa13b5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:20.592235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3d0d7-dc79-4033-9a83-0857783cf36f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.592529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3d0d7-dc79-4033-9a83-0857783cf36f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.592813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3d0d7-dc79-4033-9a83-0857783cf36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.605691 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:20.612736 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-94d3d0d7-dc79-4033-9a83-0857783cf36f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:20.614649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-94d3d0d7-dc79-4033-9a83-0857783cf36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:20.648265 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e25966-fd55-404d-b7dd-08ca8d9fa2eb admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:20.651013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:20.653331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122bc8f-99bf-4a54-8768-1befe28ee5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:20.654008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122bc8f-99bf-4a54-8768-1befe28ee5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.654287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122bc8f-99bf-4a54-8768-1befe28ee5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.654558 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122bc8f-99bf-4a54-8768-1befe28ee5f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.655423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122bc8f-99bf-4a54-8768-1befe28ee5f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:20.657774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122bc8f-99bf-4a54-8768-1befe28ee5f3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:20.687674 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1233/2447] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:20 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:20.689761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122bc8f-99bf-4a54-8768-1befe28ee5f3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:20.691775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6122bc8f-99bf-4a54-8768-1befe28ee5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:20.692457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1215/2448] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:32:20.700086 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60d1fd-cebc-4d81-8449-b833569b5250 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.700381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60d1fd-cebc-4d81-8449-b833569b5250 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.700786 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60d1fd-cebc-4d81-8449-b833569b5250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.704663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122bc8f-99bf-4a54-8768-1befe28ee5f3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:20.709534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9672-c7b9-4fa6-83f6-651eb0189729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:20.710207 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9672-c7b9-4fa6-83f6-651eb0189729 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.710495 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9672-c7b9-4fa6-83f6-651eb0189729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.710774 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9672-c7b9-4fa6-83f6-651eb0189729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.711536 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee9672-c7b9-4fa6-83f6-651eb0189729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:20.713196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee9672-c7b9-4fa6-83f6-651eb0189729 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:20.719305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-7d60d1fd-cebc-4d81-8449-b833569b5250 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:20.720561 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7d60d1fd-cebc-4d81-8449-b833569b5250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:20.723559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1234/2449] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:32:20.727537 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9672-c7b9-4fa6-83f6-651eb0189729 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:20.729769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1216/2450] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:20.734061 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60d1fd-cebc-4d81-8449-b833569b5250 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:20.737675 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9672-c7b9-4fa6-83f6-651eb0189729 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:20.744540 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6aaf8a-38fb-428c-beea-2eea5ab75574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:20.745029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60d1fd-cebc-4d81-8449-b833569b5250 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:20.745225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6aaf8a-38fb-428c-beea-2eea5ab75574 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.745681 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6aaf8a-38fb-428c-beea-2eea5ab75574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.745944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6aaf8a-38fb-428c-beea-2eea5ab75574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.746682 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6aaf8a-38fb-428c-beea-2eea5ab75574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:20.748371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6aaf8a-38fb-428c-beea-2eea5ab75574 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:20.749967 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8870f-b508-402a-ba53-c16c581b5f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:20.751037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8870f-b508-402a-ba53-c16c581b5f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.751037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8870f-b508-402a-ba53-c16c581b5f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.751250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8870f-b508-402a-ba53-c16c581b5f66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.752146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8870f-b508-402a-ba53-c16c581b5f66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:32:20.752480 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8870f-b508-402a-ba53-c16c581b5f66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:20.754409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8870f-b508-402a-ba53-c16c581b5f66 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:20.760571 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1235/2451] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:32:20.764681 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6aaf8a-38fb-428c-beea-2eea5ab75574 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:20.769886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1217/2452] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:32:20.770993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8870f-b508-402a-ba53-c16c581b5f66 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:20.774653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6aaf8a-38fb-428c-beea-2eea5ab75574 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:20.779577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3840747-3299-4a25-ace1-591838e239b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:20.780500 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3840747-3299-4a25-ace1-591838e239b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.780776 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3840747-3299-4a25-ace1-591838e239b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.780882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8870f-b508-402a-ba53-c16c581b5f66 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:20.781049 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3840747-3299-4a25-ace1-591838e239b7 admin admin] PATH_INFO: `/v3/projects/1dcdc3ea556a47cbbca330f400ac0967/users/f200322f009e4736932961f616622a2d/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.786654 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6b1af-5996-4886-b072-610f56d7e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:20.787296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6b1af-5996-4886-b072-610f56d7e948 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.787619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6b1af-5996-4886-b072-610f56d7e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.787932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6b1af-5996-4886-b072-610f56d7e948 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.788622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6b1af-5996-4886-b072-610f56d7e948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:20.790950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6b1af-5996-4886-b072-610f56d7e948 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:20.796053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3840747-3299-4a25-ace1-591838e239b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dcdc3ea556a47cbbca330f400ac0967, user_id=f200322f009e4736932961f616622a2d, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:20.798729 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3840747-3299-4a25-ace1-591838e239b7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:20.814618 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1236/2453] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:20 2022] PUT /identity/v3/projects/1dcdc3ea556a47cbbca330f400ac0967/users/f200322f009e4736932961f616622a2d/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:32:20.819569 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1218/2454] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:20 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:32:20.819847 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06703f-bfec-4830-be4b-e025fa0f86bc None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.820195 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06703f-bfec-4830-be4b-e025fa0f86bc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.820480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06703f-bfec-4830-be4b-e025fa0f86bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.823348 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6b1af-5996-4886-b072-610f56d7e948 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:20.841950 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2d06703f-bfec-4830-be4b-e025fa0f86bc None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:20.843695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2d06703f-bfec-4830-be4b-e025fa0f86bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:20.889306 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6b1af-5996-4886-b072-610f56d7e948 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:20.894463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278a67e-0f01-4bc3-a9cc-ebb5f1cd6857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:20.895143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278a67e-0f01-4bc3-a9cc-ebb5f1cd6857 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.895447 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278a67e-0f01-4bc3-a9cc-ebb5f1cd6857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.895730 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278a67e-0f01-4bc3-a9cc-ebb5f1cd6857 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.896427 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278a67e-0f01-4bc3-a9cc-ebb5f1cd6857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:20.898378 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278a67e-0f01-4bc3-a9cc-ebb5f1cd6857 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:20.903159 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1237/2455] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:32:20.918059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06703f-bfec-4830-be4b-e025fa0f86bc None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:20.919674 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2d06703f-bfec-4830-be4b-e025fa0f86bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:20.932429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1219/2456] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:20 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:32:20.936480 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278a67e-0f01-4bc3-a9cc-ebb5f1cd6857 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:20.946192 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278a67e-0f01-4bc3-a9cc-ebb5f1cd6857 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:20.950745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa46c6a-4532-4149-b757-abe9fdefb64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:20.951397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa46c6a-4532-4149-b757-abe9fdefb64c admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.951710 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa46c6a-4532-4149-b757-abe9fdefb64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.951989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa46c6a-4532-4149-b757-abe9fdefb64c admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.952716 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa46c6a-4532-4149-b757-abe9fdefb64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:20.954328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa46c6a-4532-4149-b757-abe9fdefb64c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:20.964450 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1220/2457] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:32:20.968364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa46c6a-4532-4149-b757-abe9fdefb64c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:20.978582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa46c6a-4532-4149-b757-abe9fdefb64c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:20.982244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06703f-bfec-4830-be4b-e025fa0f86bc None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:20.983806 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f8467-7c3e-4420-ba2c-6fde9c2026ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:20.984477 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f8467-7c3e-4420-ba2c-6fde9c2026ec admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.984759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f8467-7c3e-4420-ba2c-6fde9c2026ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.985198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f8467-7c3e-4420-ba2c-6fde9c2026ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:20.985934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f8467-7c3e-4420-ba2c-6fde9c2026ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:20.987795 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f8467-7c3e-4420-ba2c-6fde9c2026ec admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:20.992590 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b198d4e-4927-4ef2-8c19-754973b9009d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:20.993596 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b198d4e-4927-4ef2-8c19-754973b9009d service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:20.993888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b198d4e-4927-4ef2-8c19-754973b9009d service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:20.994151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b198d4e-4927-4ef2-8c19-754973b9009d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:21.000322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1221/2458] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:32:21.004445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f8467-7c3e-4420-ba2c-6fde9c2026ec admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:21.005873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b198d4e-4927-4ef2-8c19-754973b9009d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:21.007531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b198d4e-4927-4ef2-8c19-754973b9009d service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:21.015024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f8467-7c3e-4420-ba2c-6fde9c2026ec admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:21.019534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1238/2459] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:21.021979 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1672595-fde6-42a4-93cc-9ecf40efc1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:21.023315 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1672595-fde6-42a4-93cc-9ecf40efc1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:21.023623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1672595-fde6-42a4-93cc-9ecf40efc1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:21.023950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1672595-fde6-42a4-93cc-9ecf40efc1a6 admin admin] PATH_INFO: `/v3/projects/22c347c5096048118060d2a4e2d8984d/users/df24f34dc02c4850b61a872d65b54cbb/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:21.042443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1672595-fde6-42a4-93cc-9ecf40efc1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c347c5096048118060d2a4e2d8984d, user_id=df24f34dc02c4850b61a872d65b54cbb, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:21.045328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1672595-fde6-42a4-93cc-9ecf40efc1a6 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:21.069349 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1222/2460] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:21 2022] PUT /identity/v3/projects/22c347c5096048118060d2a4e2d8984d/users/df24f34dc02c4850b61a872d65b54cbb/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:32:21.082063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb44cc5-5377-466b-8b40-30aa38c54735 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:21.082409 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb44cc5-5377-466b-8b40-30aa38c54735 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:21.082754 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb44cc5-5377-466b-8b40-30aa38c54735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:21.107700 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:21.118585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-fdb44cc5-5377-466b-8b40-30aa38c54735 None None] MFA Rules not processed for user `df24f34dc02c4850b61a872d65b54cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:21.120237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fdb44cc5-5377-466b-8b40-30aa38c54735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:21.286718 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1239/2461] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:21.301507 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1672595-fde6-42a4-93cc-9ecf40efc1a6 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:21.304530 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e1672595-fde6-42a4-93cc-9ecf40efc1a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:21.427693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:21.464437 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1672595-fde6-42a4-93cc-9ecf40efc1a6 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:21.468275 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196534ae-ba9d-4097-b9db-aad265d97dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:21.468905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196534ae-ba9d-4097-b9db-aad265d97dee service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:21.469188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196534ae-ba9d-4097-b9db-aad265d97dee service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:21.469463 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196534ae-ba9d-4097-b9db-aad265d97dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:21.479196 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196534ae-ba9d-4097-b9db-aad265d97dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:21.480710 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196534ae-ba9d-4097-b9db-aad265d97dee service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:21.499930 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1223/2462] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:21.528322 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb44cc5-5377-466b-8b40-30aa38c54735 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:21.608479 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb44cc5-5377-466b-8b40-30aa38c54735 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:21.615068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7f94b-f8f0-49ba-84b0-fb96a1425b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:21.616018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7f94b-f8f0-49ba-84b0-fb96a1425b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:21.616303 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7f94b-f8f0-49ba-84b0-fb96a1425b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:21.616581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7f94b-f8f0-49ba-84b0-fb96a1425b87 admin admin] PATH_INFO: `/v3/users/df24f34dc02c4850b61a872d65b54cbb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:21.618461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7f94b-f8f0-49ba-84b0-fb96a1425b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df24f34dc02c4850b61a872d65b54cbb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:21.620564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7f94b-f8f0-49ba-84b0-fb96a1425b87 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:21.691764 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3ac7f94b-f8f0-49ba-84b0-fb96a1425b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df24f34dc02c4850b61a872d65b54cbb'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:21.692707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3ac7f94b-f8f0-49ba-84b0-fb96a1425b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df24f34dc02c4850b61a872d65b54cbb'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:21.693336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3ac7f94b-f8f0-49ba-84b0-fb96a1425b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df24f34dc02c4850b61a872d65b54cbb'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:21.701263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3ac7f94b-f8f0-49ba-84b0-fb96a1425b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df24f34dc02c4850b61a872d65b54cbb'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:21.710948 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3ac7f94b-f8f0-49ba-84b0-fb96a1425b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df24f34dc02c4850b61a872d65b54cbb'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:21.729679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1240/2463] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:21 2022] DELETE /identity/v3/users/df24f34dc02c4850b61a872d65b54cbb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:21.734108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b86551-ea84-40f8-8d16-b52d44c77d6d None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:21.734798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b86551-ea84-40f8-8d16-b52d44c77d6d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:21.734798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b86551-ea84-40f8-8d16-b52d44c77d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:21.752596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-51b86551-ea84-40f8-8d16-b52d44c77d6d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:21.753999 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-51b86551-ea84-40f8-8d16-b52d44c77d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:21.815699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1224/2464] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:21.826060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7f94b-f8f0-49ba-84b0-fb96a1425b87 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:21.827879 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3ac7f94b-f8f0-49ba-84b0-fb96a1425b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:21.856119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:21.903074 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7f94b-f8f0-49ba-84b0-fb96a1425b87 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:21.907104 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff32e6-40db-4118-ae46-e71051d92f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:21.907829 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff32e6-40db-4118-ae46-e71051d92f9b service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:21.908099 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff32e6-40db-4118-ae46-e71051d92f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:21.908973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff32e6-40db-4118-ae46-e71051d92f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:21.920212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff32e6-40db-4118-ae46-e71051d92f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:21.921719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff32e6-40db-4118-ae46-e71051d92f9b service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:21.937068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1241/2465] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:21.938888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b60625-8e54-45c9-a4e8-ed00c27352b6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:21.939182 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b60625-8e54-45c9-a4e8-ed00c27352b6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:21.939464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b60625-8e54-45c9-a4e8-ed00c27352b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:21.968597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-93b60625-8e54-45c9-a4e8-ed00c27352b6 None None] MFA Rules not processed for user `f200322f009e4736932961f616622a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:21.969931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-93b60625-8e54-45c9-a4e8-ed00c27352b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:22.067918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1225/2466] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:22.087560 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff32e6-40db-4118-ae46-e71051d92f9b service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:22.089997 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a0ff32e6-40db-4118-ae46-e71051d92f9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:22.194155 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff32e6-40db-4118-ae46-e71051d92f9b service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:22.198513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bce9f-ee1e-4e8a-9047-602c50d50aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:22.199197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bce9f-ee1e-4e8a-9047-602c50d50aae service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:22.199481 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bce9f-ee1e-4e8a-9047-602c50d50aae service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:22.199791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bce9f-ee1e-4e8a-9047-602c50d50aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:22.209544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bce9f-ee1e-4e8a-9047-602c50d50aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:22.211195 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bce9f-ee1e-4e8a-9047-602c50d50aae service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:22.223046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1242/2467] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:22.278237 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b60625-8e54-45c9-a4e8-ed00c27352b6 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:22.280329 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-93b60625-8e54-45c9-a4e8-ed00c27352b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:22.302413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b60625-8e54-45c9-a4e8-ed00c27352b6 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:22.308072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aa93d-0ef9-4a21-9e00-dc23e6baab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:22.308969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aa93d-0ef9-4a21-9e00-dc23e6baab89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:22.309253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aa93d-0ef9-4a21-9e00-dc23e6baab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:22.309530 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aa93d-0ef9-4a21-9e00-dc23e6baab89 admin admin] PATH_INFO: `/v3/projects/22c347c5096048118060d2a4e2d8984d` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:22.311050 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19aa93d-0ef9-4a21-9e00-dc23e6baab89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c347c5096048118060d2a4e2d8984d)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:22.312913 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19aa93d-0ef9-4a21-9e00-dc23e6baab89 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:22.368703 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e19aa93d-0ef9-4a21-9e00-dc23e6baab89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c347c5096048118060d2a4e2d8984d', 'request_id': 'req-e19aa93d-0ef9-4a21-9e00-dc23e6baab89'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:22.379386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e19aa93d-0ef9-4a21-9e00-dc23e6baab89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c347c5096048118060d2a4e2d8984d', 'request_id': 'req-e19aa93d-0ef9-4a21-9e00-dc23e6baab89'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:22.391401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e19aa93d-0ef9-4a21-9e00-dc23e6baab89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c347c5096048118060d2a4e2d8984d', 'request_id': 'req-e19aa93d-0ef9-4a21-9e00-dc23e6baab89'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:22.393697 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:22.404791 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e19aa93d-0ef9-4a21-9e00-dc23e6baab89 admin admin] The token cache is being invalidate because project 22c347c5096048118060d2a4e2d8984d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:22.405602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e19aa93d-0ef9-4a21-9e00-dc23e6baab89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:22.407002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e19aa93d-0ef9-4a21-9e00-dc23e6baab89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:22.409508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1226/2468] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:22 2022] DELETE /identity/v3/projects/22c347c5096048118060d2a4e2d8984d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:22.415436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdc33b-cebb-47ac-8fb4-2d8e582e192f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:22.415765 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdc33b-cebb-47ac-8fb4-2d8e582e192f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:22.416046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdc33b-cebb-47ac-8fb4-2d8e582e192f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:22.435135 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f5cdc33b-cebb-47ac-8fb4-2d8e582e192f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:22.435590 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f5cdc33b-cebb-47ac-8fb4-2d8e582e192f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:22.513622 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1243/2469] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:22.524056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5d938-c006-4caf-a867-5ef17734453b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:22.524671 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5d938-c006-4caf-a867-5ef17734453b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:22.525277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5d938-c006-4caf-a867-5ef17734453b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:22.559176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-bab5d938-c006-4caf-a867-5ef17734453b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:22.562603 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-bab5d938-c006-4caf-a867-5ef17734453b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:22.585164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1227/2470] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:22.589299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdc33b-cebb-47ac-8fb4-2d8e582e192f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:22.605540 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdc33b-cebb-47ac-8fb4-2d8e582e192f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:22.621833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78bb78-32b3-4abc-a197-4163347ddb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:22.632300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78bb78-32b3-4abc-a197-4163347ddb92 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:22.632656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78bb78-32b3-4abc-a197-4163347ddb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:22.632946 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78bb78-32b3-4abc-a197-4163347ddb92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:22.633840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78bb78-32b3-4abc-a197-4163347ddb92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:32:22.634043 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78bb78-32b3-4abc-a197-4163347ddb92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:22.635823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78bb78-32b3-4abc-a197-4163347ddb92 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:22.649179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1244/2471] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:32:22.653614 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5d938-c006-4caf-a867-5ef17734453b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:22.666390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5d938-c006-4caf-a867-5ef17734453b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:22.673435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cd25f-653f-4f7b-895f-c149083e1a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:22.675112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cd25f-653f-4f7b-895f-c149083e1a64 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:22.675112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cd25f-653f-4f7b-895f-c149083e1a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:22.675112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cd25f-653f-4f7b-895f-c149083e1a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:22.675448 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cd25f-653f-4f7b-895f-c149083e1a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:22.677684 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cd25f-653f-4f7b-895f-c149083e1a64 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:22.717154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1228/2472] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:22 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:32:22.722384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78bb78-32b3-4abc-a197-4163347ddb92 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:22.734807 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78bb78-32b3-4abc-a197-4163347ddb92 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:22.798875 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:22.809389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd0c12-fa59-4dba-9892-a4615d719117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:22.810106 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd0c12-fa59-4dba-9892-a4615d719117 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:22.811638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd0c12-fa59-4dba-9892-a4615d719117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:22.811638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd0c12-fa59-4dba-9892-a4615d719117 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:22.811826 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd0c12-fa59-4dba-9892-a4615d719117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:22.813938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd0c12-fa59-4dba-9892-a4615d719117 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:22.851638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1245/2473] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:22 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:22.855120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cd25f-653f-4f7b-895f-c149083e1a64 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:22.870328 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cd25f-653f-4f7b-895f-c149083e1a64 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:22.877924 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6fa5b-e2eb-40b4-aff8-068d79a2d761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:22.879295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6fa5b-e2eb-40b4-aff8-068d79a2d761 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:22.879835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6fa5b-e2eb-40b4-aff8-068d79a2d761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:22.880255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6fa5b-e2eb-40b4-aff8-068d79a2d761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:22.881144 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6fa5b-e2eb-40b4-aff8-068d79a2d761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:22.883515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6fa5b-e2eb-40b4-aff8-068d79a2d761 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:22.898539 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1229/2474] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:22.902698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd0c12-fa59-4dba-9892-a4615d719117 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:22.914737 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd0c12-fa59-4dba-9892-a4615d719117 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:22.919769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1309b-1bb8-4e8e-8002-1df1741b43f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:22.920640 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1309b-1bb8-4e8e-8002-1df1741b43f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:22.921056 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1309b-1bb8-4e8e-8002-1df1741b43f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:22.921480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1309b-1bb8-4e8e-8002-1df1741b43f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:22.922292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1309b-1bb8-4e8e-8002-1df1741b43f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:22.924150 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1309b-1bb8-4e8e-8002-1df1741b43f5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:22.936297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1246/2475] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:22.940555 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6fa5b-e2eb-40b4-aff8-068d79a2d761 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:22.951181 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6fa5b-e2eb-40b4-aff8-068d79a2d761 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:22.955862 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125f2f3-50d4-4b53-8f3d-16807e281eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:22.957123 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125f2f3-50d4-4b53-8f3d-16807e281eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:22.957483 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125f2f3-50d4-4b53-8f3d-16807e281eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:22.957764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125f2f3-50d4-4b53-8f3d-16807e281eaf admin admin] PATH_INFO: `/v3/projects/595707058f424913b727c534a2e477d6/users/ca5ddd20cf1f4f63a1bb4fdf96b9f894/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:22.974705 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125f2f3-50d4-4b53-8f3d-16807e281eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=595707058f424913b727c534a2e477d6, user_id=ca5ddd20cf1f4f63a1bb4fdf96b9f894, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:22.977435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125f2f3-50d4-4b53-8f3d-16807e281eaf admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:22.994199 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1230/2476] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:22 2022] PUT /identity/v3/projects/595707058f424913b727c534a2e477d6/users/ca5ddd20cf1f4f63a1bb4fdf96b9f894/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:32:22.999299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c570d33-a2e9-44fc-978e-07603fcf80f1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:23.000335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c570d33-a2e9-44fc-978e-07603fcf80f1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:23.000335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c570d33-a2e9-44fc-978e-07603fcf80f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:23.018877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7c570d33-a2e9-44fc-978e-07603fcf80f1 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:23.020216 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7c570d33-a2e9-44fc-978e-07603fcf80f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:23.085657 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1247/2477] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:32:23.095974 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125f2f3-50d4-4b53-8f3d-16807e281eaf admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:23.098127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e125f2f3-50d4-4b53-8f3d-16807e281eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:23.193996 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125f2f3-50d4-4b53-8f3d-16807e281eaf admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:23.197783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa4909-ea05-4419-b0dc-1d93f54b9f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:23.198528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa4909-ea05-4419-b0dc-1d93f54b9f27 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:23.198817 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa4909-ea05-4419-b0dc-1d93f54b9f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:23.199095 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa4909-ea05-4419-b0dc-1d93f54b9f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:23.216918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa4909-ea05-4419-b0dc-1d93f54b9f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:23.219394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa4909-ea05-4419-b0dc-1d93f54b9f27 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:23.239630 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1231/2478] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:23.796231 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396aeba5-347d-43bf-ae7a-4264d07f52fa None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:23.796998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396aeba5-347d-43bf-ae7a-4264d07f52fa None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:23.797276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396aeba5-347d-43bf-ae7a-4264d07f52fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:23.843544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-396aeba5-347d-43bf-ae7a-4264d07f52fa None None] MFA Rules not processed for user `f200322f009e4736932961f616622a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:23.844965 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-396aeba5-347d-43bf-ae7a-4264d07f52fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:23.937698 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1248/2479] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:24.028532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa4909-ea05-4419-b0dc-1d93f54b9f27 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:24.030928 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8dfa4909-ea05-4419-b0dc-1d93f54b9f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:24.047811 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa4909-ea05-4419-b0dc-1d93f54b9f27 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:24.056226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f9e27-4261-400d-8db3-2128b48d55e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:24.057138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f9e27-4261-400d-8db3-2128b48d55e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:24.057596 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f9e27-4261-400d-8db3-2128b48d55e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:24.058512 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f9e27-4261-400d-8db3-2128b48d55e7 admin admin] PATH_INFO: `/v3/users/a1283412627e4288a3eff6fc09fd5cb5` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:24.061553 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f9e27-4261-400d-8db3-2128b48d55e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1283412627e4288a3eff6fc09fd5cb5)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:24.067763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f9e27-4261-400d-8db3-2128b48d55e7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:24.148679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-642f9e27-4261-400d-8db3-2128b48d55e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1283412627e4288a3eff6fc09fd5cb5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:24.183827 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-642f9e27-4261-400d-8db3-2128b48d55e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1283412627e4288a3eff6fc09fd5cb5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:24.184704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-642f9e27-4261-400d-8db3-2128b48d55e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1283412627e4288a3eff6fc09fd5cb5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:24.185417 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-642f9e27-4261-400d-8db3-2128b48d55e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1283412627e4288a3eff6fc09fd5cb5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:24.200209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-642f9e27-4261-400d-8db3-2128b48d55e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1283412627e4288a3eff6fc09fd5cb5'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:24.250056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1232/2480] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:24 2022] DELETE /identity/v3/users/a1283412627e4288a3eff6fc09fd5cb5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:25.222436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396aeba5-347d-43bf-ae7a-4264d07f52fa None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:25.258645 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396aeba5-347d-43bf-ae7a-4264d07f52fa None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:25.450803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055e599-5cf1-40b6-9fd6-fbf9591f1258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:25.451851 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055e599-5cf1-40b6-9fd6-fbf9591f1258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:25.452164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055e599-5cf1-40b6-9fd6-fbf9591f1258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:25.452447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055e599-5cf1-40b6-9fd6-fbf9591f1258 admin admin] PATH_INFO: `/v3/projects/76cdfcfcc75542db97386a6f1b69215a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:25.453765 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055e599-5cf1-40b6-9fd6-fbf9591f1258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76cdfcfcc75542db97386a6f1b69215a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:25.457645 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055e599-5cf1-40b6-9fd6-fbf9591f1258 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:25.513283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:25.555228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9055e599-5cf1-40b6-9fd6-fbf9591f1258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76cdfcfcc75542db97386a6f1b69215a', 'request_id': 'req-9055e599-5cf1-40b6-9fd6-fbf9591f1258'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.569384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9055e599-5cf1-40b6-9fd6-fbf9591f1258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76cdfcfcc75542db97386a6f1b69215a', 'request_id': 'req-9055e599-5cf1-40b6-9fd6-fbf9591f1258'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.578363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9055e599-5cf1-40b6-9fd6-fbf9591f1258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76cdfcfcc75542db97386a6f1b69215a', 'request_id': 'req-9055e599-5cf1-40b6-9fd6-fbf9591f1258'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.600474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9055e599-5cf1-40b6-9fd6-fbf9591f1258 admin admin] The token cache is being invalidate because project 76cdfcfcc75542db97386a6f1b69215a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:25.600764 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9055e599-5cf1-40b6-9fd6-fbf9591f1258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.603143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-9055e599-5cf1-40b6-9fd6-fbf9591f1258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.613281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1249/2481] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:25 2022] DELETE /identity/v3/projects/76cdfcfcc75542db97386a6f1b69215a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:25.615119 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f9e27-4261-400d-8db3-2128b48d55e7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:25.617455 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-642f9e27-4261-400d-8db3-2128b48d55e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:25.629674 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:25.651146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f9e27-4261-400d-8db3-2128b48d55e7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:25.776272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247392d-5586-403a-879e-47addc11c02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:25.777275 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247392d-5586-403a-879e-47addc11c02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:25.777656 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247392d-5586-403a-879e-47addc11c02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:25.778030 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247392d-5586-403a-879e-47addc11c02d admin admin] PATH_INFO: `/v3/users/3fd184b7a5b0463ca9e14375dea63439` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:25.779373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247392d-5586-403a-879e-47addc11c02d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd184b7a5b0463ca9e14375dea63439)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:25.781480 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247392d-5586-403a-879e-47addc11c02d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:25.870815 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b247392d-5586-403a-879e-47addc11c02d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd184b7a5b0463ca9e14375dea63439'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.885235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b247392d-5586-403a-879e-47addc11c02d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd184b7a5b0463ca9e14375dea63439'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.889387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b247392d-5586-403a-879e-47addc11c02d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd184b7a5b0463ca9e14375dea63439'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.894999 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b247392d-5586-403a-879e-47addc11c02d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd184b7a5b0463ca9e14375dea63439'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.914353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b247392d-5586-403a-879e-47addc11c02d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd184b7a5b0463ca9e14375dea63439'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.944871 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1233/2482] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:25 2022] DELETE /identity/v3/users/3fd184b7a5b0463ca9e14375dea63439 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:26.585559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055e599-5cf1-40b6-9fd6-fbf9591f1258 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:26.587358 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9055e599-5cf1-40b6-9fd6-fbf9591f1258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:26.605563 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055e599-5cf1-40b6-9fd6-fbf9591f1258 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:26.690685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd28ebd-0636-465e-a2a3-4a5207e92749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:26.691912 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd28ebd-0636-465e-a2a3-4a5207e92749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.692618 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd28ebd-0636-465e-a2a3-4a5207e92749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.692913 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd28ebd-0636-465e-a2a3-4a5207e92749 admin admin] PATH_INFO: `/v3/projects/8f57047507424c93a1a3774dd63f76a9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.694365 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd28ebd-0636-465e-a2a3-4a5207e92749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f57047507424c93a1a3774dd63f76a9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:26.696877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd28ebd-0636-465e-a2a3-4a5207e92749 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:26.745525 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6fd28ebd-0636-465e-a2a3-4a5207e92749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f57047507424c93a1a3774dd63f76a9', 'request_id': 'req-6fd28ebd-0636-465e-a2a3-4a5207e92749'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:26.753861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6fd28ebd-0636-465e-a2a3-4a5207e92749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f57047507424c93a1a3774dd63f76a9', 'request_id': 'req-6fd28ebd-0636-465e-a2a3-4a5207e92749'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:26.761791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6fd28ebd-0636-465e-a2a3-4a5207e92749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f57047507424c93a1a3774dd63f76a9', 'request_id': 'req-6fd28ebd-0636-465e-a2a3-4a5207e92749'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:26.773625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6fd28ebd-0636-465e-a2a3-4a5207e92749 admin admin] The token cache is being invalidate because project 8f57047507424c93a1a3774dd63f76a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:26.773913 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6fd28ebd-0636-465e-a2a3-4a5207e92749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:26.774585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6fd28ebd-0636-465e-a2a3-4a5207e92749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:26.776534 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1250/2483] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:26 2022] DELETE /identity/v3/projects/8f57047507424c93a1a3774dd63f76a9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:26.782009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57624187-193e-4d14-b7c4-f950caf397e8 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.782518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57624187-193e-4d14-b7c4-f950caf397e8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.782597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57624187-193e-4d14-b7c4-f950caf397e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.805126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-57624187-193e-4d14-b7c4-f950caf397e8 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:26.806409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-57624187-193e-4d14-b7c4-f950caf397e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:26.883106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1234/2484] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:26.890949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfa810-7a52-43a6-8d7b-bd94f874bbf7 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.891301 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfa810-7a52-43a6-8d7b-bd94f874bbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.891664 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfa810-7a52-43a6-8d7b-bd94f874bbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.911090 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2bcfa810-7a52-43a6-8d7b-bd94f874bbf7 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:26.912465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2bcfa810-7a52-43a6-8d7b-bd94f874bbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:26.921945 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1251/2485] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:32:26.927179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57624187-193e-4d14-b7c4-f950caf397e8 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:26.938340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57624187-193e-4d14-b7c4-f950caf397e8 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:26.943468 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cc896-d2fd-49a4-a661-e83104ce4660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:26.944188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cc896-d2fd-49a4-a661-e83104ce4660 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.944647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cc896-d2fd-49a4-a661-e83104ce4660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.945101 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cc896-d2fd-49a4-a661-e83104ce4660 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.945850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cc896-d2fd-49a4-a661-e83104ce4660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:32:26.946168 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cc896-d2fd-49a4-a661-e83104ce4660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:26.948190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cc896-d2fd-49a4-a661-e83104ce4660 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:26.961003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1235/2486] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:32:26.965508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfa810-7a52-43a6-8d7b-bd94f874bbf7 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:26.977015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfa810-7a52-43a6-8d7b-bd94f874bbf7 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:26.983553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96e9fc-ffbc-4cb5-a9c5-8c7e39b15c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:26.984264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96e9fc-ffbc-4cb5-a9c5-8c7e39b15c55 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.984546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96e9fc-ffbc-4cb5-a9c5-8c7e39b15c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.984856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96e9fc-ffbc-4cb5-a9c5-8c7e39b15c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.985546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96e9fc-ffbc-4cb5-a9c5-8c7e39b15c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:26.987539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96e9fc-ffbc-4cb5-a9c5-8c7e39b15c55 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:27.035713 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1252/2487] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:26 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:27.037702 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cc896-d2fd-49a4-a661-e83104ce4660 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:27.057839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cc896-d2fd-49a4-a661-e83104ce4660 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:27.066500 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:27.155313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6956f3-0a08-4262-827f-5427bf2a897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:27.160253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6956f3-0a08-4262-827f-5427bf2a897d admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:27.160676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6956f3-0a08-4262-827f-5427bf2a897d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:27.161059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6956f3-0a08-4262-827f-5427bf2a897d admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:27.164460 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6956f3-0a08-4262-827f-5427bf2a897d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:27.166659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6956f3-0a08-4262-827f-5427bf2a897d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:27.196383 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1236/2488] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:27 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:27.200927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96e9fc-ffbc-4cb5-a9c5-8c7e39b15c55 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:27.218275 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96e9fc-ffbc-4cb5-a9c5-8c7e39b15c55 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:27.224059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64957e9f-021b-48d2-9c08-6189309449ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:27.224676 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64957e9f-021b-48d2-9c08-6189309449ef admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:27.225174 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64957e9f-021b-48d2-9c08-6189309449ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:27.225574 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64957e9f-021b-48d2-9c08-6189309449ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:27.226290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64957e9f-021b-48d2-9c08-6189309449ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:27.228008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64957e9f-021b-48d2-9c08-6189309449ef admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:27.237232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:27.259579 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1253/2489] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:27.260826 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6956f3-0a08-4262-827f-5427bf2a897d admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:27.273091 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6956f3-0a08-4262-827f-5427bf2a897d admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:27.284724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63538f-86a4-423e-a0d1-26b174ed27d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:27.286349 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63538f-86a4-423e-a0d1-26b174ed27d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:27.287005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63538f-86a4-423e-a0d1-26b174ed27d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:27.287492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63538f-86a4-423e-a0d1-26b174ed27d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:27.288834 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63538f-86a4-423e-a0d1-26b174ed27d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:27.291327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63538f-86a4-423e-a0d1-26b174ed27d1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:27.305995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1237/2490] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:27.310179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64957e9f-021b-48d2-9c08-6189309449ef admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:27.322540 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64957e9f-021b-48d2-9c08-6189309449ef admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:27.341344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f26a1d-979d-4b60-b442-ba2ca714f285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:27.342710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f26a1d-979d-4b60-b442-ba2ca714f285 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:27.343222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f26a1d-979d-4b60-b442-ba2ca714f285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:27.344007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f26a1d-979d-4b60-b442-ba2ca714f285 admin admin] PATH_INFO: `/v3/projects/d23843f5b8c44487919706253ce8046d/users/1f9b240932814d14a174e8ff8ad6105d/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:27.406162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f26a1d-979d-4b60-b442-ba2ca714f285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23843f5b8c44487919706253ce8046d, user_id=1f9b240932814d14a174e8ff8ad6105d, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:27.419288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f26a1d-979d-4b60-b442-ba2ca714f285 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:27.469206 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1254/2491] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:27 2022] PUT /identity/v3/projects/d23843f5b8c44487919706253ce8046d/users/1f9b240932814d14a174e8ff8ad6105d/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:27.471556 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2988450-b305-4d17-b5b4-696eaacb0d49 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:27.471556 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2988450-b305-4d17-b5b4-696eaacb0d49 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:27.472298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2988450-b305-4d17-b5b4-696eaacb0d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:27.550385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a2988450-b305-4d17-b5b4-696eaacb0d49 None None] MFA Rules not processed for user `1f9b240932814d14a174e8ff8ad6105d`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:27.553555 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a2988450-b305-4d17-b5b4-696eaacb0d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:27.775709 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f26a1d-979d-4b60-b442-ba2ca714f285 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:27.781595 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1238/2492] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:27.913943 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f26a1d-979d-4b60-b442-ba2ca714f285 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:27.923159 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e538e7-a7b6-446a-8520-c8b79c767244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:27.923882 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e538e7-a7b6-446a-8520-c8b79c767244 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:27.924407 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e538e7-a7b6-446a-8520-c8b79c767244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:27.925114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e538e7-a7b6-446a-8520-c8b79c767244 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:27.926209 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e538e7-a7b6-446a-8520-c8b79c767244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:27.929109 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e538e7-a7b6-446a-8520-c8b79c767244 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:27.975654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1255/2493] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:27 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:27.977800 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2988450-b305-4d17-b5b4-696eaacb0d49 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:27.996748 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2988450-b305-4d17-b5b4-696eaacb0d49 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:28.155013 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a89b6c-3a3b-4779-af70-c54484b506de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:28.156931 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a89b6c-3a3b-4779-af70-c54484b506de admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:28.157223 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a89b6c-3a3b-4779-af70-c54484b506de admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:28.159992 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a89b6c-3a3b-4779-af70-c54484b506de admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:28.161178 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a89b6c-3a3b-4779-af70-c54484b506de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:28.184403 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a89b6c-3a3b-4779-af70-c54484b506de admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:28.231705 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1239/2494] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:27 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:28.235051 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e538e7-a7b6-446a-8520-c8b79c767244 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:28.255312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e538e7-a7b6-446a-8520-c8b79c767244 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:28.270584 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a82ee-ae86-4b2e-91cf-6c3fd9d03155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:28.275883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a82ee-ae86-4b2e-91cf-6c3fd9d03155 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:28.276176 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a82ee-ae86-4b2e-91cf-6c3fd9d03155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:28.276478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a82ee-ae86-4b2e-91cf-6c3fd9d03155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:28.277216 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a82ee-ae86-4b2e-91cf-6c3fd9d03155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:28.281764 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a82ee-ae86-4b2e-91cf-6c3fd9d03155 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:28.326187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1256/2495] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:28.330884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a89b6c-3a3b-4779-af70-c54484b506de admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:28.351359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a89b6c-3a3b-4779-af70-c54484b506de admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:28.360076 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e8a94-8b7f-491a-b393-2ba66716c600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:28.363617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e8a94-8b7f-491a-b393-2ba66716c600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:28.364546 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e8a94-8b7f-491a-b393-2ba66716c600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:28.366776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e8a94-8b7f-491a-b393-2ba66716c600 admin admin] PATH_INFO: `/v3/projects/405298601f2c427aaac5e9a893cc7ae1/users/895eafba2f854764879b276ab99a09d1/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:28.370611 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:28.391890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e8a94-8b7f-491a-b393-2ba66716c600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=405298601f2c427aaac5e9a893cc7ae1, user_id=895eafba2f854764879b276ab99a09d1, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:28.395836 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e8a94-8b7f-491a-b393-2ba66716c600 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:28.432227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1240/2496] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:28 2022] PUT /identity/v3/projects/405298601f2c427aaac5e9a893cc7ae1/users/895eafba2f854764879b276ab99a09d1/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:28.436118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a82ee-ae86-4b2e-91cf-6c3fd9d03155 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:28.461253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a82ee-ae86-4b2e-91cf-6c3fd9d03155 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:28.549649 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dd766-5c43-4624-a5c4-68d34847bc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:28.550360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dd766-5c43-4624-a5c4-68d34847bc84 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:28.550648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dd766-5c43-4624-a5c4-68d34847bc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:28.550932 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dd766-5c43-4624-a5c4-68d34847bc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:28.551719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dd766-5c43-4624-a5c4-68d34847bc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:28.553949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dd766-5c43-4624-a5c4-68d34847bc84 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:28.567466 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1257/2497] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:28.571744 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e8a94-8b7f-491a-b393-2ba66716c600 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:28.588335 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e8a94-8b7f-491a-b393-2ba66716c600 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:28.594874 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e0cc8-59c1-45b6-bc21-1d70b5960ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:28.596334 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e0cc8-59c1-45b6-bc21-1d70b5960ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:28.597170 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e0cc8-59c1-45b6-bc21-1d70b5960ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:28.597536 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e0cc8-59c1-45b6-bc21-1d70b5960ed8 admin admin] PATH_INFO: `/v3/projects/405298601f2c427aaac5e9a893cc7ae1/users/895eafba2f854764879b276ab99a09d1/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:28.600220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e0cc8-59c1-45b6-bc21-1d70b5960ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=405298601f2c427aaac5e9a893cc7ae1, user_id=895eafba2f854764879b276ab99a09d1, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:28.604170 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e0cc8-59c1-45b6-bc21-1d70b5960ed8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:28.620569 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1241/2498] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:28 2022] PUT /identity/v3/projects/405298601f2c427aaac5e9a893cc7ae1/users/895eafba2f854764879b276ab99a09d1/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:28.632604 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b84851-feaf-4621-b7ae-02242b27e446 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:28.632881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b84851-feaf-4621-b7ae-02242b27e446 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:28.633173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b84851-feaf-4621-b7ae-02242b27e446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:28.679454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-00b84851-feaf-4621-b7ae-02242b27e446 None None] MFA Rules not processed for user `895eafba2f854764879b276ab99a09d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:28.681456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-00b84851-feaf-4621-b7ae-02242b27e446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:28.733258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:28.788496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1258/2499] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:28.802934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e0cc8-59c1-45b6-bc21-1d70b5960ed8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:28.805056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-397e0cc8-59c1-45b6-bc21-1d70b5960ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:28.883559 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e0cc8-59c1-45b6-bc21-1d70b5960ed8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:28.889003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c8a70-8078-4d4c-8c8a-24fee0944180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:28.889810 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c8a70-8078-4d4c-8c8a-24fee0944180 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:28.890146 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c8a70-8078-4d4c-8c8a-24fee0944180 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:28.890433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c8a70-8078-4d4c-8c8a-24fee0944180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:29.002144 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c8a70-8078-4d4c-8c8a-24fee0944180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:29.003760 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c8a70-8078-4d4c-8c8a-24fee0944180 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:29.022031 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1242/2500] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:31.188094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a8304-c831-4d00-a3bf-04c5888222a8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:31.188642 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a8304-c831-4d00-a3bf-04c5888222a8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:31.188944 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a8304-c831-4d00-a3bf-04c5888222a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:31.226573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-0e4a8304-c831-4d00-a3bf-04c5888222a8 None None] MFA Rules not processed for user `ca5ddd20cf1f4f63a1bb4fdf96b9f894`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:31.241920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0e4a8304-c831-4d00-a3bf-04c5888222a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:31.405691 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c8a70-8078-4d4c-8c8a-24fee0944180 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:31.407727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-129c8a70-8078-4d4c-8c8a-24fee0944180 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:31.409247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1259/2501] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:31.550633 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c8a70-8078-4d4c-8c8a-24fee0944180 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:31.557781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62c237-e6be-4f63-aeef-33f393da2bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:31.558671 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62c237-e6be-4f63-aeef-33f393da2bcc admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:31.559478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62c237-e6be-4f63-aeef-33f393da2bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:31.560631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62c237-e6be-4f63-aeef-33f393da2bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:31.561643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62c237-e6be-4f63-aeef-33f393da2bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:31.565400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62c237-e6be-4f63-aeef-33f393da2bcc admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:31.611276 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1243/2502] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:31 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:31.623752 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a8304-c831-4d00-a3bf-04c5888222a8 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:31.639963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a8304-c831-4d00-a3bf-04c5888222a8 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:31.776205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d02ed-07cf-435d-bdd9-2851dfafb539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:31.776916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d02ed-07cf-435d-bdd9-2851dfafb539 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:31.777204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d02ed-07cf-435d-bdd9-2851dfafb539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:31.777483 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d02ed-07cf-435d-bdd9-2851dfafb539 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:31.781103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d02ed-07cf-435d-bdd9-2851dfafb539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:31.783146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d02ed-07cf-435d-bdd9-2851dfafb539 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:31.810861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1260/2503] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:31 2022] POST /identity/v3/users => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:31.814597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62c237-e6be-4f63-aeef-33f393da2bcc admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:31.826564 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62c237-e6be-4f63-aeef-33f393da2bcc admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:31.832292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e2c11-984f-4e6e-90f5-54bbe169e444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:31.833368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e2c11-984f-4e6e-90f5-54bbe169e444 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:31.834058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e2c11-984f-4e6e-90f5-54bbe169e444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:31.834461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e2c11-984f-4e6e-90f5-54bbe169e444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:31.835456 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e2c11-984f-4e6e-90f5-54bbe169e444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:31.837264 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e2c11-984f-4e6e-90f5-54bbe169e444 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:31.839952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:31.851415 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1244/2504] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:31.855212 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d02ed-07cf-435d-bdd9-2851dfafb539 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:31.867020 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d02ed-07cf-435d-bdd9-2851dfafb539 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:31.872593 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981c017-0956-4e80-94ae-895bc551fae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:31.873733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981c017-0956-4e80-94ae-895bc551fae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:31.874414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981c017-0956-4e80-94ae-895bc551fae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:31.874841 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981c017-0956-4e80-94ae-895bc551fae3 admin admin] PATH_INFO: `/v3/projects/ec36de71d4994f39b54d800abdec8fca/users/e97d51dc7c874ac7a29250553ff6caa8/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:31.902237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981c017-0956-4e80-94ae-895bc551fae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec36de71d4994f39b54d800abdec8fca, user_id=e97d51dc7c874ac7a29250553ff6caa8, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:31.906768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981c017-0956-4e80-94ae-895bc551fae3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:31.946679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1261/2505] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:31 2022] PUT /identity/v3/projects/ec36de71d4994f39b54d800abdec8fca/users/e97d51dc7c874ac7a29250553ff6caa8/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:32:31.948131 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e2c11-984f-4e6e-90f5-54bbe169e444 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:31.964598 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e2c11-984f-4e6e-90f5-54bbe169e444 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:32.080903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba711c-017e-4c78-88e0-7b2d161096ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:32.081610 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba711c-017e-4c78-88e0-7b2d161096ea admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:32.081902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba711c-017e-4c78-88e0-7b2d161096ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:32.085040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba711c-017e-4c78-88e0-7b2d161096ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:32.085835 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba711c-017e-4c78-88e0-7b2d161096ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:32.087786 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba711c-017e-4c78-88e0-7b2d161096ea admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:32.110229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1245/2506] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:32.115403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981c017-0956-4e80-94ae-895bc551fae3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:32.131291 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981c017-0956-4e80-94ae-895bc551fae3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:32.151678 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213bd47-a68e-4312-af98-42121ae1e1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:32.152613 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213bd47-a68e-4312-af98-42121ae1e1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:32.152894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213bd47-a68e-4312-af98-42121ae1e1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:32.153166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213bd47-a68e-4312-af98-42121ae1e1c4 admin admin] PATH_INFO: `/v3/projects/ec36de71d4994f39b54d800abdec8fca/users/e97d51dc7c874ac7a29250553ff6caa8/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:32.155772 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213bd47-a68e-4312-af98-42121ae1e1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec36de71d4994f39b54d800abdec8fca, user_id=e97d51dc7c874ac7a29250553ff6caa8, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:32.159376 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213bd47-a68e-4312-af98-42121ae1e1c4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:32.177337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1262/2507] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:32 2022] PUT /identity/v3/projects/ec36de71d4994f39b54d800abdec8fca/users/e97d51dc7c874ac7a29250553ff6caa8/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:33.660754 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501238f7-ba3d-4646-8f85-fe2226354042 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:33.661314 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501238f7-ba3d-4646-8f85-fe2226354042 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:33.661616 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501238f7-ba3d-4646-8f85-fe2226354042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:33.689541 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-501238f7-ba3d-4646-8f85-fe2226354042 None None] MFA Rules not processed for user `4df9cba16cec44d3ab51d8f17258db75`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:33.692481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-501238f7-ba3d-4646-8f85-fe2226354042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:33.837203 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1246/2508] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:34.219026 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213bd47-a68e-4312-af98-42121ae1e1c4 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:34.236991 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:34.286717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501238f7-ba3d-4646-8f85-fe2226354042 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:34.289044 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-501238f7-ba3d-4646-8f85-fe2226354042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:34.353213 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213bd47-a68e-4312-af98-42121ae1e1c4 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:34.357143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9bc31-0d94-4901-be0a-d66c130ab938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:34.357814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9bc31-0d94-4901-be0a-d66c130ab938 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:34.358160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9bc31-0d94-4901-be0a-d66c130ab938 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:34.358440 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9bc31-0d94-4901-be0a-d66c130ab938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:34.432491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501238f7-ba3d-4646-8f85-fe2226354042 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:34.442007 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9bc31-0d94-4901-be0a-d66c130ab938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:34.446275 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9bc31-0d94-4901-be0a-d66c130ab938 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:34.447768 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5e769-e4ff-4388-b2da-d66e5cdf127b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:34.449381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e769-e4ff-4388-b2da-d66e5cdf127b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:34.449767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e769-e4ff-4388-b2da-d66e5cdf127b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:34.450148 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e769-e4ff-4388-b2da-d66e5cdf127b admin admin] PATH_INFO: `/v3/users/50a5ac8297ee4e3ca04ba29cc25263c3` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:34.452189 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5e769-e4ff-4388-b2da-d66e5cdf127b admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a5ac8297ee4e3ca04ba29cc25263c3)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:34.454727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5e769-e4ff-4388-b2da-d66e5cdf127b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:34.485477 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1263/2509] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:34.545066 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:34.568064 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-13c5e769-e4ff-4388-b2da-d66e5cdf127b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a5ac8297ee4e3ca04ba29cc25263c3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:34.633771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-13c5e769-e4ff-4388-b2da-d66e5cdf127b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a5ac8297ee4e3ca04ba29cc25263c3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:34.637425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-13c5e769-e4ff-4388-b2da-d66e5cdf127b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a5ac8297ee4e3ca04ba29cc25263c3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:34.652947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-13c5e769-e4ff-4388-b2da-d66e5cdf127b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a5ac8297ee4e3ca04ba29cc25263c3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:34.714118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-13c5e769-e4ff-4388-b2da-d66e5cdf127b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a5ac8297ee4e3ca04ba29cc25263c3'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:34.769145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1247/2510] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:34 2022] DELETE /identity/v3/users/50a5ac8297ee4e3ca04ba29cc25263c3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:34.773711 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487efb3e-8237-4fb2-b3f5-ee9d72ab3b71 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:34.774208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487efb3e-8237-4fb2-b3f5-ee9d72ab3b71 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:34.774495 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487efb3e-8237-4fb2-b3f5-ee9d72ab3b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:34.835660 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-487efb3e-8237-4fb2-b3f5-ee9d72ab3b71 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:34.845136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-487efb3e-8237-4fb2-b3f5-ee9d72ab3b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:35.086540 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1264/2511] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:35.148651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5e769-e4ff-4388-b2da-d66e5cdf127b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:35.150202 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-13c5e769-e4ff-4388-b2da-d66e5cdf127b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:35.390241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5e769-e4ff-4388-b2da-d66e5cdf127b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:35.406261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10ab35-0342-4590-b01f-6c22345e96d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:35.406947 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10ab35-0342-4590-b01f-6c22345e96d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:35.407235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10ab35-0342-4590-b01f-6c22345e96d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:35.407504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10ab35-0342-4590-b01f-6c22345e96d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:35.429236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10ab35-0342-4590-b01f-6c22345e96d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:35.432232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10ab35-0342-4590-b01f-6c22345e96d1 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:35.459936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1248/2512] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:36.994934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487efb3e-8237-4fb2-b3f5-ee9d72ab3b71 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:36.996564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-487efb3e-8237-4fb2-b3f5-ee9d72ab3b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:37.035887 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487efb3e-8237-4fb2-b3f5-ee9d72ab3b71 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:37.048549 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e477e00-1137-4323-a9c8-c8af36afdf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:37.050792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e477e00-1137-4323-a9c8-c8af36afdf05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:37.051069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e477e00-1137-4323-a9c8-c8af36afdf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:37.052373 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e477e00-1137-4323-a9c8-c8af36afdf05 admin admin] PATH_INFO: `/v3/projects/b1018acd67534b9d8ebd4725e9228c92` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:37.054127 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e477e00-1137-4323-a9c8-c8af36afdf05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1018acd67534b9d8ebd4725e9228c92)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:37.057643 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e477e00-1137-4323-a9c8-c8af36afdf05 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:37.258835 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6e477e00-1137-4323-a9c8-c8af36afdf05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1018acd67534b9d8ebd4725e9228c92', 'request_id': 'req-6e477e00-1137-4323-a9c8-c8af36afdf05'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:37.274969 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6e477e00-1137-4323-a9c8-c8af36afdf05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1018acd67534b9d8ebd4725e9228c92', 'request_id': 'req-6e477e00-1137-4323-a9c8-c8af36afdf05'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:37.278015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:37.285790 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6e477e00-1137-4323-a9c8-c8af36afdf05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1018acd67534b9d8ebd4725e9228c92', 'request_id': 'req-6e477e00-1137-4323-a9c8-c8af36afdf05'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:37.320598 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6e477e00-1137-4323-a9c8-c8af36afdf05 admin admin] The token cache is being invalidate because project b1018acd67534b9d8ebd4725e9228c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:37.320898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6e477e00-1137-4323-a9c8-c8af36afdf05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:37.321587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6e477e00-1137-4323-a9c8-c8af36afdf05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:37.323677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1265/2513] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:36 2022] DELETE /identity/v3/projects/b1018acd67534b9d8ebd4725e9228c92 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:37.328640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839fb87-f9fe-4c32-9f12-1d09a9ccdb0e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:37.329621 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839fb87-f9fe-4c32-9f12-1d09a9ccdb0e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:37.330121 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839fb87-f9fe-4c32-9f12-1d09a9ccdb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:37.365714 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e477e00-1137-4323-a9c8-c8af36afdf05 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:37.367445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6e477e00-1137-4323-a9c8-c8af36afdf05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:37.381179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f839fb87-f9fe-4c32-9f12-1d09a9ccdb0e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:37.382419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f839fb87-f9fe-4c32-9f12-1d09a9ccdb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:37.505765 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e477e00-1137-4323-a9c8-c8af36afdf05 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:37.512376 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d6183-f5af-41c7-aed8-67beba31ee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:37.513284 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6183-f5af-41c7-aed8-67beba31ee4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:37.513568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6183-f5af-41c7-aed8-67beba31ee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:37.513843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6183-f5af-41c7-aed8-67beba31ee4b admin admin] PATH_INFO: `/v3/users/533f30f382d74be58d1cee632bceb942` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:37.516560 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d6183-f5af-41c7-aed8-67beba31ee4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=533f30f382d74be58d1cee632bceb942)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:37.519764 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d6183-f5af-41c7-aed8-67beba31ee4b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:37.536843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1249/2514] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:37.545178 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4650274-879f-4e6e-a740-7413976fd0bd None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:37.545633 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4650274-879f-4e6e-a740-7413976fd0bd None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:37.546195 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4650274-879f-4e6e-a740-7413976fd0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:37.569638 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a4650274-879f-4e6e-a740-7413976fd0bd None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:37.571239 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a4650274-879f-4e6e-a740-7413976fd0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:37.587411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1250/2515] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:37.591639 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4650274-879f-4e6e-a740-7413976fd0bd None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:37.599107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-861d6183-f5af-41c7-aed8-67beba31ee4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533f30f382d74be58d1cee632bceb942'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:37.600690 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-861d6183-f5af-41c7-aed8-67beba31ee4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533f30f382d74be58d1cee632bceb942'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:37.601903 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-861d6183-f5af-41c7-aed8-67beba31ee4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533f30f382d74be58d1cee632bceb942'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:37.602888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4650274-879f-4e6e-a740-7413976fd0bd None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:37.617730 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b919-fe39-4108-811b-840e77c0c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:37.618679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b919-fe39-4108-811b-840e77c0c8ea admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:37.618849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b919-fe39-4108-811b-840e77c0c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:37.619148 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b919-fe39-4108-811b-840e77c0c8ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:37.620044 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09b919-fe39-4108-811b-840e77c0c8ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:32:37.620363 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09b919-fe39-4108-811b-840e77c0c8ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:37.622041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09b919-fe39-4108-811b-840e77c0c8ea admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:37.640803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-861d6183-f5af-41c7-aed8-67beba31ee4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533f30f382d74be58d1cee632bceb942'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:37.656549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1251/2516] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:32:37.669337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-861d6183-f5af-41c7-aed8-67beba31ee4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533f30f382d74be58d1cee632bceb942'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:37.672929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b919-fe39-4108-811b-840e77c0c8ea admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:37.677586 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ec09b919-fe39-4108-811b-840e77c0c8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:37.707259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b919-fe39-4108-811b-840e77c0c8ea admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:37.720046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1266/2517] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:37 2022] DELETE /identity/v3/users/533f30f382d74be58d1cee632bceb942 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:37.721828 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d49125-2c49-4344-9881-7e93703c284e None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:37.722121 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d49125-2c49-4344-9881-7e93703c284e None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:37.722422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d49125-2c49-4344-9881-7e93703c284e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:37.756968 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f0d49125-2c49-4344-9881-7e93703c284e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:37.758370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f0d49125-2c49-4344-9881-7e93703c284e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:37.819294 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:37.854980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490e952-743c-4c04-87a8-7e0855d3c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:37.858670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490e952-743c-4c04-87a8-7e0855d3c898 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:37.859035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490e952-743c-4c04-87a8-7e0855d3c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:37.859913 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490e952-743c-4c04-87a8-7e0855d3c898 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:37.863840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490e952-743c-4c04-87a8-7e0855d3c898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:37.867175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490e952-743c-4c04-87a8-7e0855d3c898 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:37.872714 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1267/2518] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:37.885550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d49125-2c49-4344-9881-7e93703c284e None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:37.888400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f0d49125-2c49-4344-9881-7e93703c284e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:37.899848 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:37.944459 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1252/2519] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:37 2022] POST /identity/v3/projects => generated 389 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:37.948805 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490e952-743c-4c04-87a8-7e0855d3c898 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:38.071353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490e952-743c-4c04-87a8-7e0855d3c898 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:38.090126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc6317-7174-4696-a55f-f202d360201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:38.091960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc6317-7174-4696-a55f-f202d360201e admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:38.092890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc6317-7174-4696-a55f-f202d360201e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:38.093015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d49125-2c49-4344-9881-7e93703c284e None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:38.093926 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc6317-7174-4696-a55f-f202d360201e admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:38.095744 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc6317-7174-4696-a55f-f202d360201e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:38.103717 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc6317-7174-4696-a55f-f202d360201e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:38.169745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1253/2520] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:37 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:38.170733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc6317-7174-4696-a55f-f202d360201e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:38.187144 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc6317-7174-4696-a55f-f202d360201e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:38.204499 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535784d-e626-49ba-87d9-bb12717bbccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:38.208982 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535784d-e626-49ba-87d9-bb12717bbccd admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:38.209276 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535784d-e626-49ba-87d9-bb12717bbccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:38.209599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535784d-e626-49ba-87d9-bb12717bbccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:38.210333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535784d-e626-49ba-87d9-bb12717bbccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:38.227154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535784d-e626-49ba-87d9-bb12717bbccd admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:38.267639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6158e41-d06e-4c59-8e46-4e5c14b1ab82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:38.268455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6158e41-d06e-4c59-8e46-4e5c14b1ab82 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:38.268739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6158e41-d06e-4c59-8e46-4e5c14b1ab82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:38.269019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6158e41-d06e-4c59-8e46-4e5c14b1ab82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:38.279140 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1254/2521] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:38.283132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535784d-e626-49ba-87d9-bb12717bbccd admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:38.292604 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6158e41-d06e-4c59-8e46-4e5c14b1ab82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:38.294126 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6158e41-d06e-4c59-8e46-4e5c14b1ab82 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:38.313527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535784d-e626-49ba-87d9-bb12717bbccd admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:38.323710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1268/2522] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:38.333347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e4389-069b-4964-86ae-322f2c70811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:38.334044 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e4389-069b-4964-86ae-322f2c70811b admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:38.334325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e4389-069b-4964-86ae-322f2c70811b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:38.334593 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e4389-069b-4964-86ae-322f2c70811b admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:38.338790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e4389-069b-4964-86ae-322f2c70811b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:38.344983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e4389-069b-4964-86ae-322f2c70811b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:38.371713 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6158e41-d06e-4c59-8e46-4e5c14b1ab82 service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:38.387557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6158e41-d06e-4c59-8e46-4e5c14b1ab82 service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:38.387847 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1255/2523] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:38.399508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15ed2d-2124-444e-83a7-bfcf835ddb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:38.400881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15ed2d-2124-444e-83a7-bfcf835ddb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:38.401205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15ed2d-2124-444e-83a7-bfcf835ddb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:38.401491 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15ed2d-2124-444e-83a7-bfcf835ddb41 admin admin] PATH_INFO: `/v3/projects/3fde6be72f8a4c3785e04015c0bfe6e3/users/45cc4cc44f1f411ab810da92d039d21b/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:38.442148 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15ed2d-2124-444e-83a7-bfcf835ddb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fde6be72f8a4c3785e04015c0bfe6e3, user_id=45cc4cc44f1f411ab810da92d039d21b, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:38.445551 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15ed2d-2124-444e-83a7-bfcf835ddb41 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:38.478938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1269/2524] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:38 2022] PUT /identity/v3/projects/3fde6be72f8a4c3785e04015c0bfe6e3/users/45cc4cc44f1f411ab810da92d039d21b/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:32:38.492394 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41c202-c913-417b-aaa8-533b16563f08 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:38.492680 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41c202-c913-417b-aaa8-533b16563f08 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:38.492953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41c202-c913-417b-aaa8-533b16563f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:38.539548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-5e41c202-c913-417b-aaa8-533b16563f08 None None] MFA Rules not processed for user `45cc4cc44f1f411ab810da92d039d21b`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:38.541430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5e41c202-c913-417b-aaa8-533b16563f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:38.625379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1256/2525] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:38.637679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15ed2d-2124-444e-83a7-bfcf835ddb41 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:38.643982 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ed15ed2d-2124-444e-83a7-bfcf835ddb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:38.731342 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15ed2d-2124-444e-83a7-bfcf835ddb41 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:38.743267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709d2e7-54e9-4bfa-8317-7a6ea8e3a816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:38.746625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709d2e7-54e9-4bfa-8317-7a6ea8e3a816 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:38.747066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709d2e7-54e9-4bfa-8317-7a6ea8e3a816 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:38.747570 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709d2e7-54e9-4bfa-8317-7a6ea8e3a816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:38.775206 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41c202-c913-417b-aaa8-533b16563f08 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:38.777111 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5e41c202-c913-417b-aaa8-533b16563f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:38.777763 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709d2e7-54e9-4bfa-8317-7a6ea8e3a816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:38.785954 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709d2e7-54e9-4bfa-8317-7a6ea8e3a816 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:38.825616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1270/2526] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:38.848167 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:38.901609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41c202-c913-417b-aaa8-533b16563f08 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:38.908342 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4902068-d2be-4079-8b54-d7a12894a03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:38.909733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902068-d2be-4079-8b54-d7a12894a03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:38.910198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902068-d2be-4079-8b54-d7a12894a03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:38.910625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902068-d2be-4079-8b54-d7a12894a03e admin admin] PATH_INFO: `/v3/projects/1448801bfbe84213aa62de48670ec4d9` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:38.912099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4902068-d2be-4079-8b54-d7a12894a03e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1448801bfbe84213aa62de48670ec4d9)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:38.914474 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4902068-d2be-4079-8b54-d7a12894a03e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:39.003891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c4902068-d2be-4079-8b54-d7a12894a03e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1448801bfbe84213aa62de48670ec4d9', 'request_id': 'req-c4902068-d2be-4079-8b54-d7a12894a03e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:39.014481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c4902068-d2be-4079-8b54-d7a12894a03e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1448801bfbe84213aa62de48670ec4d9', 'request_id': 'req-c4902068-d2be-4079-8b54-d7a12894a03e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:39.029112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c4902068-d2be-4079-8b54-d7a12894a03e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1448801bfbe84213aa62de48670ec4d9', 'request_id': 'req-c4902068-d2be-4079-8b54-d7a12894a03e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:39.048157 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c4902068-d2be-4079-8b54-d7a12894a03e admin admin] The token cache is being invalidate because project 1448801bfbe84213aa62de48670ec4d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:39.048459 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c4902068-d2be-4079-8b54-d7a12894a03e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:39.051575 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c4902068-d2be-4079-8b54-d7a12894a03e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:39.054404 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1257/2527] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:38 2022] DELETE /identity/v3/projects/1448801bfbe84213aa62de48670ec4d9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:39.059906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd083e-1888-4ad8-96b9-28cf79587f1a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:39.060294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd083e-1888-4ad8-96b9-28cf79587f1a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:39.060578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd083e-1888-4ad8-96b9-28cf79587f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:39.098905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1ecd083e-1888-4ad8-96b9-28cf79587f1a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:39.102716 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1ecd083e-1888-4ad8-96b9-28cf79587f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:39.185275 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:39.216537 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1271/2528] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:39.226634 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0eca6-5c21-4cb9-a581-b259676dd1ce None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:39.228047 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0eca6-5c21-4cb9-a581-b259676dd1ce None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:39.228047 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0eca6-5c21-4cb9-a581-b259676dd1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:39.259661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-8df0eca6-5c21-4cb9-a581-b259676dd1ce None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:39.261247 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8df0eca6-5c21-4cb9-a581-b259676dd1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:39.282337 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1258/2529] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:39.284231 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd083e-1888-4ad8-96b9-28cf79587f1a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:39.316046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd083e-1888-4ad8-96b9-28cf79587f1a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:39.325636 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6d3c6-b4ab-4195-98cf-475c8b247f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:39.332364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6d3c6-b4ab-4195-98cf-475c8b247f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:39.338545 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6d3c6-b4ab-4195-98cf-475c8b247f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:39.339588 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6d3c6-b4ab-4195-98cf-475c8b247f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:39.340496 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6d3c6-b4ab-4195-98cf-475c8b247f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:32:39.346306 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6d3c6-b4ab-4195-98cf-475c8b247f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:39.351031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6d3c6-b4ab-4195-98cf-475c8b247f11 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:39.422001 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1272/2530] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:32:39.425597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0eca6-5c21-4cb9-a581-b259676dd1ce None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:39.436083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0eca6-5c21-4cb9-a581-b259676dd1ce None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:39.461403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde45e2-9670-4f28-92ec-fd89f542cb94 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:39.461643 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3db01-361d-49ff-80ec-c1adfd528ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:39.461764 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3db01-361d-49ff-80ec-c1adfd528ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:39.462042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3db01-361d-49ff-80ec-c1adfd528ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:39.462317 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3db01-361d-49ff-80ec-c1adfd528ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:39.463287 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde45e2-9670-4f28-92ec-fd89f542cb94 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:39.464032 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde45e2-9670-4f28-92ec-fd89f542cb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:39.465823 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3db01-361d-49ff-80ec-c1adfd528ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:39.467990 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3db01-361d-49ff-80ec-c1adfd528ce0 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:39.516230 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8fde45e2-9670-4f28-92ec-fd89f542cb94 None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:39.520955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8fde45e2-9670-4f28-92ec-fd89f542cb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:39.556629 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1259/2531] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:39 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:39.560766 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3db01-361d-49ff-80ec-c1adfd528ce0 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:39.711238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1273/2532] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 08:32:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:39.717508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3db01-361d-49ff-80ec-c1adfd528ce0 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:39.726106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60959c7-c06c-43c9-a620-0c7078a3bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:39.726867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60959c7-c06c-43c9-a620-0c7078a3bf3b admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:39.727151 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60959c7-c06c-43c9-a620-0c7078a3bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:39.728033 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60959c7-c06c-43c9-a620-0c7078a3bf3b admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:39.728704 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60959c7-c06c-43c9-a620-0c7078a3bf3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:39.731168 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60959c7-c06c-43c9-a620-0c7078a3bf3b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:39.770351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde45e2-9670-4f28-92ec-fd89f542cb94 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:39.771967 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1260/2533] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:39 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:39.773247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8fde45e2-9670-4f28-92ec-fd89f542cb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:39.776498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60959c7-c06c-43c9-a620-0c7078a3bf3b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:39.792353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60959c7-c06c-43c9-a620-0c7078a3bf3b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:39.820661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07efc2-3f25-4af2-b00a-6ea821cdf624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:39.821364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07efc2-3f25-4af2-b00a-6ea821cdf624 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:39.821645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07efc2-3f25-4af2-b00a-6ea821cdf624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:39.821943 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07efc2-3f25-4af2-b00a-6ea821cdf624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:39.822674 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07efc2-3f25-4af2-b00a-6ea821cdf624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:39.825100 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07efc2-3f25-4af2-b00a-6ea821cdf624 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:39.850329 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1261/2534] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:39.855361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07efc2-3f25-4af2-b00a-6ea821cdf624 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:39.863994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:39.880501 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07efc2-3f25-4af2-b00a-6ea821cdf624 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:39.891936 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254aaacf-5890-47e9-b0eb-9e92f0be9c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:39.892763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254aaacf-5890-47e9-b0eb-9e92f0be9c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:39.893121 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254aaacf-5890-47e9-b0eb-9e92f0be9c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:39.893485 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254aaacf-5890-47e9-b0eb-9e92f0be9c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:39.894294 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254aaacf-5890-47e9-b0eb-9e92f0be9c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:39.896958 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254aaacf-5890-47e9-b0eb-9e92f0be9c29 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:39.911181 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1262/2535] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:39.915845 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254aaacf-5890-47e9-b0eb-9e92f0be9c29 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:39.927840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254aaacf-5890-47e9-b0eb-9e92f0be9c29 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:39.935647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48c17f-5499-4a54-ae4e-ab249330b8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:39.936771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48c17f-5499-4a54-ae4e-ab249330b8a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:39.937374 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48c17f-5499-4a54-ae4e-ab249330b8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:39.937787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48c17f-5499-4a54-ae4e-ab249330b8a2 admin admin] PATH_INFO: `/v3/projects/8cd4ba6979354543a3cbab1e8154ce07/users/0f16f7a5f9c140c19637a4c63cddaed7/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:39.950546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde45e2-9670-4f28-92ec-fd89f542cb94 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:39.974376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48c17f-5499-4a54-ae4e-ab249330b8a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd4ba6979354543a3cbab1e8154ce07, user_id=0f16f7a5f9c140c19637a4c63cddaed7, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:39.977277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48c17f-5499-4a54-ae4e-ab249330b8a2 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:40.000393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1263/2536] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:39 2022] PUT /identity/v3/projects/8cd4ba6979354543a3cbab1e8154ce07/users/0f16f7a5f9c140c19637a4c63cddaed7/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:40.009031 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b1bba-46af-435f-9da4-1d68b64b7e64 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:40.009474 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b1bba-46af-435f-9da4-1d68b64b7e64 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:40.010449 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b1bba-46af-435f-9da4-1d68b64b7e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:40.030401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-db4b1bba-46af-435f-9da4-1d68b64b7e64 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:40.031681 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-db4b1bba-46af-435f-9da4-1d68b64b7e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:40.038859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d691ff-efba-494f-aade-2634c54ef3b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:40.040203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d691ff-efba-494f-aade-2634c54ef3b1 service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:40.040203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d691ff-efba-494f-aade-2634c54ef3b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:40.040539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d691ff-efba-494f-aade-2634c54ef3b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:40.076370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:40.171433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1264/2537] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:40.188815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d691ff-efba-494f-aade-2634c54ef3b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:40.194766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d691ff-efba-494f-aade-2634c54ef3b1 service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:40.219281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b1bba-46af-435f-9da4-1d68b64b7e64 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:40.221382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-db4b1bba-46af-435f-9da4-1d68b64b7e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:40.223347 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1274/2538] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:32:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 08:32:40.422648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b1bba-46af-435f-9da4-1d68b64b7e64 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:40.434769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc5701-6e97-4147-93c5-d485691d523d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:40.436500 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc5701-6e97-4147-93c5-d485691d523d service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:40.436993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc5701-6e97-4147-93c5-d485691d523d service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:40.437493 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc5701-6e97-4147-93c5-d485691d523d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:40.474770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc5701-6e97-4147-93c5-d485691d523d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:40.478372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc5701-6e97-4147-93c5-d485691d523d service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:40.509768 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1265/2539] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:32:40.786134 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d691ff-efba-494f-aade-2634c54ef3b1 service swift] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:40.788605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-28d691ff-efba-494f-aade-2634c54ef3b1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:40.831859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d691ff-efba-494f-aade-2634c54ef3b1 service swift] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:40.855629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965a1fd-4f11-48de-bab9-7df7c12d7b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:40.855629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965a1fd-4f11-48de-bab9-7df7c12d7b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:40.855629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965a1fd-4f11-48de-bab9-7df7c12d7b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:40.855629 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965a1fd-4f11-48de-bab9-7df7c12d7b25 admin admin] PATH_INFO: `/v3/users/1f9b240932814d14a174e8ff8ad6105d` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:40.861144 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965a1fd-4f11-48de-bab9-7df7c12d7b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9b240932814d14a174e8ff8ad6105d)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:40.872868 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965a1fd-4f11-48de-bab9-7df7c12d7b25 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:41.041746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c965a1fd-4f11-48de-bab9-7df7c12d7b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9b240932814d14a174e8ff8ad6105d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:41.043359 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c965a1fd-4f11-48de-bab9-7df7c12d7b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9b240932814d14a174e8ff8ad6105d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:41.045313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c965a1fd-4f11-48de-bab9-7df7c12d7b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9b240932814d14a174e8ff8ad6105d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:41.058888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c965a1fd-4f11-48de-bab9-7df7c12d7b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9b240932814d14a174e8ff8ad6105d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:41.081354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c965a1fd-4f11-48de-bab9-7df7c12d7b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9b240932814d14a174e8ff8ad6105d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:41.114128 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1275/2540] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:40 2022] DELETE /identity/v3/users/1f9b240932814d14a174e8ff8ad6105d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:41.116241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af080a-6843-4a78-a87b-976ea78a9f58 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:41.116532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af080a-6843-4a78-a87b-976ea78a9f58 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:41.116849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af080a-6843-4a78-a87b-976ea78a9f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:41.160407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-86af080a-6843-4a78-a87b-976ea78a9f58 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:41.166516 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-86af080a-6843-4a78-a87b-976ea78a9f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:41.355442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1266/2541] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:32:41.446815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965a1fd-4f11-48de-bab9-7df7c12d7b25 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:41.463568 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c965a1fd-4f11-48de-bab9-7df7c12d7b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:41.655476 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965a1fd-4f11-48de-bab9-7df7c12d7b25 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:41.680900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67b1ca-eaf6-441b-bf32-84891795031b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:41.684584 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67b1ca-eaf6-441b-bf32-84891795031b service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:41.684934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67b1ca-eaf6-441b-bf32-84891795031b service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:41.685221 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67b1ca-eaf6-441b-bf32-84891795031b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:41.707988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67b1ca-eaf6-441b-bf32-84891795031b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:41.710120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67b1ca-eaf6-441b-bf32-84891795031b service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:41.758837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1276/2542] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:42.433280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f63bd-be4d-42b7-a48c-6ce4d0abdfb3 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:42.433280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f63bd-be4d-42b7-a48c-6ce4d0abdfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:42.433280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f63bd-be4d-42b7-a48c-6ce4d0abdfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:42.496108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:42.506154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1a3f63bd-be4d-42b7-a48c-6ce4d0abdfb3 None None] MFA Rules not processed for user `e97d51dc7c874ac7a29250553ff6caa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:42.507580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1a3f63bd-be4d-42b7-a48c-6ce4d0abdfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:42.690503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1267/2543] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:42.955185 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67b1ca-eaf6-441b-bf32-84891795031b service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:42.957791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2e67b1ca-eaf6-441b-bf32-84891795031b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:43.006471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67b1ca-eaf6-441b-bf32-84891795031b service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:43.099008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e62a05-2513-49b4-997c-9f27ed228757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:43.103286 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e62a05-2513-49b4-997c-9f27ed228757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:43.103778 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e62a05-2513-49b4-997c-9f27ed228757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:43.104226 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e62a05-2513-49b4-997c-9f27ed228757 admin admin] PATH_INFO: `/v3/projects/d23843f5b8c44487919706253ce8046d` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:43.105751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e62a05-2513-49b4-997c-9f27ed228757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d23843f5b8c44487919706253ce8046d)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:43.112439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e62a05-2513-49b4-997c-9f27ed228757 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:43.219304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:43.243959 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41e62a05-2513-49b4-997c-9f27ed228757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd23843f5b8c44487919706253ce8046d', 'request_id': 'req-41e62a05-2513-49b4-997c-9f27ed228757'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:43.260340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41e62a05-2513-49b4-997c-9f27ed228757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd23843f5b8c44487919706253ce8046d', 'request_id': 'req-41e62a05-2513-49b4-997c-9f27ed228757'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:43.270747 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41e62a05-2513-49b4-997c-9f27ed228757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd23843f5b8c44487919706253ce8046d', 'request_id': 'req-41e62a05-2513-49b4-997c-9f27ed228757'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:43.295350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41e62a05-2513-49b4-997c-9f27ed228757 admin admin] The token cache is being invalidate because project d23843f5b8c44487919706253ce8046d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:43.295953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41e62a05-2513-49b4-997c-9f27ed228757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:43.296812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-41e62a05-2513-49b4-997c-9f27ed228757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:43.299502 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1277/2544] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:42 2022] DELETE /identity/v3/projects/d23843f5b8c44487919706253ce8046d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:43.303962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f63bd-be4d-42b7-a48c-6ce4d0abdfb3 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:43.333020 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f63bd-be4d-42b7-a48c-6ce4d0abdfb3 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:43.565423 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea9387-4e11-4f54-9d2a-bb3698664deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:43.567259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea9387-4e11-4f54-9d2a-bb3698664deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:43.567813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea9387-4e11-4f54-9d2a-bb3698664deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:43.568464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea9387-4e11-4f54-9d2a-bb3698664deb admin admin] PATH_INFO: `/v3/users/895eafba2f854764879b276ab99a09d1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:43.572272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea9387-4e11-4f54-9d2a-bb3698664deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=895eafba2f854764879b276ab99a09d1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:43.582679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea9387-4e11-4f54-9d2a-bb3698664deb admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:43.729015 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-73ea9387-4e11-4f54-9d2a-bb3698664deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895eafba2f854764879b276ab99a09d1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:43.762645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-73ea9387-4e11-4f54-9d2a-bb3698664deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895eafba2f854764879b276ab99a09d1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:43.764723 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-73ea9387-4e11-4f54-9d2a-bb3698664deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895eafba2f854764879b276ab99a09d1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:43.766226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-73ea9387-4e11-4f54-9d2a-bb3698664deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895eafba2f854764879b276ab99a09d1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:43.796127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-73ea9387-4e11-4f54-9d2a-bb3698664deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895eafba2f854764879b276ab99a09d1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:43.843079 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1268/2545] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:43 2022] DELETE /identity/v3/users/895eafba2f854764879b276ab99a09d1 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:44.594254 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e62a05-2513-49b4-997c-9f27ed228757 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:44.596243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-41e62a05-2513-49b4-997c-9f27ed228757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:44.636669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e62a05-2513-49b4-997c-9f27ed228757 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:44.811227 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:44.812173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:44.812462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:44.812741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a admin admin] PATH_INFO: `/v3/projects/405298601f2c427aaac5e9a893cc7ae1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:44.819232 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a admin admin] RBAC: Authorizing `identity:delete_project(project_id=405298601f2c427aaac5e9a893cc7ae1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:44.820920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:44.948961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405298601f2c427aaac5e9a893cc7ae1', 'request_id': 'req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:44.979516 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405298601f2c427aaac5e9a893cc7ae1', 'request_id': 'req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:44.989679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405298601f2c427aaac5e9a893cc7ae1', 'request_id': 'req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:45.027006 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a admin admin] The token cache is being invalidate because project 405298601f2c427aaac5e9a893cc7ae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:45.027320 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:45.027889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:45.029866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1278/2546] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:44 2022] DELETE /identity/v3/projects/405298601f2c427aaac5e9a893cc7ae1 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:51.231907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7fae6-7d7e-419c-8cce-725b57ed58d9 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:51.232842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7fae6-7d7e-419c-8cce-725b57ed58d9 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:51.234964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7fae6-7d7e-419c-8cce-725b57ed58d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:51.267686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f5d7fae6-7d7e-419c-8cce-725b57ed58d9 None None] MFA Rules not processed for user `0f16f7a5f9c140c19637a4c63cddaed7`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:51.269242 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f5d7fae6-7d7e-419c-8cce-725b57ed58d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:51.275556 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:51.396108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1269/2547] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:51.403124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7fae6-7d7e-419c-8cce-725b57ed58d9 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:51.404269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:51.405721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f5d7fae6-7d7e-419c-8cce-725b57ed58d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:51.405985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:51.498853 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:51.510142 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7fae6-7d7e-419c-8cce-725b57ed58d9 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:51.519151 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90253239-0d12-429a-bf1c-e2e6f6ad435f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:51.520272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90253239-0d12-429a-bf1c-e2e6f6ad435f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:51.520705 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90253239-0d12-429a-bf1c-e2e6f6ad435f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:51.521025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90253239-0d12-429a-bf1c-e2e6f6ad435f admin admin] PATH_INFO: `/v3/users/45cc4cc44f1f411ab810da92d039d21b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:51.522556 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90253239-0d12-429a-bf1c-e2e6f6ad435f admin admin] RBAC: Authorizing `identity:delete_user(user_id=45cc4cc44f1f411ab810da92d039d21b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:51.527317 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90253239-0d12-429a-bf1c-e2e6f6ad435f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:51.541928 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043482f9-5fd2-4c56-b0f1-acfe8ba6788a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:51.555453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936500d9-d3cb-45c7-abd9-b707718181ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:51.556483 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936500d9-d3cb-45c7-abd9-b707718181ac admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:51.557675 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936500d9-d3cb-45c7-abd9-b707718181ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:51.558034 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936500d9-d3cb-45c7-abd9-b707718181ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:51.560656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936500d9-d3cb-45c7-abd9-b707718181ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:51.564139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936500d9-d3cb-45c7-abd9-b707718181ac admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:51.603039 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-90253239-0d12-429a-bf1c-e2e6f6ad435f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45cc4cc44f1f411ab810da92d039d21b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.622567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-90253239-0d12-429a-bf1c-e2e6f6ad435f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45cc4cc44f1f411ab810da92d039d21b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.623588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-90253239-0d12-429a-bf1c-e2e6f6ad435f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45cc4cc44f1f411ab810da92d039d21b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.624300 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-90253239-0d12-429a-bf1c-e2e6f6ad435f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45cc4cc44f1f411ab810da92d039d21b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.638640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-90253239-0d12-429a-bf1c-e2e6f6ad435f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45cc4cc44f1f411ab810da92d039d21b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.639396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1279/2548] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:51 2022] POST /identity/v3/projects => generated 373 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:32:51.640158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936500d9-d3cb-45c7-abd9-b707718181ac admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:51.647037 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-936500d9-d3cb-45c7-abd9-b707718181ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:51.674504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1270/2549] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:51 2022] DELETE /identity/v3/users/45cc4cc44f1f411ab810da92d039d21b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:32:51.683321 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4668a8-d2bf-46fd-9037-b99f7fb88520 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:51.684370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4668a8-d2bf-46fd-9037-b99f7fb88520 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:51.684781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4668a8-d2bf-46fd-9037-b99f7fb88520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:51.711697 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0d4668a8-d2bf-46fd-9037-b99f7fb88520 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:51.713221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0d4668a8-d2bf-46fd-9037-b99f7fb88520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:51.739297 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:51.811143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1271/2550] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:51.830412 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4668a8-d2bf-46fd-9037-b99f7fb88520 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:51.832441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0d4668a8-d2bf-46fd-9037-b99f7fb88520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:51.855684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936500d9-d3cb-45c7-abd9-b707718181ac admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:51.863746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeef542-29e3-4794-97f3-870b46e5112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:51.864710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeef542-29e3-4794-97f3-870b46e5112a admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:51.865381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeef542-29e3-4794-97f3-870b46e5112a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:51.865811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeef542-29e3-4794-97f3-870b46e5112a admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:51.866742 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeef542-29e3-4794-97f3-870b46e5112a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:51.870505 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeef542-29e3-4794-97f3-870b46e5112a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:51.920283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1280/2551] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:51 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:51.920522 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4668a8-d2bf-46fd-9037-b99f7fb88520 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:51.920753 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ae39a-1db9-4998-b17b-7803af63aa8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:51.921261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ae39a-1db9-4998-b17b-7803af63aa8f service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:51.921555 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ae39a-1db9-4998-b17b-7803af63aa8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:51.921846 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ae39a-1db9-4998-b17b-7803af63aa8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:51.930977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeef542-29e3-4794-97f3-870b46e5112a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:51.945081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ae39a-1db9-4998-b17b-7803af63aa8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:51.945551 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeef542-29e3-4794-97f3-870b46e5112a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:51.947036 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ae39a-1db9-4998-b17b-7803af63aa8f service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:51.951468 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e49a0-6428-4768-9f39-f819336857a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:51.952201 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e49a0-6428-4768-9f39-f819336857a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:51.952549 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e49a0-6428-4768-9f39-f819336857a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:51.953147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e49a0-6428-4768-9f39-f819336857a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:51.953811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e49a0-6428-4768-9f39-f819336857a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:51.957834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e49a0-6428-4768-9f39-f819336857a5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:51.979269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1272/2552] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:52.027694 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1281/2553] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:52.033889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ae39a-1db9-4998-b17b-7803af63aa8f service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:52.052710 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ae39a-1db9-4998-b17b-7803af63aa8f service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:52.058068 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952344dd-9f0a-4e2f-8ca9-d660b08cdf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:52.059433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952344dd-9f0a-4e2f-8ca9-d660b08cdf7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:52.059748 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952344dd-9f0a-4e2f-8ca9-d660b08cdf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:52.065953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952344dd-9f0a-4e2f-8ca9-d660b08cdf7e admin admin] PATH_INFO: `/v3/projects/7965ed5c59c048ae9aaf025fc5114ec8/users/bafec8a6d8ba44fca6a51fd5730bfadc/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:52.090441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952344dd-9f0a-4e2f-8ca9-d660b08cdf7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7965ed5c59c048ae9aaf025fc5114ec8, user_id=bafec8a6d8ba44fca6a51fd5730bfadc, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:52.093052 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952344dd-9f0a-4e2f-8ca9-d660b08cdf7e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:52.124617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1273/2554] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:52 2022] PUT /identity/v3/projects/7965ed5c59c048ae9aaf025fc5114ec8/users/bafec8a6d8ba44fca6a51fd5730bfadc/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:52.129138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e49a0-6428-4768-9f39-f819336857a5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:52.147561 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e49a0-6428-4768-9f39-f819336857a5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:52.362240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae342b0-a283-44bd-b8e0-f62b454fdeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:52.363290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae342b0-a283-44bd-b8e0-f62b454fdeba admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:52.363575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae342b0-a283-44bd-b8e0-f62b454fdeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:52.363902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae342b0-a283-44bd-b8e0-f62b454fdeba admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:52.364992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae342b0-a283-44bd-b8e0-f62b454fdeba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:52.366759 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae342b0-a283-44bd-b8e0-f62b454fdeba admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:52.410530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1282/2555] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:52.414467 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952344dd-9f0a-4e2f-8ca9-d660b08cdf7e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:52.432629 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952344dd-9f0a-4e2f-8ca9-d660b08cdf7e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:52.459175 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb942f0-2afe-4401-8379-fd1c35c45c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:52.460330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb942f0-2afe-4401-8379-fd1c35c45c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:52.462395 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb942f0-2afe-4401-8379-fd1c35c45c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:52.463086 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb942f0-2afe-4401-8379-fd1c35c45c90 admin admin] PATH_INFO: `/v3/projects/7965ed5c59c048ae9aaf025fc5114ec8/users/bafec8a6d8ba44fca6a51fd5730bfadc/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:52.465910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb942f0-2afe-4401-8379-fd1c35c45c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7965ed5c59c048ae9aaf025fc5114ec8, user_id=bafec8a6d8ba44fca6a51fd5730bfadc, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:52.469776 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb942f0-2afe-4401-8379-fd1c35c45c90 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:52.485520 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1274/2556] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:52 2022] PUT /identity/v3/projects/7965ed5c59c048ae9aaf025fc5114ec8/users/bafec8a6d8ba44fca6a51fd5730bfadc/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:52.765841 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae342b0-a283-44bd-b8e0-f62b454fdeba admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:52.768148 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eae342b0-a283-44bd-b8e0-f62b454fdeba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:52.803909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae342b0-a283-44bd-b8e0-f62b454fdeba admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:52.986603 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:53.024633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81da45-5236-4a15-8cfa-5bb8cd029153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:53.025719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81da45-5236-4a15-8cfa-5bb8cd029153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.026098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81da45-5236-4a15-8cfa-5bb8cd029153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.026470 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81da45-5236-4a15-8cfa-5bb8cd029153 admin admin] PATH_INFO: `/v3/projects/3fde6be72f8a4c3785e04015c0bfe6e3` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.027810 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81da45-5236-4a15-8cfa-5bb8cd029153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fde6be72f8a4c3785e04015c0bfe6e3)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:53.029843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81da45-5236-4a15-8cfa-5bb8cd029153 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:53.213881 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba81da45-5236-4a15-8cfa-5bb8cd029153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fde6be72f8a4c3785e04015c0bfe6e3', 'request_id': 'req-ba81da45-5236-4a15-8cfa-5bb8cd029153'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:53.250525 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba81da45-5236-4a15-8cfa-5bb8cd029153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fde6be72f8a4c3785e04015c0bfe6e3', 'request_id': 'req-ba81da45-5236-4a15-8cfa-5bb8cd029153'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:53.264573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba81da45-5236-4a15-8cfa-5bb8cd029153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fde6be72f8a4c3785e04015c0bfe6e3', 'request_id': 'req-ba81da45-5236-4a15-8cfa-5bb8cd029153'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:53.365022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba81da45-5236-4a15-8cfa-5bb8cd029153 admin admin] The token cache is being invalidate because project 3fde6be72f8a4c3785e04015c0bfe6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:53.365619 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba81da45-5236-4a15-8cfa-5bb8cd029153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:53.366732 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ba81da45-5236-4a15-8cfa-5bb8cd029153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:53.385231 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1283/2557] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:52 2022] DELETE /identity/v3/projects/3fde6be72f8a4c3785e04015c0bfe6e3 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:53.389542 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e7345-fc1e-4293-8444-e5dbb607b33f None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.390106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e7345-fc1e-4293-8444-e5dbb607b33f None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.390559 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e7345-fc1e-4293-8444-e5dbb607b33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.441054 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-a78e7345-fc1e-4293-8444-e5dbb607b33f None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:53.446087 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a78e7345-fc1e-4293-8444-e5dbb607b33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:53.709634 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1275/2558] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:53.718043 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104d378-f159-4ee3-9df6-e814330ec655 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.719280 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104d378-f159-4ee3-9df6-e814330ec655 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.719965 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104d378-f159-4ee3-9df6-e814330ec655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.777878 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-d104d378-f159-4ee3-9df6-e814330ec655 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:53.779456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d104d378-f159-4ee3-9df6-e814330ec655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:53.798834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1284/2559] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:53.802789 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e7345-fc1e-4293-8444-e5dbb607b33f None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:53.824459 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e7345-fc1e-4293-8444-e5dbb607b33f None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:53.834696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b2cb6-796e-43c1-aecb-42c484d79b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:53.835688 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b2cb6-796e-43c1-aecb-42c484d79b3a admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.835988 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b2cb6-796e-43c1-aecb-42c484d79b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.836227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b2cb6-796e-43c1-aecb-42c484d79b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.836998 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b2cb6-796e-43c1-aecb-42c484d79b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:32:53.837303 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b2cb6-796e-43c1-aecb-42c484d79b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:53.842310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b2cb6-796e-43c1-aecb-42c484d79b3a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:53.867019 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1276/2560] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:32:53.868414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104d378-f159-4ee3-9df6-e814330ec655 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:53.881391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104d378-f159-4ee3-9df6-e814330ec655 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:53.907056 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db347a5-de9c-4840-ba28-0ae7e700c384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:53.908082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db347a5-de9c-4840-ba28-0ae7e700c384 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.908397 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db347a5-de9c-4840-ba28-0ae7e700c384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.908673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db347a5-de9c-4840-ba28-0ae7e700c384 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.909392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db347a5-de9c-4840-ba28-0ae7e700c384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:53.911348 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db347a5-de9c-4840-ba28-0ae7e700c384 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:54.022721 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1285/2561] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:53 2022] POST /identity/v3/projects => generated 397 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:54.026631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b2cb6-796e-43c1-aecb-42c484d79b3a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:54.048783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b2cb6-796e-43c1-aecb-42c484d79b3a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:54.116346 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:54.214224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd568ac8-2deb-4253-87ca-149907b9d227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:54.214996 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd568ac8-2deb-4253-87ca-149907b9d227 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:54.215217 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd568ac8-2deb-4253-87ca-149907b9d227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:54.215492 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd568ac8-2deb-4253-87ca-149907b9d227 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:54.216235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd568ac8-2deb-4253-87ca-149907b9d227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:54.218443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd568ac8-2deb-4253-87ca-149907b9d227 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:54.257848 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1277/2562] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:54 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:54.261788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db347a5-de9c-4840-ba28-0ae7e700c384 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:54.276934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db347a5-de9c-4840-ba28-0ae7e700c384 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:54.287441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8973c-4669-4b02-84cd-469a26eddeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:54.290052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8973c-4669-4b02-84cd-469a26eddeed admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:54.290344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8973c-4669-4b02-84cd-469a26eddeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:54.292230 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8973c-4669-4b02-84cd-469a26eddeed admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:54.293417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8973c-4669-4b02-84cd-469a26eddeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:54.297064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8973c-4669-4b02-84cd-469a26eddeed admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:54.322877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1286/2563] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:54.327165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd568ac8-2deb-4253-87ca-149907b9d227 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:54.346997 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd568ac8-2deb-4253-87ca-149907b9d227 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:54.359102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3b5a0-566b-462e-8e22-3deb94fa83dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:54.362235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3b5a0-566b-462e-8e22-3deb94fa83dc admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:54.363195 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3b5a0-566b-462e-8e22-3deb94fa83dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:54.363480 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3b5a0-566b-462e-8e22-3deb94fa83dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:54.366652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3b5a0-566b-462e-8e22-3deb94fa83dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:54.374526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3b5a0-566b-462e-8e22-3deb94fa83dc admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:54.420275 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1278/2564] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:54.422718 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8973c-4669-4b02-84cd-469a26eddeed admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:54.472286 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8973c-4669-4b02-84cd-469a26eddeed admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:54.493058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf64a70-ee68-4fa3-a486-fb9298040b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:54.494856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf64a70-ee68-4fa3-a486-fb9298040b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:54.495148 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf64a70-ee68-4fa3-a486-fb9298040b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:54.495431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf64a70-ee68-4fa3-a486-fb9298040b94 admin admin] PATH_INFO: `/v3/projects/943bdef7eb1d468aa518f6a9d377bb3b/users/7be98254cb064a70912f8482493a06bc/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:54.537540 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf64a70-ee68-4fa3-a486-fb9298040b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=943bdef7eb1d468aa518f6a9d377bb3b, user_id=7be98254cb064a70912f8482493a06bc, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:54.543141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf64a70-ee68-4fa3-a486-fb9298040b94 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:54.583200 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1287/2565] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:54 2022] PUT /identity/v3/projects/943bdef7eb1d468aa518f6a9d377bb3b/users/7be98254cb064a70912f8482493a06bc/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:54.599434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450769f-ca10-4da3-a9b7-2738d9dc70f1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:54.600502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450769f-ca10-4da3-a9b7-2738d9dc70f1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:54.600950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450769f-ca10-4da3-a9b7-2738d9dc70f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:54.655713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-f450769f-ca10-4da3-a9b7-2738d9dc70f1 None None] MFA Rules not processed for user `7be98254cb064a70912f8482493a06bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:54.657025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f450769f-ca10-4da3-a9b7-2738d9dc70f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:54.801072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1279/2566] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:32:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:54.814089 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf64a70-ee68-4fa3-a486-fb9298040b94 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:54.816294 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-acf64a70-ee68-4fa3-a486-fb9298040b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:54.892535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf64a70-ee68-4fa3-a486-fb9298040b94 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:54.904557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3ee01-52bb-447a-a0aa-55b574f9408d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:54.906238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3ee01-52bb-447a-a0aa-55b574f9408d service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:54.906475 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3ee01-52bb-447a-a0aa-55b574f9408d service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:54.906760 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3ee01-52bb-447a-a0aa-55b574f9408d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:54.919271 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3ee01-52bb-447a-a0aa-55b574f9408d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:54.920830 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3ee01-52bb-447a-a0aa-55b574f9408d service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:54.940697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1288/2567] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:57.083537 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450769f-ca10-4da3-a9b7-2738d9dc70f1 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:57.085914 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f450769f-ca10-4da3-a9b7-2738d9dc70f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:57.327842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450769f-ca10-4da3-a9b7-2738d9dc70f1 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:57.341518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a523a5-a7ef-4323-8542-d33554f992ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a57dc68aeb5482a86d5983b466d933d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:57.344359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a523a5-a7ef-4323-8542-d33554f992ed service glance] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:57.346727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a523a5-a7ef-4323-8542-d33554f992ed service glance] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:57.348244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a523a5-a7ef-4323-8542-d33554f992ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:57.356841 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-46a523a5-a7ef-4323-8542-d33554f992ed service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:57.543964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:57.625259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a523a5-a7ef-4323-8542-d33554f992ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:57.628488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a523a5-a7ef-4323-8542-d33554f992ed service glance] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:57.661793 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1280/2568] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:32:58.090261 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bb620-98bf-40ec-9e40-340dd500bc18 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:58.091008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bb620-98bf-40ec-9e40-340dd500bc18 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:58.091008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bb620-98bf-40ec-9e40-340dd500bc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:58.151637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5c0bb620-98bf-40ec-9e40-340dd500bc18 None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:58.152919 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5c0bb620-98bf-40ec-9e40-340dd500bc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:58.198050 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:58.351431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1289/2569] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 08:32:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:58.382127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a523a5-a7ef-4323-8542-d33554f992ed service glance] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:58.384106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-46a523a5-a7ef-4323-8542-d33554f992ed service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:58.576201 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a523a5-a7ef-4323-8542-d33554f992ed service glance] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:58.594055 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31da9bc-369c-41e8-a67e-aff9176bfb5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:58.594787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31da9bc-369c-41e8-a67e-aff9176bfb5f service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:58.595072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31da9bc-369c-41e8-a67e-aff9176bfb5f service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:58.595509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31da9bc-369c-41e8-a67e-aff9176bfb5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:58.629250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31da9bc-369c-41e8-a67e-aff9176bfb5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:58.630411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31da9bc-369c-41e8-a67e-aff9176bfb5f service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:58.651060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1281/2570] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:32:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:33:01.203577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bb620-98bf-40ec-9e40-340dd500bc18 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:01.367679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bb620-98bf-40ec-9e40-340dd500bc18 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:01.392816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c7b57-5558-4ad1-80fb-94dfa779adf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:01.394673 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c7b57-5558-4ad1-80fb-94dfa779adf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:01.395344 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c7b57-5558-4ad1-80fb-94dfa779adf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:01.396036 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c7b57-5558-4ad1-80fb-94dfa779adf7 admin admin] PATH_INFO: `/v3/users/7be98254cb064a70912f8482493a06bc` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:01.400436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c7b57-5558-4ad1-80fb-94dfa779adf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be98254cb064a70912f8482493a06bc)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:01.402639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c7b57-5558-4ad1-80fb-94dfa779adf7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:01.534134 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2f2c7b57-5558-4ad1-80fb-94dfa779adf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be98254cb064a70912f8482493a06bc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:01.535312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2f2c7b57-5558-4ad1-80fb-94dfa779adf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be98254cb064a70912f8482493a06bc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:01.535977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2f2c7b57-5558-4ad1-80fb-94dfa779adf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be98254cb064a70912f8482493a06bc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:01.555761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2f2c7b57-5558-4ad1-80fb-94dfa779adf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be98254cb064a70912f8482493a06bc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:01.579388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-2f2c7b57-5558-4ad1-80fb-94dfa779adf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be98254cb064a70912f8482493a06bc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:01.620947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1290/2571] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:01 2022] DELETE /identity/v3/users/7be98254cb064a70912f8482493a06bc => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:01.624915 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255adac-45b4-453f-95d3-e0417e277f69 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:01.626482 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255adac-45b4-453f-95d3-e0417e277f69 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:01.627582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255adac-45b4-453f-95d3-e0417e277f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:01.676707 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9255adac-45b4-453f-95d3-e0417e277f69 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:01.679575 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9255adac-45b4-453f-95d3-e0417e277f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:01.937226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1282/2572] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:33:01.977465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c7b57-5558-4ad1-80fb-94dfa779adf7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:01.979899 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2f2c7b57-5558-4ad1-80fb-94dfa779adf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:02.183520 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:02.233284 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c7b57-5558-4ad1-80fb-94dfa779adf7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:02.252795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad17af-debd-40bb-b3e9-0b50704e1d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:02.253821 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad17af-debd-40bb-b3e9-0b50704e1d91 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:02.254273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad17af-debd-40bb-b3e9-0b50704e1d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:02.254710 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad17af-debd-40bb-b3e9-0b50704e1d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:02.265315 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad17af-debd-40bb-b3e9-0b50704e1d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:02.269222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad17af-debd-40bb-b3e9-0b50704e1d91 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:02.307151 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1291/2573] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:03.622668 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255adac-45b4-453f-95d3-e0417e277f69 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:03.624259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9255adac-45b4-453f-95d3-e0417e277f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:03.648488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255adac-45b4-453f-95d3-e0417e277f69 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:03.671170 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:03.680498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:03.680812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:03.681102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d admin admin] PATH_INFO: `/v3/projects/943bdef7eb1d468aa518f6a9d377bb3b` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:03.682567 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=943bdef7eb1d468aa518f6a9d377bb3b)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:03.684746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:03.814669 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '943bdef7eb1d468aa518f6a9d377bb3b', 'request_id': 'req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:03.822049 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '943bdef7eb1d468aa518f6a9d377bb3b', 'request_id': 'req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:03.839083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '943bdef7eb1d468aa518f6a9d377bb3b', 'request_id': 'req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:03.849071 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:03.863710 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d admin admin] The token cache is being invalidate because project 943bdef7eb1d468aa518f6a9d377bb3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:03.866646 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:03.869557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:03.874502 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1283/2574] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:03 2022] DELETE /identity/v3/projects/943bdef7eb1d468aa518f6a9d377bb3b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:04.603970 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85684c0a-687e-4ace-a762-a6e3f8af95db None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:04.605310 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85684c0a-687e-4ace-a762-a6e3f8af95db None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:04.606090 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85684c0a-687e-4ace-a762-a6e3f8af95db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:04.672363 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-85684c0a-687e-4ace-a762-a6e3f8af95db None None] MFA Rules not processed for user `bafec8a6d8ba44fca6a51fd5730bfadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:04.673939 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-85684c0a-687e-4ace-a762-a6e3f8af95db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:04.969992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1292/2575] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:33:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:04.984369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:04.986897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:05.152139 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec1ccb-2d6d-4be4-895f-2e40816adf0d admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:05.159806 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10d957-2b56-4815-a5b4-a4da2f5e06c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:05.160885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10d957-2b56-4815-a5b4-a4da2f5e06c4 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:05.161183 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10d957-2b56-4815-a5b4-a4da2f5e06c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:05.161462 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10d957-2b56-4815-a5b4-a4da2f5e06c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:05.168587 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-de10d957-2b56-4815-a5b4-a4da2f5e06c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:05.316434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10d957-2b56-4815-a5b4-a4da2f5e06c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:05.320149 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10d957-2b56-4815-a5b4-a4da2f5e06c4 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:05.346999 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1284/2576] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:07.835318 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b6d4e-7c74-4cb6-92c8-36cf1692a245 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:07.837269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b6d4e-7c74-4cb6-92c8-36cf1692a245 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:07.837887 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b6d4e-7c74-4cb6-92c8-36cf1692a245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:07.864740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1a9b6d4e-7c74-4cb6-92c8-36cf1692a245 None None] MFA Rules not processed for user `0f16f7a5f9c140c19637a4c63cddaed7`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:07.866474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1a9b6d4e-7c74-4cb6-92c8-36cf1692a245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:07.875327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1293/2577] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:33:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:33:13.117611 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3191fa5-56d2-4f6b-964b-52a0460008f5 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:13.118080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3191fa5-56d2-4f6b-964b-52a0460008f5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:13.118295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3191fa5-56d2-4f6b-964b-52a0460008f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:13.142437 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-d3191fa5-56d2-4f6b-964b-52a0460008f5 None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:13.143713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d3191fa5-56d2-4f6b-964b-52a0460008f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:13.205291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1285/2578] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 21 08:33:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:13.223687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b6d4e-7c74-4cb6-92c8-36cf1692a245 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:13.225227 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1a9b6d4e-7c74-4cb6-92c8-36cf1692a245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:13.314224 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b6d4e-7c74-4cb6-92c8-36cf1692a245 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:13.321626 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd82623-d21f-4077-98d4-b5ebd904d73f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:13.323291 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd82623-d21f-4077-98d4-b5ebd904d73f service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:13.323768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd82623-d21f-4077-98d4-b5ebd904d73f service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:13.324206 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd82623-d21f-4077-98d4-b5ebd904d73f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:13.333930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd82623-d21f-4077-98d4-b5ebd904d73f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:13.335752 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd82623-d21f-4077-98d4-b5ebd904d73f service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:13.345962 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1294/2579] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:33:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:33:13.744562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78391ad-f093-495d-bb24-259e41059e89 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:13.744942 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78391ad-f093-495d-bb24-259e41059e89 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:13.745282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78391ad-f093-495d-bb24-259e41059e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:13.766687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e78391ad-f093-495d-bb24-259e41059e89 None None] MFA Rules not processed for user `ca5ddd20cf1f4f63a1bb4fdf96b9f894`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:13.768027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e78391ad-f093-495d-bb24-259e41059e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:13.804273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:13.836336 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1286/2580] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:33:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:33:15.526734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd82623-d21f-4077-98d4-b5ebd904d73f service swift] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:15.529196 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-dfd82623-d21f-4077-98d4-b5ebd904d73f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:15.616832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:15.648775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd82623-d21f-4077-98d4-b5ebd904d73f service swift] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:15.658812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c898879-4e2b-4a41-bbb4-de909744d8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:15.659829 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c898879-4e2b-4a41-bbb4-de909744d8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:15.660114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c898879-4e2b-4a41-bbb4-de909744d8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:15.660541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c898879-4e2b-4a41-bbb4-de909744d8a2 admin admin] PATH_INFO: `/v3/users/e870ec5ae9eb43b6bc650d730f778d02` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:15.663235 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c898879-4e2b-4a41-bbb4-de909744d8a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e870ec5ae9eb43b6bc650d730f778d02)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:15.666242 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c898879-4e2b-4a41-bbb4-de909744d8a2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:15.737518 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c898879-4e2b-4a41-bbb4-de909744d8a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e870ec5ae9eb43b6bc650d730f778d02'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:15.738222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c898879-4e2b-4a41-bbb4-de909744d8a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e870ec5ae9eb43b6bc650d730f778d02'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:15.739625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c898879-4e2b-4a41-bbb4-de909744d8a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e870ec5ae9eb43b6bc650d730f778d02'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:15.763238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c898879-4e2b-4a41-bbb4-de909744d8a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e870ec5ae9eb43b6bc650d730f778d02'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:15.778735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3c898879-4e2b-4a41-bbb4-de909744d8a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e870ec5ae9eb43b6bc650d730f778d02'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:15.828101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1295/2581] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:15 2022] DELETE /identity/v3/users/e870ec5ae9eb43b6bc650d730f778d02 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:15.944616 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0649a-383e-4842-9427-346eb9935213 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:15.945457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0649a-383e-4842-9427-346eb9935213 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:15.945925 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0649a-383e-4842-9427-346eb9935213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:15.967525 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-5ba0649a-383e-4842-9427-346eb9935213 None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:15.970096 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5ba0649a-383e-4842-9427-346eb9935213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:16.091734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1287/2582] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 08:33:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:16.112557 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c898879-4e2b-4a41-bbb4-de909744d8a2 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:16.114031 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3c898879-4e2b-4a41-bbb4-de909744d8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:16.123664 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0649a-383e-4842-9427-346eb9935213 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:16.129110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-5ba0649a-383e-4842-9427-346eb9935213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:16.259889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0649a-383e-4842-9427-346eb9935213 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:16.262388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c898879-4e2b-4a41-bbb4-de909744d8a2 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:16.265973 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf9e68-7c77-4ffb-88ec-7495b68a4551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:16.267106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf9e68-7c77-4ffb-88ec-7495b68a4551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:16.267393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf9e68-7c77-4ffb-88ec-7495b68a4551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:16.267713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf9e68-7c77-4ffb-88ec-7495b68a4551 admin admin] PATH_INFO: `/v3/projects/b3b665abe6ca4a359375096c35940f52` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:16.268913 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf9e68-7c77-4ffb-88ec-7495b68a4551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b665abe6ca4a359375096c35940f52)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:16.269368 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cc507-13a7-4e75-b5b6-d1c34212677c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:16.270252 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cc507-13a7-4e75-b5b6-d1c34212677c service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:16.270631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cc507-13a7-4e75-b5b6-d1c34212677c service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:16.270892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf9e68-7c77-4ffb-88ec-7495b68a4551 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:16.271078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cc507-13a7-4e75-b5b6-d1c34212677c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:16.281337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cc507-13a7-4e75-b5b6-d1c34212677c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:16.283697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cc507-13a7-4e75-b5b6-d1c34212677c service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:16.295855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1296/2583] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:33:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:33:16.337713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-26cf9e68-7c77-4ffb-88ec-7495b68a4551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b665abe6ca4a359375096c35940f52', 'request_id': 'req-26cf9e68-7c77-4ffb-88ec-7495b68a4551'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:16.352592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-26cf9e68-7c77-4ffb-88ec-7495b68a4551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b665abe6ca4a359375096c35940f52', 'request_id': 'req-26cf9e68-7c77-4ffb-88ec-7495b68a4551'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:16.364628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-26cf9e68-7c77-4ffb-88ec-7495b68a4551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b665abe6ca4a359375096c35940f52', 'request_id': 'req-26cf9e68-7c77-4ffb-88ec-7495b68a4551'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:16.380611 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-26cf9e68-7c77-4ffb-88ec-7495b68a4551 admin admin] The token cache is being invalidate because project b3b665abe6ca4a359375096c35940f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:16.380984 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-26cf9e68-7c77-4ffb-88ec-7495b68a4551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:16.381727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-26cf9e68-7c77-4ffb-88ec-7495b68a4551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:16.383510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1288/2584] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:16 2022] DELETE /identity/v3/projects/b3b665abe6ca4a359375096c35940f52 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:26.291706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=62,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:26.376194 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:31.785739 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef663b50-ec71-4196-96eb-e185a344c970 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:31.786522 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef663b50-ec71-4196-96eb-e185a344c970 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:31.786522 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef663b50-ec71-4196-96eb-e185a344c970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:31.808487 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ef663b50-ec71-4196-96eb-e185a344c970 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:31.810010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ef663b50-ec71-4196-96eb-e185a344c970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:31.876989 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1297/2585] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 21 08:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:31.893588 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf9e68-7c77-4ffb-88ec-7495b68a4551 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:31.895996 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-26cf9e68-7c77-4ffb-88ec-7495b68a4551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:31.974980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf9e68-7c77-4ffb-88ec-7495b68a4551 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:31.980921 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f53da0-1a95-4e6e-b435-b4d8960a96a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:31.981566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f53da0-1a95-4e6e-b435-b4d8960a96a2 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:31.981843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f53da0-1a95-4e6e-b435-b4d8960a96a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:31.982116 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f53da0-1a95-4e6e-b435-b4d8960a96a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:31.993566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f53da0-1a95-4e6e-b435-b4d8960a96a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:31.995226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f53da0-1a95-4e6e-b435-b4d8960a96a2 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:32.007153 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1289/2586] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:32.967062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef663b50-ec71-4196-96eb-e185a344c970 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:32.969087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ef663b50-ec71-4196-96eb-e185a344c970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:33.057012 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef663b50-ec71-4196-96eb-e185a344c970 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:33.062685 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c153c-5c61-4894-a21f-b7dd63e55d42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1146aa09d30458f9ab3b3bec8f94233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:33.063441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c153c-5c61-4894-a21f-b7dd63e55d42 service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:33.063674 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c153c-5c61-4894-a21f-b7dd63e55d42 service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:33.063955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c153c-5c61-4894-a21f-b7dd63e55d42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:33.065846 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ff5c153c-5c61-4894-a21f-b7dd63e55d42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:33.077735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c153c-5c61-4894-a21f-b7dd63e55d42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:33.079347 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c153c-5c61-4894-a21f-b7dd63e55d42 service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:33.089762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1298/2587] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:35.201914 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c310a-3f9d-43c4-ba5a-0dd477af20e1 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:35.202430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c310a-3f9d-43c4-ba5a-0dd477af20e1 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:35.202557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c310a-3f9d-43c4-ba5a-0dd477af20e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:35.221466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-876c310a-3f9d-43c4-ba5a-0dd477af20e1 None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:35.222728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-876c310a-3f9d-43c4-ba5a-0dd477af20e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:35.297930 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1290/2588] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 08:33:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:35.311382 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c153c-5c61-4894-a21f-b7dd63e55d42 service placement] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:35.313934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ff5c153c-5c61-4894-a21f-b7dd63e55d42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:35.387571 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c153c-5c61-4894-a21f-b7dd63e55d42 service placement] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:35.393365 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92896304-8804-492f-bb1c-4c5a21bd5533 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:35.394013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92896304-8804-492f-bb1c-4c5a21bd5533 service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:35.394289 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92896304-8804-492f-bb1c-4c5a21bd5533 service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:35.394559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92896304-8804-492f-bb1c-4c5a21bd5533 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:35.403952 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92896304-8804-492f-bb1c-4c5a21bd5533 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:35.405751 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92896304-8804-492f-bb1c-4c5a21bd5533 service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:35.415126 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1299/2589] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:33:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:33:35.948733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fcdac-f22b-411d-b448-5e36388f5d1d None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:35.949018 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fcdac-f22b-411d-b448-5e36388f5d1d None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:35.949298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fcdac-f22b-411d-b448-5e36388f5d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:35.980043 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-178fcdac-f22b-411d-b448-5e36388f5d1d None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:35.995348 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-178fcdac-f22b-411d-b448-5e36388f5d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:36.029128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1291/2590] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 21 08:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:36.220284 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92896304-8804-492f-bb1c-4c5a21bd5533 service swift] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:36.235243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92896304-8804-492f-bb1c-4c5a21bd5533 service swift] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:36.241920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76a06c-c4df-4e3c-8e58-bff864a8e47d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:36.242647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76a06c-c4df-4e3c-8e58-bff864a8e47d service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:36.242938 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76a06c-c4df-4e3c-8e58-bff864a8e47d service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:36.243217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76a06c-c4df-4e3c-8e58-bff864a8e47d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:36.256854 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76a06c-c4df-4e3c-8e58-bff864a8e47d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:36.258505 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76a06c-c4df-4e3c-8e58-bff864a8e47d service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:36.270654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1300/2591] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:39.346214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebae4e-92c9-4527-84f2-1e5a0f418f84 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:39.347170 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebae4e-92c9-4527-84f2-1e5a0f418f84 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:39.347698 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebae4e-92c9-4527-84f2-1e5a0f418f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:39.373425 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-c6ebae4e-92c9-4527-84f2-1e5a0f418f84 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:39.375981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c6ebae4e-92c9-4527-84f2-1e5a0f418f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:39.390749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1292/2592] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 21 08:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:39.406086 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76a06c-c4df-4e3c-8e58-bff864a8e47d service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:39.408202 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1d76a06c-c4df-4e3c-8e58-bff864a8e47d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:39.424736 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76a06c-c4df-4e3c-8e58-bff864a8e47d service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:39.431587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a805c-03d7-4e15-bfe4-a6302f871fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:39.432532 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a805c-03d7-4e15-bfe4-a6302f871fc2 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:39.432972 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a805c-03d7-4e15-bfe4-a6302f871fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:39.433425 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a805c-03d7-4e15-bfe4-a6302f871fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:39.450546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:39.461867 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a805c-03d7-4e15-bfe4-a6302f871fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:39.463771 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a805c-03d7-4e15-bfe4-a6302f871fc2 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:39.476411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1301/2593] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:45.502248 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829382c-3f86-4e49-842f-f7fc3346bfe6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:45.502879 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829382c-3f86-4e49-842f-f7fc3346bfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:45.502879 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829382c-3f86-4e49-842f-f7fc3346bfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:45.522869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0829382c-3f86-4e49-842f-f7fc3346bfe6 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:45.524205 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0829382c-3f86-4e49-842f-f7fc3346bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:45.532436 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1293/2594] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 21 08:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:45.547550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a805c-03d7-4e15-bfe4-a6302f871fc2 service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:45.562259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a805c-03d7-4e15-bfe4-a6302f871fc2 service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:45.568869 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6d50c-e4c0-46f0-90e1-32490d5cdba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:45.569541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6d50c-e4c0-46f0-90e1-32490d5cdba2 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:45.569825 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6d50c-e4c0-46f0-90e1-32490d5cdba2 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:45.570101 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6d50c-e4c0-46f0-90e1-32490d5cdba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:45.578945 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6d50c-e4c0-46f0-90e1-32490d5cdba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:45.580654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6d50c-e4c0-46f0-90e1-32490d5cdba2 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:45.590659 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1302/2595] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:46.599580 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829382c-3f86-4e49-842f-f7fc3346bfe6 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:46.602253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0829382c-3f86-4e49-842f-f7fc3346bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:46.678179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829382c-3f86-4e49-842f-f7fc3346bfe6 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:46.687079 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec5fe0-66c2-43f5-a70e-7821b3665bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:46.687778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec5fe0-66c2-43f5-a70e-7821b3665bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:46.688117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec5fe0-66c2-43f5-a70e-7821b3665bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:46.688583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec5fe0-66c2-43f5-a70e-7821b3665bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:46.692230 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a9ec5fe0-66c2-43f5-a70e-7821b3665bd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:46.728543 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=100 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:46.770777 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec5fe0-66c2-43f5-a70e-7821b3665bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:46.772370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec5fe0-66c2-43f5-a70e-7821b3665bd0 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:46.782909 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1294/2596] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:49.735219 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523a851-22db-4554-b000-3d5df382ee18 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:49.739817 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523a851-22db-4554-b000-3d5df382ee18 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:49.740306 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523a851-22db-4554-b000-3d5df382ee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:49.802915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6523a851-22db-4554-b000-3d5df382ee18 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:49.804237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6523a851-22db-4554-b000-3d5df382ee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:49.842193 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1303/2597] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 21 08:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:49.876253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec5fe0-66c2-43f5-a70e-7821b3665bd0 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:49.894497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec5fe0-66c2-43f5-a70e-7821b3665bd0 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:49.901745 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152d662-5b11-4174-83d5-5d947cb60197 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:49.902516 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152d662-5b11-4174-83d5-5d947cb60197 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:49.902981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152d662-5b11-4174-83d5-5d947cb60197 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:49.903330 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152d662-5b11-4174-83d5-5d947cb60197 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:49.913343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152d662-5b11-4174-83d5-5d947cb60197 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:49.915051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152d662-5b11-4174-83d5-5d947cb60197 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:49.926017 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1295/2598] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:51.479948 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523a851-22db-4554-b000-3d5df382ee18 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:51.481477 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6523a851-22db-4554-b000-3d5df382ee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:51.494880 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523a851-22db-4554-b000-3d5df382ee18 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:51.498712 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9290b7-300c-46a2-83c1-a7426d610470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:51.500084 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9290b7-300c-46a2-83c1-a7426d610470 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:51.500372 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9290b7-300c-46a2-83c1-a7426d610470 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:51.500651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9290b7-300c-46a2-83c1-a7426d610470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:51.502476 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5d9290b7-300c-46a2-83c1-a7426d610470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:51.579499 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9290b7-300c-46a2-83c1-a7426d610470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:51.580987 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9290b7-300c-46a2-83c1-a7426d610470 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:51.590489 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1304/2599] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:54.803386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85916e59-7d43-4045-8940-f46d70c58ad2 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:54.803995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85916e59-7d43-4045-8940-f46d70c58ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:54.804093 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85916e59-7d43-4045-8940-f46d70c58ad2 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:54.805944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1296/2600] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 08:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:33:54.814416 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf2d97-452b-48a5-a74e-7ca6ea1ca45c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:54.815391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf2d97-452b-48a5-a74e-7ca6ea1ca45c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:54.815699 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf2d97-452b-48a5-a74e-7ca6ea1ca45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:54.855969 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1bbf2d97-452b-48a5-a74e-7ca6ea1ca45c None None] MFA Rules not processed for user `131bb5462c8b478783a350d37caa76ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:54.858128 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1bbf2d97-452b-48a5-a74e-7ca6ea1ca45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:54.874435 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1305/2601] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 08:33:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:54.889535 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85916e59-7d43-4045-8940-f46d70c58ad2 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:54.891648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-85916e59-7d43-4045-8940-f46d70c58ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:54.987999 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85916e59-7d43-4045-8940-f46d70c58ad2 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:54.992759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e5766-65be-4c47-8433-3786630333b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a57dc68aeb5482a86d5983b466d933d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:54.993604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e5766-65be-4c47-8433-3786630333b0 service glance] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:54.993886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e5766-65be-4c47-8433-3786630333b0 service glance] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:54.994352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e5766-65be-4c47-8433-3786630333b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:55.014087 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e5766-65be-4c47-8433-3786630333b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:55.017706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e5766-65be-4c47-8433-3786630333b0 service glance] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:55.043506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1297/2602] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:55.143217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac638ad-7e3b-4011-8afb-b876bc5d3628 None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:55.143735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac638ad-7e3b-4011-8afb-b876bc5d3628 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:55.144115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac638ad-7e3b-4011-8afb-b876bc5d3628 None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:55.146818 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1306/2603] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 08:33:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:33:55.154700 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7906de-bfb3-4870-afce-b2fb04900028 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:55.155348 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7906de-bfb3-4870-afce-b2fb04900028 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:55.155886 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7906de-bfb3-4870-afce-b2fb04900028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:55.186389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-7f7906de-bfb3-4870-afce-b2fb04900028 None None] MFA Rules not processed for user `1d737a8a33da490db5d59ffed92bee60`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:55.188143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7f7906de-bfb3-4870-afce-b2fb04900028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:55.197202 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1298/2604] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 08:33:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:55.223352 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac638ad-7e3b-4011-8afb-b876bc5d3628 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:55.246243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac638ad-7e3b-4011-8afb-b876bc5d3628 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:55.264186 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db213eb7-5c1a-46c5-be01-ebcc5805bbc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:55.267094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db213eb7-5c1a-46c5-be01-ebcc5805bbc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:55.268605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db213eb7-5c1a-46c5-be01-ebcc5805bbc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:55.270562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db213eb7-5c1a-46c5-be01-ebcc5805bbc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:55.284179 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db213eb7-5c1a-46c5-be01-ebcc5805bbc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:55.286021 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db213eb7-5c1a-46c5-be01-ebcc5805bbc5 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:55.308646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1307/2605] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:55.530117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e799807-905d-442d-9c03-a41bc7e671ff None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:55.531064 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e799807-905d-442d-9c03-a41bc7e671ff None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:55.531575 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e799807-905d-442d-9c03-a41bc7e671ff None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:55.534281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1299/2606] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 08:33:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:33:55.543346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6934f-657b-4558-b3e6-2586b975a57d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:55.544068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6934f-657b-4558-b3e6-2586b975a57d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:55.544639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6934f-657b-4558-b3e6-2586b975a57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:55.569891 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-eca6934f-657b-4558-b3e6-2586b975a57d None None] MFA Rules not processed for user `131bb5462c8b478783a350d37caa76ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:55.571123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-eca6934f-657b-4558-b3e6-2586b975a57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:55.589801 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1308/2607] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 08:33:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:55.603280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e799807-905d-442d-9c03-a41bc7e671ff None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:55.625558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e799807-905d-442d-9c03-a41bc7e671ff None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:55.625558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe3f37-89f7-4bac-9fe2-58e5e3e29742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:55.625812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe3f37-89f7-4bac-9fe2-58e5e3e29742 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:55.626089 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe3f37-89f7-4bac-9fe2-58e5e3e29742 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:55.626426 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe3f37-89f7-4bac-9fe2-58e5e3e29742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:55.637612 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe3f37-89f7-4bac-9fe2-58e5e3e29742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:55.639159 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe3f37-89f7-4bac-9fe2-58e5e3e29742 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:55.650885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1300/2608] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:56.027564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24effdf1-d641-44cb-85ad-b151e655fd58 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:56.028171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24effdf1-d641-44cb-85ad-b151e655fd58 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:56.028366 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24effdf1-d641-44cb-85ad-b151e655fd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:56.050228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-24effdf1-d641-44cb-85ad-b151e655fd58 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:56.052540 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-24effdf1-d641-44cb-85ad-b151e655fd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:56.063295 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1309/2609] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 21 08:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:56.085806 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe3f37-89f7-4bac-9fe2-58e5e3e29742 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:56.097464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe3f37-89f7-4bac-9fe2-58e5e3e29742 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:56.104649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feffa3-eac4-4a0a-94ce-3077e4a366a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:56.105312 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feffa3-eac4-4a0a-94ce-3077e4a366a6 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:56.105586 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feffa3-eac4-4a0a-94ce-3077e4a366a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:56.106046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feffa3-eac4-4a0a-94ce-3077e4a366a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:56.116448 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1feffa3-eac4-4a0a-94ce-3077e4a366a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:56.118277 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1feffa3-eac4-4a0a-94ce-3077e4a366a6 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:56.129701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1301/2610] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:34:00.031211 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981eb7b-a3b7-43f4-b3a8-e0ac7c88db52 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:00.031703 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981eb7b-a3b7-43f4-b3a8-e0ac7c88db52 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:00.031794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981eb7b-a3b7-43f4-b3a8-e0ac7c88db52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:00.051333 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-5981eb7b-a3b7-43f4-b3a8-e0ac7c88db52 None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:00.052637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-5981eb7b-a3b7-43f4-b3a8-e0ac7c88db52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:00.060507 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1310/2611] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 08:34:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:00.073135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feffa3-eac4-4a0a-94ce-3077e4a366a6 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:00.085577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feffa3-eac4-4a0a-94ce-3077e4a366a6 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:00.091172 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f9038-ca73-4aa5-a200-9df5479b438d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:00.091838 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f9038-ca73-4aa5-a200-9df5479b438d service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:00.092117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f9038-ca73-4aa5-a200-9df5479b438d service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:00.092388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f9038-ca73-4aa5-a200-9df5479b438d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:00.101254 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f9038-ca73-4aa5-a200-9df5479b438d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:00.102762 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f9038-ca73-4aa5-a200-9df5479b438d service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:00.111475 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1302/2612] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:34:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:34:10.045771 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=60 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:10.107728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=71 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:20.545960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0a5a8-3389-42e6-a062-7e6f0078a134 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:20.546688 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0a5a8-3389-42e6-a062-7e6f0078a134 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:20.547004 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0a5a8-3389-42e6-a062-7e6f0078a134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:20.568292 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e2a0a5a8-3389-42e6-a062-7e6f0078a134 None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:20.569526 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e2a0a5a8-3389-42e6-a062-7e6f0078a134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:20.579951 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1311/2613] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 21 08:34:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:20.597954 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f9038-ca73-4aa5-a200-9df5479b438d service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:20.610181 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f9038-ca73-4aa5-a200-9df5479b438d service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:20.616192 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e895d3-8c29-4516-8963-e089c28aca2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:20.616857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e895d3-8c29-4516-8963-e089c28aca2b service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:20.617126 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e895d3-8c29-4516-8963-e089c28aca2b service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:20.617405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e895d3-8c29-4516-8963-e089c28aca2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:20.626387 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e895d3-8c29-4516-8963-e089c28aca2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:20.628026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e895d3-8c29-4516-8963-e089c28aca2b service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:20.636092 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1303/2614] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:34:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 08:34:21.077113 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d79a-d7bb-48bb-a327-9ae2b4306241 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:21.077403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d79a-d7bb-48bb-a327-9ae2b4306241 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:21.077683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d79a-d7bb-48bb-a327-9ae2b4306241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:21.098312 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1ce9d79a-d7bb-48bb-a327-9ae2b4306241 None None] MFA Rules not processed for user `4df9cba16cec44d3ab51d8f17258db75`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:21.099463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1ce9d79a-d7bb-48bb-a327-9ae2b4306241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:21.162045 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1312/2615] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:34:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:25.770163 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98586e3-4818-488f-8435-274852e2863c None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:25.770743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98586e3-4818-488f-8435-274852e2863c None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:25.770849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98586e3-4818-488f-8435-274852e2863c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:25.790404 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e98586e3-4818-488f-8435-274852e2863c None None] MFA Rules not processed for user `f200322f009e4736932961f616622a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:25.791822 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e98586e3-4818-488f-8435-274852e2863c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:25.857623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1304/2616] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:34:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:31.150445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=28 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:35.848801 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=31 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:41.412541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2b011-261d-4e60-b821-653f8e2e07a9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:41.413118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2b011-261d-4e60-b821-653f8e2e07a9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:41.413118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2b011-261d-4e60-b821-653f8e2e07a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:41.433015 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-acb2b011-261d-4e60-b821-653f8e2e07a9 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:41.434242 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-acb2b011-261d-4e60-b821-653f8e2e07a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:41.442850 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1313/2617] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 21 08:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:41.457897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98586e3-4818-488f-8435-274852e2863c None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:41.472408 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98586e3-4818-488f-8435-274852e2863c None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:41.482857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5c234-8a29-4f29-9ec8-06b10f187e0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:41.484129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5c234-8a29-4f29-9ec8-06b10f187e0a service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:41.484511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5c234-8a29-4f29-9ec8-06b10f187e0a service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:41.484891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5c234-8a29-4f29-9ec8-06b10f187e0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:41.498935 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5c234-8a29-4f29-9ec8-06b10f187e0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:41.500570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5c234-8a29-4f29-9ec8-06b10f187e0a service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:41.510575 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1305/2618] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:34:44.679333 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1266d3-9ae5-4236-b5c9-8f38215ab7d8 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:44.679933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1266d3-9ae5-4236-b5c9-8f38215ab7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:44.679933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1266d3-9ae5-4236-b5c9-8f38215ab7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:44.701408 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-ea1266d3-9ae5-4236-b5c9-8f38215ab7d8 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:44.702703 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ea1266d3-9ae5-4236-b5c9-8f38215ab7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:44.711761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1314/2619] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 21 08:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:44.726654 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5c234-8a29-4f29-9ec8-06b10f187e0a service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:44.739913 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5c234-8a29-4f29-9ec8-06b10f187e0a service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:44.746498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8750d24-ff96-41b8-b7b3-e786d9f13ed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:44.747180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8750d24-ff96-41b8-b7b3-e786d9f13ed5 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:44.747950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8750d24-ff96-41b8-b7b3-e786d9f13ed5 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:44.747950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8750d24-ff96-41b8-b7b3-e786d9f13ed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:44.757802 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8750d24-ff96-41b8-b7b3-e786d9f13ed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:44.759574 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8750d24-ff96-41b8-b7b3-e786d9f13ed5 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:44.770686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1306/2620] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:34:47.740732 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3758c-44c4-4bdd-9acc-0c0a36c55893 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:47.741406 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3758c-44c4-4bdd-9acc-0c0a36c55893 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:47.741406 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3758c-44c4-4bdd-9acc-0c0a36c55893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:47.761246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2ad3758c-44c4-4bdd-9acc-0c0a36c55893 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:47.762464 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2ad3758c-44c4-4bdd-9acc-0c0a36c55893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:47.772918 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1315/2621] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 21 08:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:47.797392 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8750d24-ff96-41b8-b7b3-e786d9f13ed5 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:47.814149 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8750d24-ff96-41b8-b7b3-e786d9f13ed5 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:47.823802 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d25b7-0dbc-45fe-977c-6a1d7b41fbef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:47.824838 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d25b7-0dbc-45fe-977c-6a1d7b41fbef service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:47.825178 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d25b7-0dbc-45fe-977c-6a1d7b41fbef service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:47.825551 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d25b7-0dbc-45fe-977c-6a1d7b41fbef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:47.835960 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d25b7-0dbc-45fe-977c-6a1d7b41fbef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:47.837563 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d25b7-0dbc-45fe-977c-6a1d7b41fbef service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:47.847876 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1307/2622] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:34:50.918646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1398f-2338-403d-8da7-725f6ca17da5 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:50.919160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1398f-2338-403d-8da7-725f6ca17da5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:50.919160 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1398f-2338-403d-8da7-725f6ca17da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:50.938456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b1a1398f-2338-403d-8da7-725f6ca17da5 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:50.939722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b1a1398f-2338-403d-8da7-725f6ca17da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:50.950075 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1316/2623] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 21 08:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:50.986719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d25b7-0dbc-45fe-977c-6a1d7b41fbef service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:50.998783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d25b7-0dbc-45fe-977c-6a1d7b41fbef service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:51.004740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd901cf-e425-4fa2-b0f0-4a6dc33e2f1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:51.005386 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd901cf-e425-4fa2-b0f0-4a6dc33e2f1f service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:51.005674 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd901cf-e425-4fa2-b0f0-4a6dc33e2f1f service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:51.005952 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd901cf-e425-4fa2-b0f0-4a6dc33e2f1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:51.014619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd901cf-e425-4fa2-b0f0-4a6dc33e2f1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:51.016361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd901cf-e425-4fa2-b0f0-4a6dc33e2f1f service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:51.026366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1308/2624] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:34:54.108500 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329c11f-3e6f-4089-bc62-0fdb3032960c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:54.109028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329c11f-3e6f-4089-bc62-0fdb3032960c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:54.109028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329c11f-3e6f-4089-bc62-0fdb3032960c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:54.130497 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7329c11f-3e6f-4089-bc62-0fdb3032960c None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:54.131801 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7329c11f-3e6f-4089-bc62-0fdb3032960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:54.141411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1317/2625] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 21 08:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:54.161181 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd901cf-e425-4fa2-b0f0-4a6dc33e2f1f service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:54.178675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd901cf-e425-4fa2-b0f0-4a6dc33e2f1f service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:54.189082 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbce17-8ad0-4531-968a-165657c5fa17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:54.189985 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbce17-8ad0-4531-968a-165657c5fa17 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:54.190326 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbce17-8ad0-4531-968a-165657c5fa17 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:54.190650 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbce17-8ad0-4531-968a-165657c5fa17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:54.199638 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbce17-8ad0-4531-968a-165657c5fa17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:54.201287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbce17-8ad0-4531-968a-165657c5fa17 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:54.211310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1309/2626] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:04.124571 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=15 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:04.206649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=30 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:18.985526 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46efe5-d147-4a04-a9e6-9a165fc0830f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:18.986331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46efe5-d147-4a04-a9e6-9a165fc0830f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:18.986331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46efe5-d147-4a04-a9e6-9a165fc0830f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:19.003787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-9e46efe5-d147-4a04-a9e6-9a165fc0830f None None] MFA Rules not processed for user `29aac2ddd3e04ee3b0c68ba2457a8b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:19.004991 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-9e46efe5-d147-4a04-a9e6-9a165fc0830f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:19.063459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1318/2627] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:35:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:35:23.032868 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbce17-8ad0-4531-968a-165657c5fa17 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:23.048273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbce17-8ad0-4531-968a-165657c5fa17 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:23.053675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584b845-5774-46c1-9aa2-d92e8a822f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:23.054260 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584b845-5774-46c1-9aa2-d92e8a822f31 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:23.054547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584b845-5774-46c1-9aa2-d92e8a822f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:23.054827 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584b845-5774-46c1-9aa2-d92e8a822f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:23.056763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b584b845-5774-46c1-9aa2-d92e8a822f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:23.072039 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584b845-5774-46c1-9aa2-d92e8a822f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:23.073849 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584b845-5774-46c1-9aa2-d92e8a822f31 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:23.085594 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1310/2628] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:23.341611 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46efe5-d147-4a04-a9e6-9a165fc0830f None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:23.364120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46efe5-d147-4a04-a9e6-9a165fc0830f None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:23.368197 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c51841-ff74-4411-97f9-5878555f773d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:23.369156 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c51841-ff74-4411-97f9-5878555f773d service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:23.369648 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c51841-ff74-4411-97f9-5878555f773d service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:23.369914 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c51841-ff74-4411-97f9-5878555f773d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:23.375445 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-50c51841-ff74-4411-97f9-5878555f773d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:23.393118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c51841-ff74-4411-97f9-5878555f773d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:23.395107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c51841-ff74-4411-97f9-5878555f773d service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:23.409131 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1319/2629] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:23.772894 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584b845-5774-46c1-9aa2-d92e8a822f31 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:23.775571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b584b845-5774-46c1-9aa2-d92e8a822f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:23.805547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584b845-5774-46c1-9aa2-d92e8a822f31 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:23.810257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d98d4-09b6-48f9-bc9e-0f49b5ebe40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:23.811157 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d98d4-09b6-48f9-bc9e-0f49b5ebe40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:23.811439 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d98d4-09b6-48f9-bc9e-0f49b5ebe40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:23.811752 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d98d4-09b6-48f9-bc9e-0f49b5ebe40c admin admin] PATH_INFO: `/v3/users/f200322f009e4736932961f616622a2d` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:23.812953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d98d4-09b6-48f9-bc9e-0f49b5ebe40c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f200322f009e4736932961f616622a2d)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:23.814883 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d98d4-09b6-48f9-bc9e-0f49b5ebe40c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:23.875227 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ae8d98d4-09b6-48f9-bc9e-0f49b5ebe40c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f200322f009e4736932961f616622a2d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:23.891476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ae8d98d4-09b6-48f9-bc9e-0f49b5ebe40c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f200322f009e4736932961f616622a2d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:23.892566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ae8d98d4-09b6-48f9-bc9e-0f49b5ebe40c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f200322f009e4736932961f616622a2d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:23.893177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ae8d98d4-09b6-48f9-bc9e-0f49b5ebe40c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f200322f009e4736932961f616622a2d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:23.904464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-ae8d98d4-09b6-48f9-bc9e-0f49b5ebe40c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f200322f009e4736932961f616622a2d'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:23.922667 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1311/2630] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:35:23 2022] DELETE /identity/v3/users/f200322f009e4736932961f616622a2d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:35:24.140920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c51841-ff74-4411-97f9-5878555f773d service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:24.160483 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c51841-ff74-4411-97f9-5878555f773d service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:24.228340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78edf6-2261-4f31-8119-971173af4ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:24.229411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78edf6-2261-4f31-8119-971173af4ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:24.229770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78edf6-2261-4f31-8119-971173af4ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:24.230116 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78edf6-2261-4f31-8119-971173af4ffd admin admin] PATH_INFO: `/v3/projects/1dcdc3ea556a47cbbca330f400ac0967` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:24.231394 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78edf6-2261-4f31-8119-971173af4ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dcdc3ea556a47cbbca330f400ac0967)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:24.233919 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78edf6-2261-4f31-8119-971173af4ffd admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:24.312184 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ee78edf6-2261-4f31-8119-971173af4ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dcdc3ea556a47cbbca330f400ac0967', 'request_id': 'req-ee78edf6-2261-4f31-8119-971173af4ffd'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:24.323250 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ee78edf6-2261-4f31-8119-971173af4ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dcdc3ea556a47cbbca330f400ac0967', 'request_id': 'req-ee78edf6-2261-4f31-8119-971173af4ffd'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:24.332792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ee78edf6-2261-4f31-8119-971173af4ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dcdc3ea556a47cbbca330f400ac0967', 'request_id': 'req-ee78edf6-2261-4f31-8119-971173af4ffd'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:24.353992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ee78edf6-2261-4f31-8119-971173af4ffd admin admin] The token cache is being invalidate because project 1dcdc3ea556a47cbbca330f400ac0967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:35:24.354601 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ee78edf6-2261-4f31-8119-971173af4ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:24.355448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-ee78edf6-2261-4f31-8119-971173af4ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:24.360968 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1320/2631] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:35:24 2022] DELETE /identity/v3/projects/1dcdc3ea556a47cbbca330f400ac0967 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:35:30.212754 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d98d4-09b6-48f9-bc9e-0f49b5ebe40c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:30.214333 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ae8d98d4-09b6-48f9-bc9e-0f49b5ebe40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:30.296241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d98d4-09b6-48f9-bc9e-0f49b5ebe40c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:30.351753 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:30.368067 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b9f9b-26a0-4725-b996-ff627d38c329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:30.368744 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b9f9b-26a0-4725-b996-ff627d38c329 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:30.369027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b9f9b-26a0-4725-b996-ff627d38c329 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:30.369304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b9f9b-26a0-4725-b996-ff627d38c329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:30.371289 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ce5b9f9b-26a0-4725-b996-ff627d38c329 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:30.433601 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b9f9b-26a0-4725-b996-ff627d38c329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:30.435007 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b9f9b-26a0-4725-b996-ff627d38c329 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:30.450723 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1312/2632] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:30.511062 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78edf6-2261-4f31-8119-971173af4ffd admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:30.512615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-ee78edf6-2261-4f31-8119-971173af4ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:30.541271 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:30.582814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78edf6-2261-4f31-8119-971173af4ffd admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:30.587258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad864a-4aee-4466-99d4-18d49f1a9c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:30.587952 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad864a-4aee-4466-99d4-18d49f1a9c0b service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:30.588241 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad864a-4aee-4466-99d4-18d49f1a9c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:30.588519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad864a-4aee-4466-99d4-18d49f1a9c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:30.590625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-62ad864a-4aee-4466-99d4-18d49f1a9c0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:30.655592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad864a-4aee-4466-99d4-18d49f1a9c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:30.657087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad864a-4aee-4466-99d4-18d49f1a9c0b service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:30.667268 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1321/2633] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:36.136972 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b9f9b-26a0-4725-b996-ff627d38c329 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:36.139089 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ce5b9f9b-26a0-4725-b996-ff627d38c329 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:36.192955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad864a-4aee-4466-99d4-18d49f1a9c0b service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:36.195226 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-62ad864a-4aee-4466-99d4-18d49f1a9c0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:36.208551 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad864a-4aee-4466-99d4-18d49f1a9c0b service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:36.214010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de4094-26ec-4e94-9af6-b8ce0641ca1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:36.215143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de4094-26ec-4e94-9af6-b8ce0641ca1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:36.215424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de4094-26ec-4e94-9af6-b8ce0641ca1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:36.215833 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de4094-26ec-4e94-9af6-b8ce0641ca1e admin admin] PATH_INFO: `/v3/users/4df9cba16cec44d3ab51d8f17258db75` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:36.217091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de4094-26ec-4e94-9af6-b8ce0641ca1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df9cba16cec44d3ab51d8f17258db75)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:36.219032 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de4094-26ec-4e94-9af6-b8ce0641ca1e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:36.226959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b9f9b-26a0-4725-b996-ff627d38c329 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:36.232416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41334c9e-7e8d-4bf3-93a1-19cbc9ed670e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1146aa09d30458f9ab3b3bec8f94233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:36.233940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41334c9e-7e8d-4bf3-93a1-19cbc9ed670e service placement] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:36.234214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41334c9e-7e8d-4bf3-93a1-19cbc9ed670e service placement] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:36.234489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41334c9e-7e8d-4bf3-93a1-19cbc9ed670e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:36.236759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-41334c9e-7e8d-4bf3-93a1-19cbc9ed670e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:36.253379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41334c9e-7e8d-4bf3-93a1-19cbc9ed670e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:36.255024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41334c9e-7e8d-4bf3-93a1-19cbc9ed670e service placement] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:36.266944 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1313/2634] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:36.296968 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e6de4094-26ec-4e94-9af6-b8ce0641ca1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df9cba16cec44d3ab51d8f17258db75'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:36.297644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e6de4094-26ec-4e94-9af6-b8ce0641ca1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df9cba16cec44d3ab51d8f17258db75'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:36.298261 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e6de4094-26ec-4e94-9af6-b8ce0641ca1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df9cba16cec44d3ab51d8f17258db75'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:36.308882 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e6de4094-26ec-4e94-9af6-b8ce0641ca1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df9cba16cec44d3ab51d8f17258db75'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:36.320933 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e6de4094-26ec-4e94-9af6-b8ce0641ca1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df9cba16cec44d3ab51d8f17258db75'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:36.355481 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1322/2635] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:35:36 2022] DELETE /identity/v3/users/4df9cba16cec44d3ab51d8f17258db75 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:35:36.626516 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41334c9e-7e8d-4bf3-93a1-19cbc9ed670e service placement] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:36.637512 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41334c9e-7e8d-4bf3-93a1-19cbc9ed670e service placement] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:36.697433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84368404-a434-44f7-a549-7088ad1c0e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:36.698359 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84368404-a434-44f7-a549-7088ad1c0e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:36.698640 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84368404-a434-44f7-a549-7088ad1c0e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:36.698916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84368404-a434-44f7-a549-7088ad1c0e27 admin admin] PATH_INFO: `/v3/projects/1861eff82fb5414c95aa2cf53dcae6a2` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:36.700381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84368404-a434-44f7-a549-7088ad1c0e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1861eff82fb5414c95aa2cf53dcae6a2)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:36.702310 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84368404-a434-44f7-a549-7088ad1c0e27 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:36.738154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:36.762124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-84368404-a434-44f7-a549-7088ad1c0e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1861eff82fb5414c95aa2cf53dcae6a2', 'request_id': 'req-84368404-a434-44f7-a549-7088ad1c0e27'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:36.768421 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-84368404-a434-44f7-a549-7088ad1c0e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1861eff82fb5414c95aa2cf53dcae6a2', 'request_id': 'req-84368404-a434-44f7-a549-7088ad1c0e27'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:36.780071 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-84368404-a434-44f7-a549-7088ad1c0e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1861eff82fb5414c95aa2cf53dcae6a2', 'request_id': 'req-84368404-a434-44f7-a549-7088ad1c0e27'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:36.791406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-84368404-a434-44f7-a549-7088ad1c0e27 admin admin] The token cache is being invalidate because project 1861eff82fb5414c95aa2cf53dcae6a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:35:36.791734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-84368404-a434-44f7-a549-7088ad1c0e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:36.792435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-84368404-a434-44f7-a549-7088ad1c0e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:36.794195 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1314/2636] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:35:36 2022] DELETE /identity/v3/projects/1861eff82fb5414c95aa2cf53dcae6a2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:35:36.799564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018ee2c-bcf7-4741-8139-26ef561f981a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:36.799895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018ee2c-bcf7-4741-8139-26ef561f981a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:36.800191 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018ee2c-bcf7-4741-8139-26ef561f981a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:36.820304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-c018ee2c-bcf7-4741-8139-26ef561f981a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:36.821554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c018ee2c-bcf7-4741-8139-26ef561f981a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:36.864800 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:36.885004 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1323/2637] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:35:36.893362 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8dfe0-755f-451f-9117-50af5c4edb13 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:36.893657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8dfe0-755f-451f-9117-50af5c4edb13 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:36.893937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8dfe0-755f-451f-9117-50af5c4edb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:36.914824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-10e8dfe0-755f-451f-9117-50af5c4edb13 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:36.916120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-10e8dfe0-755f-451f-9117-50af5c4edb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:36.927562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1315/2638] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:35:36.933184 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018ee2c-bcf7-4741-8139-26ef561f981a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:36.943855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018ee2c-bcf7-4741-8139-26ef561f981a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:36.949801 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410b05d-ebeb-4963-bee1-fd53416fc769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:36.950452 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410b05d-ebeb-4963-bee1-fd53416fc769 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:36.950745 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410b05d-ebeb-4963-bee1-fd53416fc769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:36.951019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410b05d-ebeb-4963-bee1-fd53416fc769 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:36.951799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410b05d-ebeb-4963-bee1-fd53416fc769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:35:36.952106 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410b05d-ebeb-4963-bee1-fd53416fc769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:36.953728 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410b05d-ebeb-4963-bee1-fd53416fc769 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:36.966249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1324/2639] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:35:36.970954 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8dfe0-755f-451f-9117-50af5c4edb13 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:36.980824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8dfe0-755f-451f-9117-50af5c4edb13 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:36.987220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed18ef0-86e7-4880-bce9-80311ecf2e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:36.987979 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed18ef0-86e7-4880-bce9-80311ecf2e53 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:36.988261 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed18ef0-86e7-4880-bce9-80311ecf2e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:36.988538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed18ef0-86e7-4880-bce9-80311ecf2e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:36.989241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed18ef0-86e7-4880-bce9-80311ecf2e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:36.991155 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed18ef0-86e7-4880-bce9-80311ecf2e53 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:37.025185 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1316/2640] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:35:36 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:35:37.029646 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410b05d-ebeb-4963-bee1-fd53416fc769 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:37.040747 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410b05d-ebeb-4963-bee1-fd53416fc769 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:37.100243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3cb13-4651-4c35-9eaf-be20c34717ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:37.100929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3cb13-4651-4c35-9eaf-be20c34717ed admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:37.101214 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3cb13-4651-4c35-9eaf-be20c34717ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:37.101492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3cb13-4651-4c35-9eaf-be20c34717ed admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:37.102188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3cb13-4651-4c35-9eaf-be20c34717ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:37.104281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3cb13-4651-4c35-9eaf-be20c34717ed admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:37.128104 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1325/2641] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:35:37 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:35:37.134031 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed18ef0-86e7-4880-bce9-80311ecf2e53 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:37.145495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed18ef0-86e7-4880-bce9-80311ecf2e53 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:37.151526 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060edac3-5065-4031-9818-2fec3739cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:37.152210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060edac3-5065-4031-9818-2fec3739cfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:37.152490 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060edac3-5065-4031-9818-2fec3739cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:37.152761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060edac3-5065-4031-9818-2fec3739cfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:37.153735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060edac3-5065-4031-9818-2fec3739cfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:37.155324 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060edac3-5065-4031-9818-2fec3739cfe5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:37.166962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1317/2642] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:35:37.172485 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3cb13-4651-4c35-9eaf-be20c34717ed admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:37.184694 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3cb13-4651-4c35-9eaf-be20c34717ed admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:37.190531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3a22d-f471-4849-88c4-4317b09ca147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:37.191192 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3a22d-f471-4849-88c4-4317b09ca147 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:37.191474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3a22d-f471-4849-88c4-4317b09ca147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:37.191783 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3a22d-f471-4849-88c4-4317b09ca147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:37.192508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3a22d-f471-4849-88c4-4317b09ca147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:37.194103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3a22d-f471-4849-88c4-4317b09ca147 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:37.205740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1326/2643] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:35:37.210213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060edac3-5065-4031-9818-2fec3739cfe5 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:37.222302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060edac3-5065-4031-9818-2fec3739cfe5 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:37.228528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b531a06-b5a3-4547-8342-6aaade53f28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:37.229434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b531a06-b5a3-4547-8342-6aaade53f28c admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:37.229740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b531a06-b5a3-4547-8342-6aaade53f28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:37.230043 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b531a06-b5a3-4547-8342-6aaade53f28c admin admin] PATH_INFO: `/v3/projects/9092cfde36f34dfa86c2b4c78d34cb56/users/1943ba023a424b53a6b2128ba02c773c/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:37.248839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b531a06-b5a3-4547-8342-6aaade53f28c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9092cfde36f34dfa86c2b4c78d34cb56, user_id=1943ba023a424b53a6b2128ba02c773c, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:37.251744 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b531a06-b5a3-4547-8342-6aaade53f28c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:37.268715 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1318/2644] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:35:37 2022] PUT /identity/v3/projects/9092cfde36f34dfa86c2b4c78d34cb56/users/1943ba023a424b53a6b2128ba02c773c/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:35:37.274154 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26029c-2104-4b10-b5e2-4bb971093394 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:37.274435 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26029c-2104-4b10-b5e2-4bb971093394 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:37.274736 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26029c-2104-4b10-b5e2-4bb971093394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:37.293874 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-cb26029c-2104-4b10-b5e2-4bb971093394 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:37.295404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cb26029c-2104-4b10-b5e2-4bb971093394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:37.362513 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1327/2645] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:35:37.372409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b531a06-b5a3-4547-8342-6aaade53f28c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:37.374267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-8b531a06-b5a3-4547-8342-6aaade53f28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:37.434750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b531a06-b5a3-4547-8342-6aaade53f28c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:37.438739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29672a3-aa96-4389-8547-a4ac4116ea0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:37.439399 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29672a3-aa96-4389-8547-a4ac4116ea0b service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:37.439713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29672a3-aa96-4389-8547-a4ac4116ea0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:37.439990 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29672a3-aa96-4389-8547-a4ac4116ea0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:37.450648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29672a3-aa96-4389-8547-a4ac4116ea0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:37.452396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29672a3-aa96-4389-8547-a4ac4116ea0b service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:37.462742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1319/2646] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:40.583361 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0333d-f991-4e14-8f4c-4600dc677ebc None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:40.583927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0333d-f991-4e14-8f4c-4600dc677ebc None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:40.584185 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0333d-f991-4e14-8f4c-4600dc677ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:40.608915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-47c0333d-f991-4e14-8f4c-4600dc677ebc None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:40.614257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-47c0333d-f991-4e14-8f4c-4600dc677ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:40.705043 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:40.724432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1328/2647] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 21 08:35:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:35:40.782351 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29672a3-aa96-4389-8547-a4ac4116ea0b service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:40.784168 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d29672a3-aa96-4389-8547-a4ac4116ea0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:40.855733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:40.881206 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29672a3-aa96-4389-8547-a4ac4116ea0b service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:40.886529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed695e-3209-4417-abdd-095d24a2b3cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:40.887213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed695e-3209-4417-abdd-095d24a2b3cd service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:40.887515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed695e-3209-4417-abdd-095d24a2b3cd service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:40.887962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed695e-3209-4417-abdd-095d24a2b3cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:40.897091 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed695e-3209-4417-abdd-095d24a2b3cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:40.898701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed695e-3209-4417-abdd-095d24a2b3cd service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:40.907406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1320/2648] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:35:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:35:43.124697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c3499-20e7-4031-9fa7-cb24d1485432 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:43.125263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c3499-20e7-4031-9fa7-cb24d1485432 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:43.125424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c3499-20e7-4031-9fa7-cb24d1485432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:43.209697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f17c3499-20e7-4031-9fa7-cb24d1485432 None None] MFA Rules not processed for user `1943ba023a424b53a6b2128ba02c773c`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:43.211786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f17c3499-20e7-4031-9fa7-cb24d1485432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:43.327226 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1329/2649] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:35:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:35:43.344810 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed695e-3209-4417-abdd-095d24a2b3cd service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:43.346532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-ceed695e-3209-4417-abdd-095d24a2b3cd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:43.460787 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed695e-3209-4417-abdd-095d24a2b3cd service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:43.469071 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145b366-98bc-4f1c-935c-97f3fdee1509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:43.469877 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145b366-98bc-4f1c-935c-97f3fdee1509 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:43.470161 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145b366-98bc-4f1c-935c-97f3fdee1509 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:43.470439 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145b366-98bc-4f1c-935c-97f3fdee1509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:43.484298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145b366-98bc-4f1c-935c-97f3fdee1509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:43.486008 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145b366-98bc-4f1c-935c-97f3fdee1509 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:43.498609 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1321/2650] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:45.479346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c801-3e5c-4cbc-a8c7-64042cf1873c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:45.482231 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c801-3e5c-4cbc-a8c7-64042cf1873c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:45.482512 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c801-3e5c-4cbc-a8c7-64042cf1873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:45.505082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1f97c801-3e5c-4cbc-a8c7-64042cf1873c None None] MFA Rules not processed for user `1943ba023a424b53a6b2128ba02c773c`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:45.506493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1f97c801-3e5c-4cbc-a8c7-64042cf1873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:45.520949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1330/2651] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:35:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:35:46.065679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145b366-98bc-4f1c-935c-97f3fdee1509 service nova] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:46.077102 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145b366-98bc-4f1c-935c-97f3fdee1509 service nova] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:46.081465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c27a02-3aff-4435-9ff9-e943c0fb2b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:46.082259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c27a02-3aff-4435-9ff9-e943c0fb2b4c service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:46.086850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c27a02-3aff-4435-9ff9-e943c0fb2b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:46.086850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c27a02-3aff-4435-9ff9-e943c0fb2b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:46.086850 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-08c27a02-3aff-4435-9ff9-e943c0fb2b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:46.096938 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c27a02-3aff-4435-9ff9-e943c0fb2b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:46.098602 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c27a02-3aff-4435-9ff9-e943c0fb2b4c service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:46.108790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1322/2652] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:46.660748 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97c801-3e5c-4cbc-a8c7-64042cf1873c None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:46.662783 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1f97c801-3e5c-4cbc-a8c7-64042cf1873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:46.778360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97c801-3e5c-4cbc-a8c7-64042cf1873c None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:46.796469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa47f4-fef9-4dd8-b2b3-2339c95aa37c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1146aa09d30458f9ab3b3bec8f94233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:46.799064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa47f4-fef9-4dd8-b2b3-2339c95aa37c service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:46.799575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa47f4-fef9-4dd8-b2b3-2339c95aa37c service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:46.801997 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa47f4-fef9-4dd8-b2b3-2339c95aa37c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:46.805872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-54fa47f4-fef9-4dd8-b2b3-2339c95aa37c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:46.823438 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa47f4-fef9-4dd8-b2b3-2339c95aa37c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:46.827019 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa47f4-fef9-4dd8-b2b3-2339c95aa37c service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:46.883984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1331/2653] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:49.296686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c27a02-3aff-4435-9ff9-e943c0fb2b4c service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:49.298491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-08c27a02-3aff-4435-9ff9-e943c0fb2b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:49.312163 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c27a02-3aff-4435-9ff9-e943c0fb2b4c service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:49.316935 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da33839-0526-4fcb-8545-1f7a09b0166e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:49.318200 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da33839-0526-4fcb-8545-1f7a09b0166e service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:49.318495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da33839-0526-4fcb-8545-1f7a09b0166e service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:49.318772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da33839-0526-4fcb-8545-1f7a09b0166e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:49.322083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4da33839-0526-4fcb-8545-1f7a09b0166e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:49.354909 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da33839-0526-4fcb-8545-1f7a09b0166e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:49.357372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da33839-0526-4fcb-8545-1f7a09b0166e service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:49.369245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1323/2654] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:49.678700 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa47f4-fef9-4dd8-b2b3-2339c95aa37c service placement] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:49.680343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-54fa47f4-fef9-4dd8-b2b3-2339c95aa37c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:49.701550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa47f4-fef9-4dd8-b2b3-2339c95aa37c service placement] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:49.715656 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe169eb-ae62-4787-b74f-b8d72db48ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:49.717018 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe169eb-ae62-4787-b74f-b8d72db48ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:49.717474 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe169eb-ae62-4787-b74f-b8d72db48ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:49.718052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe169eb-ae62-4787-b74f-b8d72db48ee6 admin admin] PATH_INFO: `/v3/users/ca5ddd20cf1f4f63a1bb4fdf96b9f894` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:49.720669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe169eb-ae62-4787-b74f-b8d72db48ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5ddd20cf1f4f63a1bb4fdf96b9f894)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:49.722822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe169eb-ae62-4787-b74f-b8d72db48ee6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:49.783878 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8fe169eb-ae62-4787-b74f-b8d72db48ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5ddd20cf1f4f63a1bb4fdf96b9f894'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:49.784589 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8fe169eb-ae62-4787-b74f-b8d72db48ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5ddd20cf1f4f63a1bb4fdf96b9f894'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:49.785194 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8fe169eb-ae62-4787-b74f-b8d72db48ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5ddd20cf1f4f63a1bb4fdf96b9f894'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:49.793164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8fe169eb-ae62-4787-b74f-b8d72db48ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5ddd20cf1f4f63a1bb4fdf96b9f894'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:49.802068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8fe169eb-ae62-4787-b74f-b8d72db48ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5ddd20cf1f4f63a1bb4fdf96b9f894'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:49.803399 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:49.833059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1332/2655] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:35:49 2022] DELETE /identity/v3/users/ca5ddd20cf1f4f63a1bb4fdf96b9f894 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:35:50.057255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da33839-0526-4fcb-8545-1f7a09b0166e service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:50.074339 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da33839-0526-4fcb-8545-1f7a09b0166e service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:50.230423 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:50.237024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:50.237413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:50.237703 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef admin admin] PATH_INFO: `/v3/projects/595707058f424913b727c534a2e477d6` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:50.239164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=595707058f424913b727c534a2e477d6)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:50.241153 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:50.316324 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:50.325552 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '595707058f424913b727c534a2e477d6', 'request_id': 'req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:50.332989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '595707058f424913b727c534a2e477d6', 'request_id': 'req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:50.357210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '595707058f424913b727c534a2e477d6', 'request_id': 'req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:50.369879 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef admin admin] The token cache is being invalidate because project 595707058f424913b727c534a2e477d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:35:50.370435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:50.371107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:50.374728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1324/2656] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:35:50 2022] DELETE /identity/v3/projects/595707058f424913b727c534a2e477d6 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:35:50.377645 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe169eb-ae62-4787-b74f-b8d72db48ee6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:50.379450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8fe169eb-ae62-4787-b74f-b8d72db48ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:50.395098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe169eb-ae62-4787-b74f-b8d72db48ee6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:50.464628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4dcbf-fdf9-4eae-851e-8a057f6bc7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:50.465929 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4dcbf-fdf9-4eae-851e-8a057f6bc7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:50.466329 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4dcbf-fdf9-4eae-851e-8a057f6bc7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:50.466614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4dcbf-fdf9-4eae-851e-8a057f6bc7e9 admin admin] PATH_INFO: `/v3/users/e97d51dc7c874ac7a29250553ff6caa8` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:50.467894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4dcbf-fdf9-4eae-851e-8a057f6bc7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e97d51dc7c874ac7a29250553ff6caa8)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:50.469912 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4dcbf-fdf9-4eae-851e-8a057f6bc7e9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:50.525135 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d8d4dcbf-fdf9-4eae-851e-8a057f6bc7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e97d51dc7c874ac7a29250553ff6caa8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:50.525819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d8d4dcbf-fdf9-4eae-851e-8a057f6bc7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e97d51dc7c874ac7a29250553ff6caa8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:50.526432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d8d4dcbf-fdf9-4eae-851e-8a057f6bc7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e97d51dc7c874ac7a29250553ff6caa8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:50.541914 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d8d4dcbf-fdf9-4eae-851e-8a057f6bc7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e97d51dc7c874ac7a29250553ff6caa8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:50.553547 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d8d4dcbf-fdf9-4eae-851e-8a057f6bc7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e97d51dc7c874ac7a29250553ff6caa8'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:50.572405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1333/2657] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:35:50 2022] DELETE /identity/v3/users/e97d51dc7c874ac7a29250553ff6caa8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:35:50.760538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:50.762255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:50.776766 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f206fc-bdfb-4e68-ac4f-4a8136e3b4ef admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:50.838929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4055a-cad6-4c9e-b293-a845b33b19ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:50.839827 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4055a-cad6-4c9e-b293-a845b33b19ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:50.840213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4055a-cad6-4c9e-b293-a845b33b19ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:50.840494 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4055a-cad6-4c9e-b293-a845b33b19ae admin admin] PATH_INFO: `/v3/projects/ec36de71d4994f39b54d800abdec8fca` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:50.841767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4055a-cad6-4c9e-b293-a845b33b19ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec36de71d4994f39b54d800abdec8fca)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:50.843734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4055a-cad6-4c9e-b293-a845b33b19ae admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:50.901445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-46d4055a-cad6-4c9e-b293-a845b33b19ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec36de71d4994f39b54d800abdec8fca', 'request_id': 'req-46d4055a-cad6-4c9e-b293-a845b33b19ae'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:50.910029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-46d4055a-cad6-4c9e-b293-a845b33b19ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec36de71d4994f39b54d800abdec8fca', 'request_id': 'req-46d4055a-cad6-4c9e-b293-a845b33b19ae'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:50.921233 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-46d4055a-cad6-4c9e-b293-a845b33b19ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec36de71d4994f39b54d800abdec8fca', 'request_id': 'req-46d4055a-cad6-4c9e-b293-a845b33b19ae'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:50.934619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-46d4055a-cad6-4c9e-b293-a845b33b19ae admin admin] The token cache is being invalidate because project ec36de71d4994f39b54d800abdec8fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:35:50.934853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-46d4055a-cad6-4c9e-b293-a845b33b19ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:50.935751 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-46d4055a-cad6-4c9e-b293-a845b33b19ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:35:50.937582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1325/2658] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:35:50 2022] DELETE /identity/v3/projects/ec36de71d4994f39b54d800abdec8fca => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:35:58.658679 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4dcbf-fdf9-4eae-851e-8a057f6bc7e9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:58.660265 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-d8d4dcbf-fdf9-4eae-851e-8a057f6bc7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:58.718497 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:58.737579 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4dcbf-fdf9-4eae-851e-8a057f6bc7e9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:58.806288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a35ef4-d42f-4087-bec3-5dad16f8ec9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:58.807146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35ef4-d42f-4087-bec3-5dad16f8ec9b service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:58.807433 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35ef4-d42f-4087-bec3-5dad16f8ec9b service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:58.807757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35ef4-d42f-4087-bec3-5dad16f8ec9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:58.809906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-53a35ef4-d42f-4087-bec3-5dad16f8ec9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:58.824106 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a35ef4-d42f-4087-bec3-5dad16f8ec9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:58.825941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a35ef4-d42f-4087-bec3-5dad16f8ec9b service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:58.838729 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1334/2659] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:36:00.930949 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=59,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:08.833889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=35 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:17.616347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4055a-cad6-4c9e-b293-a845b33b19ae admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:36:17.617927 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-46d4055a-cad6-4c9e-b293-a845b33b19ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:36:17.636211 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4055a-cad6-4c9e-b293-a845b33b19ae admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:36:17.642940 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88365c0a-3fac-44bc-a19b-a4aae976be9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:36:17.643695 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88365c0a-3fac-44bc-a19b-a4aae976be9d service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:36:17.644257 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88365c0a-3fac-44bc-a19b-a4aae976be9d service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:36:17.644600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88365c0a-3fac-44bc-a19b-a4aae976be9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:36:17.646528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-88365c0a-3fac-44bc-a19b-a4aae976be9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:36:17.674122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88365c0a-3fac-44bc-a19b-a4aae976be9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:36:17.676877 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88365c0a-3fac-44bc-a19b-a4aae976be9d service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:36:17.688215 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1326/2660] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:36:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:36:27.683884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=6 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:39.000393 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a35ef4-d42f-4087-bec3-5dad16f8ec9b service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:36:39.002013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-53a35ef4-d42f-4087-bec3-5dad16f8ec9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:36:39.020163 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a35ef4-d42f-4087-bec3-5dad16f8ec9b service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:36:39.028595 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9d828-394b-473f-b994-79aff60278c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:36:39.029263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9d828-394b-473f-b994-79aff60278c7 service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:36:39.029544 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9d828-394b-473f-b994-79aff60278c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:36:39.029817 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9d828-394b-473f-b994-79aff60278c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:36:39.031873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-55c9d828-394b-473f-b994-79aff60278c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:36:39.099493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9d828-394b-473f-b994-79aff60278c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:36:39.101258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9d828-394b-473f-b994-79aff60278c7 service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:36:39.112095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1335/2661] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:36:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:36:43.298117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81255f88-5349-460f-a319-755a333bb8a4 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:36:43.298701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81255f88-5349-460f-a319-755a333bb8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:36:43.298701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81255f88-5349-460f-a319-755a333bb8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:36:43.318510 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-81255f88-5349-460f-a319-755a333bb8a4 None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:36:43.319791 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-81255f88-5349-460f-a319-755a333bb8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:36:43.386072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1327/2662] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 08:36:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:36:43.449059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9d828-394b-473f-b994-79aff60278c7 service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:36:43.450605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-55c9d828-394b-473f-b994-79aff60278c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:36:43.529400 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9d828-394b-473f-b994-79aff60278c7 service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:36:43.538188 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa286850-7ca6-4e10-8e11-7b95a1c438b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:36:43.539153 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa286850-7ca6-4e10-8e11-7b95a1c438b9 service swift] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:36:43.539674 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa286850-7ca6-4e10-8e11-7b95a1c438b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:36:43.540145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa286850-7ca6-4e10-8e11-7b95a1c438b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:36:43.555267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa286850-7ca6-4e10-8e11-7b95a1c438b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:36:43.557997 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa286850-7ca6-4e10-8e11-7b95a1c438b9 service swift] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:36:43.567048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1336/2663] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:36:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:36:53.377731 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=25 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:53.563639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=60 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:57.086348 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c2b0-dd75-4818-aebf-2f54305f5b4b None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:36:57.086890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c2b0-dd75-4818-aebf-2f54305f5b4b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:36:57.086890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c2b0-dd75-4818-aebf-2f54305f5b4b None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:36:57.088325 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1328/2664] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 08:36:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:36:57.094951 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbac6f8-4cf0-4f5a-8909-9fb4ad1c9ee0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:36:57.095416 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbac6f8-4cf0-4f5a-8909-9fb4ad1c9ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:36:57.095579 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbac6f8-4cf0-4f5a-8909-9fb4ad1c9ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:36:57.115282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-7dbac6f8-4cf0-4f5a-8909-9fb4ad1c9ee0 None None] MFA Rules not processed for user `131bb5462c8b478783a350d37caa76ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:36:57.116559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7dbac6f8-4cf0-4f5a-8909-9fb4ad1c9ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:36:57.126510 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1337/2665] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 08:36:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:36:57.138551 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087c2b0-dd75-4818-aebf-2f54305f5b4b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:36:57.140632 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9087c2b0-dd75-4818-aebf-2f54305f5b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:36:57.215911 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087c2b0-dd75-4818-aebf-2f54305f5b4b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:36:57.219718 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ee821-dc3d-4e6d-8535-9bc9fb0d1706 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a57dc68aeb5482a86d5983b466d933d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:36:57.220533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ee821-dc3d-4e6d-8535-9bc9fb0d1706 service glance] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:36:57.220827 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ee821-dc3d-4e6d-8535-9bc9fb0d1706 service glance] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:36:57.221112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ee821-dc3d-4e6d-8535-9bc9fb0d1706 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:36:57.241792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ee821-dc3d-4e6d-8535-9bc9fb0d1706 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:36:57.243287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ee821-dc3d-4e6d-8535-9bc9fb0d1706 service glance] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:36:57.254987 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1329/2666] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:36:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:36:57.323191 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b810c-3346-4894-9913-e86fc69fe76a None None] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:36:57.323486 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b810c-3346-4894-9913-e86fc69fe76a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:36:57.323843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b810c-3346-4894-9913-e86fc69fe76a None None] PATH_INFO: `/` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:36:57.325306 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1338/2667] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 08:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:36:57.330699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589de164-215e-4dd5-b79d-570adfc79fc5 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:36:57.331070 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589de164-215e-4dd5-b79d-570adfc79fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:36:57.331433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589de164-215e-4dd5-b79d-570adfc79fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:36:57.350809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-589de164-215e-4dd5-b79d-570adfc79fc5 None None] MFA Rules not processed for user `1d737a8a33da490db5d59ffed92bee60`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:36:57.352099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-589de164-215e-4dd5-b79d-570adfc79fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:36:57.419176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1330/2668] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 08:36:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:36:57.431912 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b810c-3346-4894-9913-e86fc69fe76a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:36:57.433707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-881b810c-3346-4894-9913-e86fc69fe76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:36:57.448423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b810c-3346-4894-9913-e86fc69fe76a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:36:57.453205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b05580-6dae-4d4d-9d1e-47dc65843827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:36:57.454009 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b05580-6dae-4d4d-9d1e-47dc65843827 service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:36:57.454357 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b05580-6dae-4d4d-9d1e-47dc65843827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:36:57.454693 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b05580-6dae-4d4d-9d1e-47dc65843827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:36:57.463343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b05580-6dae-4d4d-9d1e-47dc65843827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:36:57.464917 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b05580-6dae-4d4d-9d1e-47dc65843827 service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:36:57.474890 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1339/2669] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:36:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:36:57.615285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d7b61-af16-46e1-908c-a77a0a666c22 None None] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:36:57.615718 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d7b61-af16-46e1-908c-a77a0a666c22 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:36:57.616236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d7b61-af16-46e1-908c-a77a0a666c22 None None] PATH_INFO: `/` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:36:57.617889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1331/2670] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 08:36:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:36:57.623973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55880e2a-a855-4af2-9c69-2482cb77786a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:36:57.624335 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55880e2a-a855-4af2-9c69-2482cb77786a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:36:57.624610 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55880e2a-a855-4af2-9c69-2482cb77786a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:36:57.645114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-55880e2a-a855-4af2-9c69-2482cb77786a None None] MFA Rules not processed for user `131bb5462c8b478783a350d37caa76ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:36:57.646279 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-55880e2a-a855-4af2-9c69-2482cb77786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:36:57.670371 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1340/2671] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 08:36:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:36:57.681528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d7b61-af16-46e1-908c-a77a0a666c22 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:36:57.683498 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-f53d7b61-af16-46e1-908c-a77a0a666c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:36:57.697353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d7b61-af16-46e1-908c-a77a0a666c22 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:36:57.701381 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b3bb0-ac44-4d81-9ca2-10276d423bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:36:57.702027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b3bb0-ac44-4d81-9ca2-10276d423bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:36:57.702306 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b3bb0-ac44-4d81-9ca2-10276d423bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:36:57.702625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b3bb0-ac44-4d81-9ca2-10276d423bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:36:57.713924 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b3bb0-ac44-4d81-9ca2-10276d423bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:36:57.715587 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b3bb0-ac44-4d81-9ca2-10276d423bb5 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:36:57.726701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1332/2672] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:36:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:00.330917 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739a48b-6417-4090-b37a-385f5b0d2ade None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:00.331404 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739a48b-6417-4090-b37a-385f5b0d2ade None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:00.331499 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739a48b-6417-4090-b37a-385f5b0d2ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:00.354142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2739a48b-6417-4090-b37a-385f5b0d2ade None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:00.355384 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2739a48b-6417-4090-b37a-385f5b0d2ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:00.363745 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1341/2673] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 08:37:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:00.377997 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b3bb0-ac44-4d81-9ca2-10276d423bb5 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:00.390740 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b3bb0-ac44-4d81-9ca2-10276d423bb5 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:00.397291 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f34d79-3909-4bf7-b59a-144f5ec42a79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:00.397919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f34d79-3909-4bf7-b59a-144f5ec42a79 service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:00.398201 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f34d79-3909-4bf7-b59a-144f5ec42a79 service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:00.398477 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f34d79-3909-4bf7-b59a-144f5ec42a79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:00.407781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f34d79-3909-4bf7-b59a-144f5ec42a79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:00.409369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f34d79-3909-4bf7-b59a-144f5ec42a79 service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:00.417684 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1333/2674] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:37:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 08:37:10.348331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=15 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:10.414250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=61 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:16.033042 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8e0dd-b4dc-4635-80ef-721f2297b8cf None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:16.033524 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8e0dd-b4dc-4635-80ef-721f2297b8cf None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:16.033638 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8e0dd-b4dc-4635-80ef-721f2297b8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:16.052092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8eb8e0dd-b4dc-4635-80ef-721f2297b8cf None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:16.053274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8eb8e0dd-b4dc-4635-80ef-721f2297b8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:16.061305 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1342/2675] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 21 08:37:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:16.073699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f34d79-3909-4bf7-b59a-144f5ec42a79 service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:16.085765 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f34d79-3909-4bf7-b59a-144f5ec42a79 service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:16.093056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cee534-0f2b-4bb5-a6d2-f5158f332728 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:16.093698 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cee534-0f2b-4bb5-a6d2-f5158f332728 service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:16.093977 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cee534-0f2b-4bb5-a6d2-f5158f332728 service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:16.094250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cee534-0f2b-4bb5-a6d2-f5158f332728 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:16.103877 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cee534-0f2b-4bb5-a6d2-f5158f332728 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:16.105482 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cee534-0f2b-4bb5-a6d2-f5158f332728 service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:16.115280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1334/2676] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:37:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:37:26.046668 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:26.110800 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=6 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:43.662317 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8e0dd-b4dc-4635-80ef-721f2297b8cf None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:43.676056 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8e0dd-b4dc-4635-80ef-721f2297b8cf None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:43.682139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef9579-2bba-4794-9a54-4401428ab99f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:43.682860 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef9579-2bba-4794-9a54-4401428ab99f service nova] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:43.683145 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef9579-2bba-4794-9a54-4401428ab99f service nova] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:43.683422 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef9579-2bba-4794-9a54-4401428ab99f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:43.685616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-14ef9579-2bba-4794-9a54-4401428ab99f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:43.698788 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef9579-2bba-4794-9a54-4401428ab99f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:43.700437 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef9579-2bba-4794-9a54-4401428ab99f service nova] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:43.711874 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1343/2677] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:45.268518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cee534-0f2b-4bb5-a6d2-f5158f332728 service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:45.278560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cee534-0f2b-4bb5-a6d2-f5158f332728 service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:45.283047 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dd5e3-ce58-4866-9526-15ff44ae9861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:45.284515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dd5e3-ce58-4866-9526-15ff44ae9861 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:45.285014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dd5e3-ce58-4866-9526-15ff44ae9861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:45.285617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dd5e3-ce58-4866-9526-15ff44ae9861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:45.287733 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-134dd5e3-ce58-4866-9526-15ff44ae9861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:45.352843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134dd5e3-ce58-4866-9526-15ff44ae9861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:45.354226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134dd5e3-ce58-4866-9526-15ff44ae9861 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:45.364209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1335/2678] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:48.332702 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef9579-2bba-4794-9a54-4401428ab99f service nova] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:48.335041 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-14ef9579-2bba-4794-9a54-4401428ab99f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:48.416508 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef9579-2bba-4794-9a54-4401428ab99f service nova] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:48.421456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03fda-b98d-49f4-b14a-2c07c4c42fd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1146aa09d30458f9ab3b3bec8f94233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:48.422143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03fda-b98d-49f4-b14a-2c07c4c42fd6 service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:48.422431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03fda-b98d-49f4-b14a-2c07c4c42fd6 service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:48.422711 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03fda-b98d-49f4-b14a-2c07c4c42fd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:48.424542 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a4a03fda-b98d-49f4-b14a-2c07c4c42fd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:48.437004 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a03fda-b98d-49f4-b14a-2c07c4c42fd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:48.438620 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a03fda-b98d-49f4-b14a-2c07c4c42fd6 service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:48.450530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1344/2679] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:51.893495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dd5e3-ce58-4866-9526-15ff44ae9861 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:51.895072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-134dd5e3-ce58-4866-9526-15ff44ae9861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:51.907496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dd5e3-ce58-4866-9526-15ff44ae9861 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:51.912511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9ed23-ab3f-45b3-bf6b-d459868fa029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:51.913401 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9ed23-ab3f-45b3-bf6b-d459868fa029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:51.913685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9ed23-ab3f-45b3-bf6b-d459868fa029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:51.913969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9ed23-ab3f-45b3-bf6b-d459868fa029 admin admin] PATH_INFO: `/v3/users/0f16f7a5f9c140c19637a4c63cddaed7` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:51.915169 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9ed23-ab3f-45b3-bf6b-d459868fa029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f16f7a5f9c140c19637a4c63cddaed7)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:51.917204 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9ed23-ab3f-45b3-bf6b-d459868fa029 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:51.967190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c4a9ed23-ab3f-45b3-bf6b-d459868fa029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f16f7a5f9c140c19637a4c63cddaed7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:51.983356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c4a9ed23-ab3f-45b3-bf6b-d459868fa029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f16f7a5f9c140c19637a4c63cddaed7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:51.984139 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c4a9ed23-ab3f-45b3-bf6b-d459868fa029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f16f7a5f9c140c19637a4c63cddaed7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:51.984785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c4a9ed23-ab3f-45b3-bf6b-d459868fa029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f16f7a5f9c140c19637a4c63cddaed7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:51.992124 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c4a9ed23-ab3f-45b3-bf6b-d459868fa029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f16f7a5f9c140c19637a4c63cddaed7'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.005484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1336/2680] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:37:51 2022] DELETE /identity/v3/users/0f16f7a5f9c140c19637a4c63cddaed7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:52.190614 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03fda-b98d-49f4-b14a-2c07c4c42fd6 service placement] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:52.204484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03fda-b98d-49f4-b14a-2c07c4c42fd6 service placement] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:52.273112 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566b8db-570f-4565-b7c0-73ef7a5b3352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:52.273997 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566b8db-570f-4565-b7c0-73ef7a5b3352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:52.274278 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566b8db-570f-4565-b7c0-73ef7a5b3352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:52.274556 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566b8db-570f-4565-b7c0-73ef7a5b3352 admin admin] PATH_INFO: `/v3/projects/8cd4ba6979354543a3cbab1e8154ce07` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:52.276275 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566b8db-570f-4565-b7c0-73ef7a5b3352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cd4ba6979354543a3cbab1e8154ce07)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:52.278208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566b8db-570f-4565-b7c0-73ef7a5b3352 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:52.332886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7566b8db-570f-4565-b7c0-73ef7a5b3352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cd4ba6979354543a3cbab1e8154ce07', 'request_id': 'req-7566b8db-570f-4565-b7c0-73ef7a5b3352'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.342530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7566b8db-570f-4565-b7c0-73ef7a5b3352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cd4ba6979354543a3cbab1e8154ce07', 'request_id': 'req-7566b8db-570f-4565-b7c0-73ef7a5b3352'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.348182 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7566b8db-570f-4565-b7c0-73ef7a5b3352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cd4ba6979354543a3cbab1e8154ce07', 'request_id': 'req-7566b8db-570f-4565-b7c0-73ef7a5b3352'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.359912 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7566b8db-570f-4565-b7c0-73ef7a5b3352 admin admin] The token cache is being invalidate because project 8cd4ba6979354543a3cbab1e8154ce07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:37:52.360194 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7566b8db-570f-4565-b7c0-73ef7a5b3352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.360843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7566b8db-570f-4565-b7c0-73ef7a5b3352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.362396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1345/2681] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:37:52 2022] DELETE /identity/v3/projects/8cd4ba6979354543a3cbab1e8154ce07 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:52.366599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9ed23-ab3f-45b3-bf6b-d459868fa029 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:52.368042 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c4a9ed23-ab3f-45b3-bf6b-d459868fa029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:52.380993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9ed23-ab3f-45b3-bf6b-d459868fa029 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:52.439577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8eaac-6b2b-4d4f-90c1-9816b8825644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:52.440738 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8eaac-6b2b-4d4f-90c1-9816b8825644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:52.441043 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8eaac-6b2b-4d4f-90c1-9816b8825644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:52.441367 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8eaac-6b2b-4d4f-90c1-9816b8825644 admin admin] PATH_INFO: `/v3/users/bafec8a6d8ba44fca6a51fd5730bfadc` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:52.442763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8eaac-6b2b-4d4f-90c1-9816b8825644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bafec8a6d8ba44fca6a51fd5730bfadc)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:52.445111 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8eaac-6b2b-4d4f-90c1-9816b8825644 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:52.456907 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:52.499487 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4ab8eaac-6b2b-4d4f-90c1-9816b8825644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bafec8a6d8ba44fca6a51fd5730bfadc'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.513406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4ab8eaac-6b2b-4d4f-90c1-9816b8825644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bafec8a6d8ba44fca6a51fd5730bfadc'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.514140 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4ab8eaac-6b2b-4d4f-90c1-9816b8825644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bafec8a6d8ba44fca6a51fd5730bfadc'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.514877 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4ab8eaac-6b2b-4d4f-90c1-9816b8825644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bafec8a6d8ba44fca6a51fd5730bfadc'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.522382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-4ab8eaac-6b2b-4d4f-90c1-9816b8825644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bafec8a6d8ba44fca6a51fd5730bfadc'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.537754 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1337/2682] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:37:52 2022] DELETE /identity/v3/users/bafec8a6d8ba44fca6a51fd5730bfadc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:52.715952 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566b8db-570f-4565-b7c0-73ef7a5b3352 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:52.718778 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7566b8db-570f-4565-b7c0-73ef7a5b3352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:52.735556 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566b8db-570f-4565-b7c0-73ef7a5b3352 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:52.740115 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:52.808529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:52.809411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:52.809697 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:52.809974 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9 admin admin] PATH_INFO: `/v3/projects/7965ed5c59c048ae9aaf025fc5114ec8` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:52.811180 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7965ed5c59c048ae9aaf025fc5114ec8)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:52.813165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:52.862390 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7965ed5c59c048ae9aaf025fc5114ec8', 'request_id': 'req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.874695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7965ed5c59c048ae9aaf025fc5114ec8', 'request_id': 'req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.882678 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7965ed5c59c048ae9aaf025fc5114ec8', 'request_id': 'req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.894139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9 admin admin] The token cache is being invalidate because project 7965ed5c59c048ae9aaf025fc5114ec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:37:52.894428 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.895205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.897087 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1346/2683] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:37:52 2022] DELETE /identity/v3/projects/7965ed5c59c048ae9aaf025fc5114ec8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:57.611128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8eaac-6b2b-4d4f-90c1-9816b8825644 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:57.613280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4ab8eaac-6b2b-4d4f-90c1-9816b8825644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:57.680002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8eaac-6b2b-4d4f-90c1-9816b8825644 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:57.733279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609e8b3-3ba2-4aa2-8039-acc17f74a52c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:57.734078 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609e8b3-3ba2-4aa2-8039-acc17f74a52c service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:57.734365 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609e8b3-3ba2-4aa2-8039-acc17f74a52c service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:57.734644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609e8b3-3ba2-4aa2-8039-acc17f74a52c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:57.736763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9609e8b3-3ba2-4aa2-8039-acc17f74a52c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:57.791689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:57.804891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609e8b3-3ba2-4aa2-8039-acc17f74a52c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:57.806727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609e8b3-3ba2-4aa2-8039-acc17f74a52c service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:57.816771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1338/2684] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:00.996480 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:00.998083 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:01.013064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d43ba7-ee49-407f-a2e9-e2828ffbcdb9 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:01.018575 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844c740-1a00-4350-9053-1dd48e81c86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:01.019458 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844c740-1a00-4350-9053-1dd48e81c86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:01.019947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844c740-1a00-4350-9053-1dd48e81c86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:01.020204 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844c740-1a00-4350-9053-1dd48e81c86b admin admin] PATH_INFO: `/v3/users/29aac2ddd3e04ee3b0c68ba2457a8b1a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:01.021493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844c740-1a00-4350-9053-1dd48e81c86b admin admin] RBAC: Authorizing `identity:delete_user(user_id=29aac2ddd3e04ee3b0c68ba2457a8b1a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:01.023431 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844c740-1a00-4350-9053-1dd48e81c86b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:01.077262 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4844c740-1a00-4350-9053-1dd48e81c86b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29aac2ddd3e04ee3b0c68ba2457a8b1a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:01.077897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4844c740-1a00-4350-9053-1dd48e81c86b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29aac2ddd3e04ee3b0c68ba2457a8b1a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:01.078521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4844c740-1a00-4350-9053-1dd48e81c86b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29aac2ddd3e04ee3b0c68ba2457a8b1a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:01.090175 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4844c740-1a00-4350-9053-1dd48e81c86b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29aac2ddd3e04ee3b0c68ba2457a8b1a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:01.099652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-4844c740-1a00-4350-9053-1dd48e81c86b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29aac2ddd3e04ee3b0c68ba2457a8b1a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:01.121769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1347/2685] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:00 2022] DELETE /identity/v3/users/29aac2ddd3e04ee3b0c68ba2457a8b1a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:01.312785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609e8b3-3ba2-4aa2-8039-acc17f74a52c service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:01.325145 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609e8b3-3ba2-4aa2-8039-acc17f74a52c service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:01.387368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc87b0-e5cb-4a46-af95-06904ecc8bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:01.388272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc87b0-e5cb-4a46-af95-06904ecc8bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:01.388565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc87b0-e5cb-4a46-af95-06904ecc8bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:01.388844 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc87b0-e5cb-4a46-af95-06904ecc8bfb admin admin] PATH_INFO: `/v3/projects/85ff6c0a732c4a4f96c805737a03a389` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:01.390023 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc87b0-e5cb-4a46-af95-06904ecc8bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ff6c0a732c4a4f96c805737a03a389)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:01.392099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc87b0-e5cb-4a46-af95-06904ecc8bfb admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:01.442889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-02fc87b0-e5cb-4a46-af95-06904ecc8bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ff6c0a732c4a4f96c805737a03a389', 'request_id': 'req-02fc87b0-e5cb-4a46-af95-06904ecc8bfb'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:01.449980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-02fc87b0-e5cb-4a46-af95-06904ecc8bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ff6c0a732c4a4f96c805737a03a389', 'request_id': 'req-02fc87b0-e5cb-4a46-af95-06904ecc8bfb'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:01.459852 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-02fc87b0-e5cb-4a46-af95-06904ecc8bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ff6c0a732c4a4f96c805737a03a389', 'request_id': 'req-02fc87b0-e5cb-4a46-af95-06904ecc8bfb'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:01.471555 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-02fc87b0-e5cb-4a46-af95-06904ecc8bfb admin admin] The token cache is being invalidate because project 85ff6c0a732c4a4f96c805737a03a389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:01.471882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-02fc87b0-e5cb-4a46-af95-06904ecc8bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:01.472624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-02fc87b0-e5cb-4a46-af95-06904ecc8bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:01.474371 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1339/2686] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:01 2022] DELETE /identity/v3/projects/85ff6c0a732c4a4f96c805737a03a389 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:01.479866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60856f1e-55a9-4084-859d-d7a984bd6031 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:01.480158 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60856f1e-55a9-4084-859d-d7a984bd6031 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:01.480436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60856f1e-55a9-4084-859d-d7a984bd6031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:01.499323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-60856f1e-55a9-4084-859d-d7a984bd6031 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:01.500583 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-60856f1e-55a9-4084-859d-d7a984bd6031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:01.505258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:01.563787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1348/2687] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:01.573005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa618ef3-d19c-44ce-b854-1597b8b22d16 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:01.573187 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa618ef3-d19c-44ce-b854-1597b8b22d16 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:01.573504 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa618ef3-d19c-44ce-b854-1597b8b22d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:01.595771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-fa618ef3-d19c-44ce-b854-1597b8b22d16 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:01.597012 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fa618ef3-d19c-44ce-b854-1597b8b22d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:01.606566 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1340/2688] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:01.610898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60856f1e-55a9-4084-859d-d7a984bd6031 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:01.621465 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60856f1e-55a9-4084-859d-d7a984bd6031 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:01.626940 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe5f1e-97ec-441e-ae00-214fcb655459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:01.627616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe5f1e-97ec-441e-ae00-214fcb655459 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:01.627916 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe5f1e-97ec-441e-ae00-214fcb655459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:01.628200 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe5f1e-97ec-441e-ae00-214fcb655459 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:01.628965 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe5f1e-97ec-441e-ae00-214fcb655459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:38:01.629265 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe5f1e-97ec-441e-ae00-214fcb655459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:01.630886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe5f1e-97ec-441e-ae00-214fcb655459 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:01.642837 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1349/2689] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:38:01.647663 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa618ef3-d19c-44ce-b854-1597b8b22d16 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:01.662550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa618ef3-d19c-44ce-b854-1597b8b22d16 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:01.670134 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4e581-3d1c-41c4-8615-db9cf9c67ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:01.671058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4e581-3d1c-41c4-8615-db9cf9c67ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:01.671438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4e581-3d1c-41c4-8615-db9cf9c67ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:01.671810 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4e581-3d1c-41c4-8615-db9cf9c67ad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:01.672862 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4e581-3d1c-41c4-8615-db9cf9c67ad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:01.675721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4e581-3d1c-41c4-8615-db9cf9c67ad1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:01.703025 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1341/2690] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:01 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:01.707430 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe5f1e-97ec-441e-ae00-214fcb655459 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:01.717930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe5f1e-97ec-441e-ae00-214fcb655459 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:01.775442 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1264823-269a-4302-85dd-f998ae50011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:01.776150 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1264823-269a-4302-85dd-f998ae50011a admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:01.776432 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1264823-269a-4302-85dd-f998ae50011a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:01.776707 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1264823-269a-4302-85dd-f998ae50011a admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:01.777397 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1264823-269a-4302-85dd-f998ae50011a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:01.779333 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1264823-269a-4302-85dd-f998ae50011a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:01.801136 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1350/2691] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:01 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:01.805525 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4e581-3d1c-41c4-8615-db9cf9c67ad1 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:01.817455 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4e581-3d1c-41c4-8615-db9cf9c67ad1 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:01.822550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15add69f-d46d-4ae2-beb1-ac875f1854a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:01.823274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15add69f-d46d-4ae2-beb1-ac875f1854a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:01.823519 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15add69f-d46d-4ae2-beb1-ac875f1854a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:01.823826 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15add69f-d46d-4ae2-beb1-ac875f1854a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:01.824555 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15add69f-d46d-4ae2-beb1-ac875f1854a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:01.826150 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15add69f-d46d-4ae2-beb1-ac875f1854a1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:01.837028 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1342/2692] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:01.841093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1264823-269a-4302-85dd-f998ae50011a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:01.852681 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1264823-269a-4302-85dd-f998ae50011a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:01.858595 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f11d76-2625-40b4-a9cc-2c28d3de5bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:01.859269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f11d76-2625-40b4-a9cc-2c28d3de5bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:01.859553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f11d76-2625-40b4-a9cc-2c28d3de5bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:01.859867 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f11d76-2625-40b4-a9cc-2c28d3de5bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:01.860606 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f11d76-2625-40b4-a9cc-2c28d3de5bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:01.862220 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f11d76-2625-40b4-a9cc-2c28d3de5bd3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:01.873488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1351/2693] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:01.879336 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15add69f-d46d-4ae2-beb1-ac875f1854a1 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:01.890195 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15add69f-d46d-4ae2-beb1-ac875f1854a1 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:01.896591 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29304f2-fdcd-4ada-85ef-81229f4f22d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:01.897485 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29304f2-fdcd-4ada-85ef-81229f4f22d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:01.897910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29304f2-fdcd-4ada-85ef-81229f4f22d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:01.898224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29304f2-fdcd-4ada-85ef-81229f4f22d8 admin admin] PATH_INFO: `/v3/projects/4e7ac9873d0849449c66e4c19cda94b2/users/1be3fcf43fb440f3938b0772e60c06b9/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:01.914604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29304f2-fdcd-4ada-85ef-81229f4f22d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7ac9873d0849449c66e4c19cda94b2, user_id=1be3fcf43fb440f3938b0772e60c06b9, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:01.917301 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29304f2-fdcd-4ada-85ef-81229f4f22d8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:01.932496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1343/2694] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:01 2022] PUT /identity/v3/projects/4e7ac9873d0849449c66e4c19cda94b2/users/1be3fcf43fb440f3938b0772e60c06b9/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:01.937607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065ff33-965a-412b-96bf-33ac79c4e851 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:01.937895 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065ff33-965a-412b-96bf-33ac79c4e851 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:01.938173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065ff33-965a-412b-96bf-33ac79c4e851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:01.956224 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2065ff33-965a-412b-96bf-33ac79c4e851 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:01.957517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2065ff33-965a-412b-96bf-33ac79c4e851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:02.016647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1352/2695] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:02.029815 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29304f2-fdcd-4ada-85ef-81229f4f22d8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:02.033078 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e29304f2-fdcd-4ada-85ef-81229f4f22d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:02.055784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:02.095402 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29304f2-fdcd-4ada-85ef-81229f4f22d8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:02.099922 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97376120-0cbb-4836-9b51-ceb856d5b3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:02.100889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97376120-0cbb-4836-9b51-ceb856d5b3ab service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:02.101180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97376120-0cbb-4836-9b51-ceb856d5b3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:02.101429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97376120-0cbb-4836-9b51-ceb856d5b3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:02.111195 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97376120-0cbb-4836-9b51-ceb856d5b3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:02.112650 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97376120-0cbb-4836-9b51-ceb856d5b3ab service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:02.122375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1344/2696] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:06.280248 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18490633-8a68-453f-83b9-27f12c726df1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:06.281240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18490633-8a68-453f-83b9-27f12c726df1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:06.281523 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18490633-8a68-453f-83b9-27f12c726df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:06.311146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-18490633-8a68-453f-83b9-27f12c726df1 None None] MFA Rules not processed for user `1be3fcf43fb440f3938b0772e60c06b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:06.312561 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-18490633-8a68-453f-83b9-27f12c726df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:06.317471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:06.388176 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1353/2697] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:38:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:06.403009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97376120-0cbb-4836-9b51-ceb856d5b3ab service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:06.404551 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-97376120-0cbb-4836-9b51-ceb856d5b3ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:06.490198 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97376120-0cbb-4836-9b51-ceb856d5b3ab service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:06.496299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62e60e-6a1d-4c6b-8901-0ec5a019d398 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '131bb5462c8b478783a350d37caa76ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:06.496993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62e60e-6a1d-4c6b-8901-0ec5a019d398 service nova] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:06.497283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62e60e-6a1d-4c6b-8901-0ec5a019d398 service nova] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:06.497561 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62e60e-6a1d-4c6b-8901-0ec5a019d398 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:06.507157 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62e60e-6a1d-4c6b-8901-0ec5a019d398 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:06.508903 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62e60e-6a1d-4c6b-8901-0ec5a019d398 service nova] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:06.518703 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1345/2698] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:08.872755 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314a11d-d967-44f0-a9a4-e9defa6850d2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:08.873249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314a11d-d967-44f0-a9a4-e9defa6850d2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:08.873386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314a11d-d967-44f0-a9a4-e9defa6850d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:08.900229 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1314a11d-d967-44f0-a9a4-e9defa6850d2 None None] MFA Rules not processed for user `1be3fcf43fb440f3938b0772e60c06b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:08.901464 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1314a11d-d967-44f0-a9a4-e9defa6850d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:08.914284 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1354/2699] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:38:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:16.514284 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=52 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:18.895040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=28 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:25.537149 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda0387-ef55-4b97-bdb4-75ec71fdefc6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:25.537678 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda0387-ef55-4b97-bdb4-75ec71fdefc6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:25.537678 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda0387-ef55-4b97-bdb4-75ec71fdefc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:25.566945 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-fcda0387-ef55-4b97-bdb4-75ec71fdefc6 None None] MFA Rules not processed for user `1943ba023a424b53a6b2128ba02c773c`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:25.568648 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fcda0387-ef55-4b97-bdb4-75ec71fdefc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:25.648545 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1346/2700] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:38:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:25.978506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314a11d-d967-44f0-a9a4-e9defa6850d2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:26.001625 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314a11d-d967-44f0-a9a4-e9defa6850d2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:26.005515 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b8c4f-b7c9-4671-87de-93a5efb5a3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:26.006174 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b8c4f-b7c9-4671-87de-93a5efb5a3ff service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:26.006454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b8c4f-b7c9-4671-87de-93a5efb5a3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:26.006724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b8c4f-b7c9-4671-87de-93a5efb5a3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:26.008634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-848b8c4f-b7c9-4671-87de-93a5efb5a3ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:26.029723 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b8c4f-b7c9-4671-87de-93a5efb5a3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:26.031192 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b8c4f-b7c9-4671-87de-93a5efb5a3ff service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:26.039886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1355/2701] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:35.646529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=37 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:36.036449 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=15 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:00.392582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bc04e-3431-47dc-92d8-0e9d6ed801b6 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:00.393115 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bc04e-3431-47dc-92d8-0e9d6ed801b6 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:00.393232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bc04e-3431-47dc-92d8-0e9d6ed801b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:00.411459 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-288bc04e-3431-47dc-92d8-0e9d6ed801b6 None None] MFA Rules not processed for user `1be3fcf43fb440f3938b0772e60c06b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:00.412696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-288bc04e-3431-47dc-92d8-0e9d6ed801b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:00.420418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1347/2702] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:01.533541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b8c4f-b7c9-4671-87de-93a5efb5a3ff service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:01.535244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-848b8c4f-b7c9-4671-87de-93a5efb5a3ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:01.637142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b8c4f-b7c9-4671-87de-93a5efb5a3ff service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:01.643069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50cbbb-e08e-4714-9eba-b8691d921ee7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1146aa09d30458f9ab3b3bec8f94233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:01.643859 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50cbbb-e08e-4714-9eba-b8691d921ee7 service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:01.644138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50cbbb-e08e-4714-9eba-b8691d921ee7 service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:01.644414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50cbbb-e08e-4714-9eba-b8691d921ee7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:01.646345 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-cc50cbbb-e08e-4714-9eba-b8691d921ee7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:01.658327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50cbbb-e08e-4714-9eba-b8691d921ee7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:01.659934 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50cbbb-e08e-4714-9eba-b8691d921ee7 service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:01.669843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1356/2703] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:10.406905 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:11.665636 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=44 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:37.974964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bc04e-3431-47dc-92d8-0e9d6ed801b6 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:37.976579 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-288bc04e-3431-47dc-92d8-0e9d6ed801b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:38.025752 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bc04e-3431-47dc-92d8-0e9d6ed801b6 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:38.030889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71db2eb-9841-46d6-bc6d-8f2d4a57982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:38.031956 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71db2eb-9841-46d6-bc6d-8f2d4a57982c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.032351 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71db2eb-9841-46d6-bc6d-8f2d4a57982c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.032735 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71db2eb-9841-46d6-bc6d-8f2d4a57982c admin admin] PATH_INFO: `/v3/users/1943ba023a424b53a6b2128ba02c773c` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.034186 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71db2eb-9841-46d6-bc6d-8f2d4a57982c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1943ba023a424b53a6b2128ba02c773c)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:38.036293 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71db2eb-9841-46d6-bc6d-8f2d4a57982c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:38.087432 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e71db2eb-9841-46d6-bc6d-8f2d4a57982c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1943ba023a424b53a6b2128ba02c773c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:38.100391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e71db2eb-9841-46d6-bc6d-8f2d4a57982c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1943ba023a424b53a6b2128ba02c773c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:38.101094 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e71db2eb-9841-46d6-bc6d-8f2d4a57982c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1943ba023a424b53a6b2128ba02c773c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:38.101705 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e71db2eb-9841-46d6-bc6d-8f2d4a57982c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1943ba023a424b53a6b2128ba02c773c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:38.108598 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-e71db2eb-9841-46d6-bc6d-8f2d4a57982c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1943ba023a424b53a6b2128ba02c773c'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:38.123050 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1348/2704] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:37 2022] DELETE /identity/v3/users/1943ba023a424b53a6b2128ba02c773c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:38.305355 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50cbbb-e08e-4714-9eba-b8691d921ee7 service placement] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:38.316579 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50cbbb-e08e-4714-9eba-b8691d921ee7 service placement] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:38.384663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d4208-c84f-4d0c-88bc-6fa8f65b4e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:38.385687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d4208-c84f-4d0c-88bc-6fa8f65b4e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.385968 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d4208-c84f-4d0c-88bc-6fa8f65b4e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.386237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d4208-c84f-4d0c-88bc-6fa8f65b4e5b admin admin] PATH_INFO: `/v3/projects/9092cfde36f34dfa86c2b4c78d34cb56` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.387507 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d4208-c84f-4d0c-88bc-6fa8f65b4e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9092cfde36f34dfa86c2b4c78d34cb56)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:38.389441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d4208-c84f-4d0c-88bc-6fa8f65b4e5b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:38.437850 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d90d4208-c84f-4d0c-88bc-6fa8f65b4e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9092cfde36f34dfa86c2b4c78d34cb56', 'request_id': 'req-d90d4208-c84f-4d0c-88bc-6fa8f65b4e5b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:38.447590 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d90d4208-c84f-4d0c-88bc-6fa8f65b4e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9092cfde36f34dfa86c2b4c78d34cb56', 'request_id': 'req-d90d4208-c84f-4d0c-88bc-6fa8f65b4e5b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:38.455430 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d90d4208-c84f-4d0c-88bc-6fa8f65b4e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9092cfde36f34dfa86c2b4c78d34cb56', 'request_id': 'req-d90d4208-c84f-4d0c-88bc-6fa8f65b4e5b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:38.467125 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d90d4208-c84f-4d0c-88bc-6fa8f65b4e5b admin admin] The token cache is being invalidate because project 9092cfde36f34dfa86c2b4c78d34cb56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:38.467419 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d90d4208-c84f-4d0c-88bc-6fa8f65b4e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:38.468118 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d90d4208-c84f-4d0c-88bc-6fa8f65b4e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:38.469696 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1357/2705] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:38 2022] DELETE /identity/v3/projects/9092cfde36f34dfa86c2b4c78d34cb56 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:38.475980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ceb83-69be-43ea-8535-39db09765dd7 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.476177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ceb83-69be-43ea-8535-39db09765dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.476481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ceb83-69be-43ea-8535-39db09765dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.540935 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-866ceb83-69be-43ea-8535-39db09765dd7 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:38.542127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-866ceb83-69be-43ea-8535-39db09765dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:38.607280 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1349/2706] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:38.615298 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b3da3-8384-4e51-a689-c7a8373c4c22 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.615592 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b3da3-8384-4e51-a689-c7a8373c4c22 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.615912 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b3da3-8384-4e51-a689-c7a8373c4c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.641452 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-098b3da3-8384-4e51-a689-c7a8373c4c22 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:38.642678 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-098b3da3-8384-4e51-a689-c7a8373c4c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:38.653028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1358/2707] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:38.657255 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ceb83-69be-43ea-8535-39db09765dd7 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:38.667575 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ceb83-69be-43ea-8535-39db09765dd7 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:38.672551 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcac7b5-a5c2-44b3-9fcd-0b70085a356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:38.673208 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcac7b5-a5c2-44b3-9fcd-0b70085a356c admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.673493 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcac7b5-a5c2-44b3-9fcd-0b70085a356c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.673771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcac7b5-a5c2-44b3-9fcd-0b70085a356c admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.674509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcac7b5-a5c2-44b3-9fcd-0b70085a356c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:39:38.674818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcac7b5-a5c2-44b3-9fcd-0b70085a356c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:38.676473 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcac7b5-a5c2-44b3-9fcd-0b70085a356c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:38.685447 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:38.689595 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1350/2708] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:39:38.693551 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b3da3-8384-4e51-a689-c7a8373c4c22 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:38.703240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b3da3-8384-4e51-a689-c7a8373c4c22 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:38.708753 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3f3c0-6623-41dc-9a62-cf3f3e940804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:38.709403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3f3c0-6623-41dc-9a62-cf3f3e940804 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.709687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3f3c0-6623-41dc-9a62-cf3f3e940804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.709963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3f3c0-6623-41dc-9a62-cf3f3e940804 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.710660 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3f3c0-6623-41dc-9a62-cf3f3e940804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:38.712694 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3f3c0-6623-41dc-9a62-cf3f3e940804 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:38.742483 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1359/2709] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:38 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:38.747454 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcac7b5-a5c2-44b3-9fcd-0b70085a356c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:38.757599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcac7b5-a5c2-44b3-9fcd-0b70085a356c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:38.819232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf9690-4dbd-4f83-aa65-6bc7363889fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:38.819933 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf9690-4dbd-4f83-aa65-6bc7363889fa admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.820208 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf9690-4dbd-4f83-aa65-6bc7363889fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.820511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf9690-4dbd-4f83-aa65-6bc7363889fa admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.821191 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf9690-4dbd-4f83-aa65-6bc7363889fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:38.823164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf9690-4dbd-4f83-aa65-6bc7363889fa admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:38.845801 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1351/2710] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:38 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:38.850633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3f3c0-6623-41dc-9a62-cf3f3e940804 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:38.861361 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3f3c0-6623-41dc-9a62-cf3f3e940804 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:38.866247 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d226a1-c9ef-48ae-a6a8-f9b7b6cd849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:38.866902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d226a1-c9ef-48ae-a6a8-f9b7b6cd849e admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.867184 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d226a1-c9ef-48ae-a6a8-f9b7b6cd849e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.867456 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d226a1-c9ef-48ae-a6a8-f9b7b6cd849e admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.868215 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d226a1-c9ef-48ae-a6a8-f9b7b6cd849e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:38.870000 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d226a1-c9ef-48ae-a6a8-f9b7b6cd849e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:38.880942 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1360/2711] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:38.886675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf9690-4dbd-4f83-aa65-6bc7363889fa admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:38.898384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf9690-4dbd-4f83-aa65-6bc7363889fa admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:38.904172 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b54ac-156c-466e-bc3d-573a48bed4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:38.904851 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b54ac-156c-466e-bc3d-573a48bed4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.905211 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b54ac-156c-466e-bc3d-573a48bed4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.905488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b54ac-156c-466e-bc3d-573a48bed4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.906251 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b54ac-156c-466e-bc3d-573a48bed4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:38.907898 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b54ac-156c-466e-bc3d-573a48bed4a3 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:38.918516 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1352/2712] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:38.922793 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d226a1-c9ef-48ae-a6a8-f9b7b6cd849e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:38.933747 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d226a1-c9ef-48ae-a6a8-f9b7b6cd849e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:38.938908 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b14df-c47f-4365-814d-7e8136c7b479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:38.939839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b14df-c47f-4365-814d-7e8136c7b479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.940123 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b14df-c47f-4365-814d-7e8136c7b479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.940396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b14df-c47f-4365-814d-7e8136c7b479 admin admin] PATH_INFO: `/v3/projects/044c1736098948fa9632fb79669db68b/users/8b42cfe63c6f44fb9e34c1bc6e60a4ed/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.956282 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b14df-c47f-4365-814d-7e8136c7b479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044c1736098948fa9632fb79669db68b, user_id=8b42cfe63c6f44fb9e34c1bc6e60a4ed, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:38.959048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b14df-c47f-4365-814d-7e8136c7b479 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:38.974667 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1361/2713] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:38 2022] PUT /identity/v3/projects/044c1736098948fa9632fb79669db68b/users/8b42cfe63c6f44fb9e34c1bc6e60a4ed/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:38.991647 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18569885-4425-4093-8ee8-39dc7b335484 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.992138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18569885-4425-4093-8ee8-39dc7b335484 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.992267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18569885-4425-4093-8ee8-39dc7b335484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:39.022672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-18569885-4425-4093-8ee8-39dc7b335484 None None] MFA Rules not processed for user `8b42cfe63c6f44fb9e34c1bc6e60a4ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:39.024612 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-18569885-4425-4093-8ee8-39dc7b335484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:39.095624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1353/2714] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:39.100719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b14df-c47f-4365-814d-7e8136c7b479 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:39.132457 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:39.168213 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b14df-c47f-4365-814d-7e8136c7b479 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:39.174231 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79cc17-5093-480f-9595-a2832fca6126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:39.174876 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79cc17-5093-480f-9595-a2832fca6126 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:39.175170 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79cc17-5093-480f-9595-a2832fca6126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:39.175440 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79cc17-5093-480f-9595-a2832fca6126 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:39.176166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79cc17-5093-480f-9595-a2832fca6126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:39.178110 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79cc17-5093-480f-9595-a2832fca6126 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:39.205855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1362/2715] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:39 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:39:39.210052 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18569885-4425-4093-8ee8-39dc7b335484 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:39.223531 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18569885-4425-4093-8ee8-39dc7b335484 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:39.279859 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58192d2-4707-4382-ba06-31620b349e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:39.280440 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58192d2-4707-4382-ba06-31620b349e4b admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:39.280720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58192d2-4707-4382-ba06-31620b349e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:39.280995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58192d2-4707-4382-ba06-31620b349e4b admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:39.281686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58192d2-4707-4382-ba06-31620b349e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:39.283631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58192d2-4707-4382-ba06-31620b349e4b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:39.299438 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:39.307202 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1354/2716] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:39 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:39.311207 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79cc17-5093-480f-9595-a2832fca6126 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:39.322259 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79cc17-5093-480f-9595-a2832fca6126 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:39.328236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78046279-2c44-45cb-a5ac-881f5340ac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:39.328899 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78046279-2c44-45cb-a5ac-881f5340ac60 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:39.329180 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78046279-2c44-45cb-a5ac-881f5340ac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:39.329450 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78046279-2c44-45cb-a5ac-881f5340ac60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:39.330173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78046279-2c44-45cb-a5ac-881f5340ac60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:39.331805 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78046279-2c44-45cb-a5ac-881f5340ac60 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:39.342960 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1363/2717] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:39.347686 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58192d2-4707-4382-ba06-31620b349e4b admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:39.358228 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58192d2-4707-4382-ba06-31620b349e4b admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:39.364056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78511e4-faa3-4e74-9f14-8daf1fdb6359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:39.364968 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78511e4-faa3-4e74-9f14-8daf1fdb6359 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:39.365242 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78511e4-faa3-4e74-9f14-8daf1fdb6359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:39.365516 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78511e4-faa3-4e74-9f14-8daf1fdb6359 admin admin] PATH_INFO: `/v3/projects/8e8aa88b25834162af1b4d01423df2f1/users/132568c93e3e45a4b76e6a0bc2944194/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:39.381207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78511e4-faa3-4e74-9f14-8daf1fdb6359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8aa88b25834162af1b4d01423df2f1, user_id=132568c93e3e45a4b76e6a0bc2944194, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:39.384081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78511e4-faa3-4e74-9f14-8daf1fdb6359 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:39.404760 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1355/2718] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:39 2022] PUT /identity/v3/projects/8e8aa88b25834162af1b4d01423df2f1/users/132568c93e3e45a4b76e6a0bc2944194/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:39.408962 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78046279-2c44-45cb-a5ac-881f5340ac60 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:39.419502 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78046279-2c44-45cb-a5ac-881f5340ac60 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:39.478016 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0fb4d-ef17-421c-a302-c43138e752fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:39.478928 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0fb4d-ef17-421c-a302-c43138e752fe admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:39.479372 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0fb4d-ef17-421c-a302-c43138e752fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:39.479684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0fb4d-ef17-421c-a302-c43138e752fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:39.480426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0fb4d-ef17-421c-a302-c43138e752fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:39.482053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0fb4d-ef17-421c-a302-c43138e752fe admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:39.492715 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1364/2719] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:39.497689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78511e4-faa3-4e74-9f14-8daf1fdb6359 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:39.508713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78511e4-faa3-4e74-9f14-8daf1fdb6359 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:39.513939 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd3af3-6fc1-419a-ba65-17bcce630d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:39.514820 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd3af3-6fc1-419a-ba65-17bcce630d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:39.515103 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd3af3-6fc1-419a-ba65-17bcce630d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:39.515375 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd3af3-6fc1-419a-ba65-17bcce630d60 admin admin] PATH_INFO: `/v3/projects/8e8aa88b25834162af1b4d01423df2f1/users/132568c93e3e45a4b76e6a0bc2944194/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:39.517491 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd3af3-6fc1-419a-ba65-17bcce630d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8aa88b25834162af1b4d01423df2f1, user_id=132568c93e3e45a4b76e6a0bc2944194, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:39.520174 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd3af3-6fc1-419a-ba65-17bcce630d60 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:39.532147 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1356/2720] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:39 2022] PUT /identity/v3/projects/8e8aa88b25834162af1b4d01423df2f1/users/132568c93e3e45a4b76e6a0bc2944194/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:39.543398 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d48748-5f5e-4968-9bb7-83ea43aeec24 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:39.543742 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d48748-5f5e-4968-9bb7-83ea43aeec24 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:39.544119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d48748-5f5e-4968-9bb7-83ea43aeec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:39.577167 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-38d48748-5f5e-4968-9bb7-83ea43aeec24 None None] MFA Rules not processed for user `132568c93e3e45a4b76e6a0bc2944194`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:39.578375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-38d48748-5f5e-4968-9bb7-83ea43aeec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:39.653937 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1365/2721] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:39.670085 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd3af3-6fc1-419a-ba65-17bcce630d60 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:39.672275 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9fdd3af3-6fc1-419a-ba65-17bcce630d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:39.762027 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd3af3-6fc1-419a-ba65-17bcce630d60 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:39.766251 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fee076-479e-4f50-bcd1-40eca4ffbaff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:39.766897 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fee076-479e-4f50-bcd1-40eca4ffbaff service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:39.767181 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fee076-479e-4f50-bcd1-40eca4ffbaff service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:39.767459 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fee076-479e-4f50-bcd1-40eca4ffbaff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:39.833305 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fee076-479e-4f50-bcd1-40eca4ffbaff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:39.834837 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fee076-479e-4f50-bcd1-40eca4ffbaff service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:39.845493 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1357/2722] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:41.204939 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d48748-5f5e-4968-9bb7-83ea43aeec24 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:41.207285 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-38d48748-5f5e-4968-9bb7-83ea43aeec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:41.222821 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d48748-5f5e-4968-9bb7-83ea43aeec24 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:41.226822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4192c-a3b1-4931-b490-fd731f44adb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:41.227472 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4192c-a3b1-4931-b490-fd731f44adb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:41.227789 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4192c-a3b1-4931-b490-fd731f44adb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:41.228064 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4192c-a3b1-4931-b490-fd731f44adb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:41.237484 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4192c-a3b1-4931-b490-fd731f44adb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:41.238932 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4192c-a3b1-4931-b490-fd731f44adb8 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:41.249172 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1366/2723] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:45.062759 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fee076-479e-4f50-bcd1-40eca4ffbaff service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:45.131228 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:45.137910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fee076-479e-4f50-bcd1-40eca4ffbaff service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:45.143210 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb2c0b-9370-4276-8390-ad9ac1d10d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:45.144426 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb2c0b-9370-4276-8390-ad9ac1d10d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:45.144918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb2c0b-9370-4276-8390-ad9ac1d10d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:45.145409 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb2c0b-9370-4276-8390-ad9ac1d10d8c admin admin] PATH_INFO: `/v3/users/8b42cfe63c6f44fb9e34c1bc6e60a4ed` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:45.147534 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb2c0b-9370-4276-8390-ad9ac1d10d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b42cfe63c6f44fb9e34c1bc6e60a4ed)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:45.151354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb2c0b-9370-4276-8390-ad9ac1d10d8c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:45.209924 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c2fb2c0b-9370-4276-8390-ad9ac1d10d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b42cfe63c6f44fb9e34c1bc6e60a4ed'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:45.224220 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c2fb2c0b-9370-4276-8390-ad9ac1d10d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b42cfe63c6f44fb9e34c1bc6e60a4ed'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:45.224967 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c2fb2c0b-9370-4276-8390-ad9ac1d10d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b42cfe63c6f44fb9e34c1bc6e60a4ed'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:45.225667 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c2fb2c0b-9370-4276-8390-ad9ac1d10d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b42cfe63c6f44fb9e34c1bc6e60a4ed'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:45.233607 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-c2fb2c0b-9370-4276-8390-ad9ac1d10d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b42cfe63c6f44fb9e34c1bc6e60a4ed'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:45.249825 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1358/2724] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:45 2022] DELETE /identity/v3/users/8b42cfe63c6f44fb9e34c1bc6e60a4ed => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:45.255902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433af5e9-2cf2-4ebd-9607-26d9f6de4ade None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:45.256383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433af5e9-2cf2-4ebd-9607-26d9f6de4ade None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:45.256509 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433af5e9-2cf2-4ebd-9607-26d9f6de4ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:45.274727 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-433af5e9-2cf2-4ebd-9607-26d9f6de4ade None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:45.275848 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-433af5e9-2cf2-4ebd-9607-26d9f6de4ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:45.280058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:45.347633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1367/2725] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:45.361055 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb2c0b-9370-4276-8390-ad9ac1d10d8c admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:45.363516 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-c2fb2c0b-9370-4276-8390-ad9ac1d10d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:45.455119 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb2c0b-9370-4276-8390-ad9ac1d10d8c admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:45.459496 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f6b72-c47d-406a-8a93-9e9537749e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:45.460180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f6b72-c47d-406a-8a93-9e9537749e33 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:45.460462 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f6b72-c47d-406a-8a93-9e9537749e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:45.460732 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f6b72-c47d-406a-8a93-9e9537749e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:45.470259 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f6b72-c47d-406a-8a93-9e9537749e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:45.472087 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f6b72-c47d-406a-8a93-9e9537749e33 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:45.481570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1359/2726] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:45.778033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433af5e9-2cf2-4ebd-9607-26d9f6de4ade None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:45.779639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-433af5e9-2cf2-4ebd-9607-26d9f6de4ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:45.794301 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433af5e9-2cf2-4ebd-9607-26d9f6de4ade None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:45.799173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e07c1-5b2f-4f81-ac62-906dc031266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:45.800756 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e07c1-5b2f-4f81-ac62-906dc031266b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:45.801067 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e07c1-5b2f-4f81-ac62-906dc031266b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:45.801343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e07c1-5b2f-4f81-ac62-906dc031266b admin admin] PATH_INFO: `/v3/projects/044c1736098948fa9632fb79669db68b` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:45.802826 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e07c1-5b2f-4f81-ac62-906dc031266b admin admin] RBAC: Authorizing `identity:delete_project(project_id=044c1736098948fa9632fb79669db68b)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:45.805587 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e07c1-5b2f-4f81-ac62-906dc031266b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:45.860316 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c68e07c1-5b2f-4f81-ac62-906dc031266b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044c1736098948fa9632fb79669db68b', 'request_id': 'req-c68e07c1-5b2f-4f81-ac62-906dc031266b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:45.869511 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c68e07c1-5b2f-4f81-ac62-906dc031266b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044c1736098948fa9632fb79669db68b', 'request_id': 'req-c68e07c1-5b2f-4f81-ac62-906dc031266b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:45.876675 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c68e07c1-5b2f-4f81-ac62-906dc031266b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044c1736098948fa9632fb79669db68b', 'request_id': 'req-c68e07c1-5b2f-4f81-ac62-906dc031266b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:45.888564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c68e07c1-5b2f-4f81-ac62-906dc031266b admin admin] The token cache is being invalidate because project 044c1736098948fa9632fb79669db68b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:45.888852 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c68e07c1-5b2f-4f81-ac62-906dc031266b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:45.889549 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c68e07c1-5b2f-4f81-ac62-906dc031266b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:45.891203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1368/2727] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:45 2022] DELETE /identity/v3/projects/044c1736098948fa9632fb79669db68b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:45.895442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f6b72-c47d-406a-8a93-9e9537749e33 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:45.905971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f6b72-c47d-406a-8a93-9e9537749e33 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:45.964846 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:45.975441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87911816-e77b-472b-b92c-0638fefb080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:45.976552 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87911816-e77b-472b-b92c-0638fefb080c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:45.976841 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87911816-e77b-472b-b92c-0638fefb080c admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:45.977600 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87911816-e77b-472b-b92c-0638fefb080c admin admin] PATH_INFO: `/v3/users/132568c93e3e45a4b76e6a0bc2944194` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:45.979722 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87911816-e77b-472b-b92c-0638fefb080c admin admin] RBAC: Authorizing `identity:delete_user(user_id=132568c93e3e45a4b76e6a0bc2944194)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:45.982700 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87911816-e77b-472b-b92c-0638fefb080c admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:46.039062 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-87911816-e77b-472b-b92c-0638fefb080c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132568c93e3e45a4b76e6a0bc2944194'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:46.052752 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-87911816-e77b-472b-b92c-0638fefb080c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132568c93e3e45a4b76e6a0bc2944194'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:46.053406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-87911816-e77b-472b-b92c-0638fefb080c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132568c93e3e45a4b76e6a0bc2944194'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:46.053995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-87911816-e77b-472b-b92c-0638fefb080c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132568c93e3e45a4b76e6a0bc2944194'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:46.061023 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-87911816-e77b-472b-b92c-0638fefb080c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132568c93e3e45a4b76e6a0bc2944194'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:46.075432 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1360/2728] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:45 2022] DELETE /identity/v3/users/132568c93e3e45a4b76e6a0bc2944194 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:39:46.357867 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e07c1-5b2f-4f81-ac62-906dc031266b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:46.359536 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c68e07c1-5b2f-4f81-ac62-906dc031266b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:46.375821 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e07c1-5b2f-4f81-ac62-906dc031266b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:46.433138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c12a99-d245-4220-a119-3efe3467175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:46.434085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c12a99-d245-4220-a119-3efe3467175b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:46.434369 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c12a99-d245-4220-a119-3efe3467175b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:46.434642 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c12a99-d245-4220-a119-3efe3467175b admin admin] PATH_INFO: `/v3/projects/8e8aa88b25834162af1b4d01423df2f1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:46.435868 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c12a99-d245-4220-a119-3efe3467175b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8aa88b25834162af1b4d01423df2f1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:46.437780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c12a99-d245-4220-a119-3efe3467175b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:46.480327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:46.490463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d2c12a99-d245-4220-a119-3efe3467175b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8aa88b25834162af1b4d01423df2f1', 'request_id': 'req-d2c12a99-d245-4220-a119-3efe3467175b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:46.499816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d2c12a99-d245-4220-a119-3efe3467175b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8aa88b25834162af1b4d01423df2f1', 'request_id': 'req-d2c12a99-d245-4220-a119-3efe3467175b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:46.506166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d2c12a99-d245-4220-a119-3efe3467175b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8aa88b25834162af1b4d01423df2f1', 'request_id': 'req-d2c12a99-d245-4220-a119-3efe3467175b'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:46.517719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d2c12a99-d245-4220-a119-3efe3467175b admin admin] The token cache is being invalidate because project 8e8aa88b25834162af1b4d01423df2f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:46.517977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d2c12a99-d245-4220-a119-3efe3467175b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:46.518663 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-d2c12a99-d245-4220-a119-3efe3467175b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:46.520325 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1369/2729] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:46 2022] DELETE /identity/v3/projects/8e8aa88b25834162af1b4d01423df2f1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:39:46.526160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9bb7b-e538-4502-97b0-125288eef5ef None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:46.526497 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9bb7b-e538-4502-97b0-125288eef5ef None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:46.526772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9bb7b-e538-4502-97b0-125288eef5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:46.544533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-fca9bb7b-e538-4502-97b0-125288eef5ef None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:46.545834 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fca9bb7b-e538-4502-97b0-125288eef5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:46.604631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1361/2730] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:39:46.612967 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0741-51c4-4732-9bf2-a5c92a4976d0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:46.613258 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0741-51c4-4732-9bf2-a5c92a4976d0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:46.613535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0741-51c4-4732-9bf2-a5c92a4976d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:46.632866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a38b0741-51c4-4732-9bf2-a5c92a4976d0 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:46.634092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a38b0741-51c4-4732-9bf2-a5c92a4976d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:46.643812 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1370/2731] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:46.648127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9bb7b-e538-4502-97b0-125288eef5ef None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:46.658824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9bb7b-e538-4502-97b0-125288eef5ef None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:46.664816 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e4734-84fd-4049-9a90-8d02f7d53dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:46.665503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4734-84fd-4049-9a90-8d02f7d53dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:46.665778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4734-84fd-4049-9a90-8d02f7d53dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:46.666046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4734-84fd-4049-9a90-8d02f7d53dc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:46.666782 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e4734-84fd-4049-9a90-8d02f7d53dc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:39:46.667083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e4734-84fd-4049-9a90-8d02f7d53dc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:46.668840 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e4734-84fd-4049-9a90-8d02f7d53dc5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:46.681021 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1362/2732] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:39:46.687795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b0741-51c4-4732-9bf2-a5c92a4976d0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:46.700615 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b0741-51c4-4732-9bf2-a5c92a4976d0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:46.706324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e219e66-477b-4e69-afaf-5a234efa0fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:46.706985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e219e66-477b-4e69-afaf-5a234efa0fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:46.707260 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e219e66-477b-4e69-afaf-5a234efa0fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:46.707531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e219e66-477b-4e69-afaf-5a234efa0fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:46.708251 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e219e66-477b-4e69-afaf-5a234efa0fe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:46.710147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e219e66-477b-4e69-afaf-5a234efa0fe6 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:46.740271 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1371/2733] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:46 2022] POST /identity/v3/projects => generated 401 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:46.745014 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e4734-84fd-4049-9a90-8d02f7d53dc5 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:46.757644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e4734-84fd-4049-9a90-8d02f7d53dc5 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:46.818968 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f77b8-6630-4bdb-a196-1a1fa36e3014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:46.819672 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f77b8-6630-4bdb-a196-1a1fa36e3014 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:46.819961 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f77b8-6630-4bdb-a196-1a1fa36e3014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:46.820240 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f77b8-6630-4bdb-a196-1a1fa36e3014 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:46.820937 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f77b8-6630-4bdb-a196-1a1fa36e3014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:46.823060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f77b8-6630-4bdb-a196-1a1fa36e3014 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:46.832097 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:46.851243 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1363/2734] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:46 2022] POST /identity/v3/users => generated 301 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:46.855752 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e219e66-477b-4e69-afaf-5a234efa0fe6 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:46.866611 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e219e66-477b-4e69-afaf-5a234efa0fe6 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:46.872176 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66f01a-7768-43f9-96d8-e993967aac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:46.872840 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66f01a-7768-43f9-96d8-e993967aac3b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:46.873120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66f01a-7768-43f9-96d8-e993967aac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:46.873389 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66f01a-7768-43f9-96d8-e993967aac3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:46.874120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66f01a-7768-43f9-96d8-e993967aac3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:46.875993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66f01a-7768-43f9-96d8-e993967aac3b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:46.886733 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1372/2735] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:46.891041 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f77b8-6630-4bdb-a196-1a1fa36e3014 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:46.902023 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f77b8-6630-4bdb-a196-1a1fa36e3014 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:46.907856 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e0718-3412-455b-8695-4d6bd584166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:46.908529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e0718-3412-455b-8695-4d6bd584166d admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:46.908829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e0718-3412-455b-8695-4d6bd584166d admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:46.909101 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e0718-3412-455b-8695-4d6bd584166d admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:46.909839 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e0718-3412-455b-8695-4d6bd584166d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:46.911432 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e0718-3412-455b-8695-4d6bd584166d admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:46.922140 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1364/2736] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:46.926333 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66f01a-7768-43f9-96d8-e993967aac3b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:46.937870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66f01a-7768-43f9-96d8-e993967aac3b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:46.942941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcffa23-1f81-475e-901a-12e0732a3fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:46.943863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcffa23-1f81-475e-901a-12e0732a3fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:46.944139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcffa23-1f81-475e-901a-12e0732a3fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:46.944418 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcffa23-1f81-475e-901a-12e0732a3fdc admin admin] PATH_INFO: `/v3/projects/4c37b829554d4d56ab2a145592f51406/users/ccafe8fda3d544aa8828c089fa29d2b1/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:46.959442 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcffa23-1f81-475e-901a-12e0732a3fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c37b829554d4d56ab2a145592f51406, user_id=ccafe8fda3d544aa8828c089fa29d2b1, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:46.962274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcffa23-1f81-475e-901a-12e0732a3fdc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:46.977351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1373/2737] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:46 2022] PUT /identity/v3/projects/4c37b829554d4d56ab2a145592f51406/users/ccafe8fda3d544aa8828c089fa29d2b1/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:46.989327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d0252-f2f3-4543-8671-b9d924455d8b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:46.989617 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d0252-f2f3-4543-8671-b9d924455d8b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:46.989891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d0252-f2f3-4543-8671-b9d924455d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.018192 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-db8d0252-f2f3-4543-8671-b9d924455d8b None None] MFA Rules not processed for user `ccafe8fda3d544aa8828c089fa29d2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:47.019468 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-db8d0252-f2f3-4543-8671-b9d924455d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:47.087377 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1365/2738] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:47.092917 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcffa23-1f81-475e-901a-12e0732a3fdc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:47.164819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcffa23-1f81-475e-901a-12e0732a3fdc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:47.172928 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9964d2-891d-428e-a5b9-74f63bbef6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:47.173900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9964d2-891d-428e-a5b9-74f63bbef6ca admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:47.174269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9964d2-891d-428e-a5b9-74f63bbef6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:47.174701 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9964d2-891d-428e-a5b9-74f63bbef6ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.175845 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9964d2-891d-428e-a5b9-74f63bbef6ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:47.178952 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9964d2-891d-428e-a5b9-74f63bbef6ca admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:47.215915 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1374/2739] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:47 2022] POST /identity/v3/projects => generated 401 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:47.220184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d0252-f2f3-4543-8671-b9d924455d8b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:47.232207 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d0252-f2f3-4543-8671-b9d924455d8b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:47.293633 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c58930-2376-45ec-9198-4ca5b428b7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:47.294294 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c58930-2376-45ec-9198-4ca5b428b7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:47.294577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c58930-2376-45ec-9198-4ca5b428b7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:47.294855 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c58930-2376-45ec-9198-4ca5b428b7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.295549 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c58930-2376-45ec-9198-4ca5b428b7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:47.297524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c58930-2376-45ec-9198-4ca5b428b7b1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:47.319843 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1366/2740] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:47 2022] POST /identity/v3/users => generated 307 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:47.324502 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9964d2-891d-428e-a5b9-74f63bbef6ca admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:47.335591 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9964d2-891d-428e-a5b9-74f63bbef6ca admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:47.343621 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a0b62-56d2-4a5e-b672-9b481a597c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:47.344324 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a0b62-56d2-4a5e-b672-9b481a597c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:47.344634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a0b62-56d2-4a5e-b672-9b481a597c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:47.344917 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a0b62-56d2-4a5e-b672-9b481a597c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.345651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a0b62-56d2-4a5e-b672-9b481a597c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:47.347604 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a0b62-56d2-4a5e-b672-9b481a597c1d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:47.358563 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1375/2741] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:47.362989 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c58930-2376-45ec-9198-4ca5b428b7b1 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:47.373458 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c58930-2376-45ec-9198-4ca5b428b7b1 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:47.378385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132edee-d977-4f6d-ac3a-1ead5e61820f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:47.379272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132edee-d977-4f6d-ac3a-1ead5e61820f admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:47.379560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132edee-d977-4f6d-ac3a-1ead5e61820f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:47.379862 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132edee-d977-4f6d-ac3a-1ead5e61820f admin admin] PATH_INFO: `/v3/projects/dc0baea663ce4837ac435761249b6eb2/users/d3b9033f8d544336a1bd53eb00cfe6e1/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.396201 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132edee-d977-4f6d-ac3a-1ead5e61820f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0baea663ce4837ac435761249b6eb2, user_id=d3b9033f8d544336a1bd53eb00cfe6e1, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:47.398882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132edee-d977-4f6d-ac3a-1ead5e61820f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:47.418400 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1367/2742] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:47 2022] PUT /identity/v3/projects/dc0baea663ce4837ac435761249b6eb2/users/d3b9033f8d544336a1bd53eb00cfe6e1/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:39:47.422448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a0b62-56d2-4a5e-b672-9b481a597c1d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:47.433053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a0b62-56d2-4a5e-b672-9b481a597c1d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:47.464612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:47.493845 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf85969-6800-457e-bbeb-10711e01fa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:47.494444 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf85969-6800-457e-bbeb-10711e01fa84 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:47.494725 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf85969-6800-457e-bbeb-10711e01fa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:47.495001 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf85969-6800-457e-bbeb-10711e01fa84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.495814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf85969-6800-457e-bbeb-10711e01fa84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:47.497461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf85969-6800-457e-bbeb-10711e01fa84 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:47.507488 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1376/2743] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:47.512154 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132edee-d977-4f6d-ac3a-1ead5e61820f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:47.522981 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132edee-d977-4f6d-ac3a-1ead5e61820f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:47.528135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c3743-2978-4067-b75b-2cb58d0970c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:47.529026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c3743-2978-4067-b75b-2cb58d0970c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:47.529313 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c3743-2978-4067-b75b-2cb58d0970c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:47.529592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c3743-2978-4067-b75b-2cb58d0970c4 admin admin] PATH_INFO: `/v3/projects/dc0baea663ce4837ac435761249b6eb2/users/d3b9033f8d544336a1bd53eb00cfe6e1/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.531653 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c3743-2978-4067-b75b-2cb58d0970c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0baea663ce4837ac435761249b6eb2, user_id=d3b9033f8d544336a1bd53eb00cfe6e1, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:47.534322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c3743-2978-4067-b75b-2cb58d0970c4 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:47.544806 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1368/2744] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:47 2022] PUT /identity/v3/projects/dc0baea663ce4837ac435761249b6eb2/users/d3b9033f8d544336a1bd53eb00cfe6e1/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:47.555010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f49dad-6387-4f7c-be43-d70db030912d None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:47.555307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f49dad-6387-4f7c-be43-d70db030912d None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:47.555616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f49dad-6387-4f7c-be43-d70db030912d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.582985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-21f49dad-6387-4f7c-be43-d70db030912d None None] MFA Rules not processed for user `d3b9033f8d544336a1bd53eb00cfe6e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:47.584254 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-21f49dad-6387-4f7c-be43-d70db030912d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:47.656574 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1377/2745] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:47 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:47.667802 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c3743-2978-4067-b75b-2cb58d0970c4 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:47.669867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-de5c3743-2978-4067-b75b-2cb58d0970c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:47.698380 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:47.739746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c3743-2978-4067-b75b-2cb58d0970c4 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:47.746548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fe1cf-8887-4809-9a4b-c93700102c1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:47.747150 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fe1cf-8887-4809-9a4b-c93700102c1f service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:47.747441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fe1cf-8887-4809-9a4b-c93700102c1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:47.747749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fe1cf-8887-4809-9a4b-c93700102c1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.759666 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fe1cf-8887-4809-9a4b-c93700102c1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:47.762286 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fe1cf-8887-4809-9a4b-c93700102c1f service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:47.778513 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1369/2746] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:47 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:47.856677 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f49dad-6387-4f7c-be43-d70db030912d None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:47.866945 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f49dad-6387-4f7c-be43-d70db030912d None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:47.870904 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf9677-0354-4209-8d82-c8051e2be539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:47.871669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf9677-0354-4209-8d82-c8051e2be539 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:47.871952 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf9677-0354-4209-8d82-c8051e2be539 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:47.872223 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf9677-0354-4209-8d82-c8051e2be539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.932939 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf9677-0354-4209-8d82-c8051e2be539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:47.934763 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf9677-0354-4209-8d82-c8051e2be539 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:47.944545 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1378/2747] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:52.068067 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fe1cf-8887-4809-9a4b-c93700102c1f service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:52.142636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fe1cf-8887-4809-9a4b-c93700102c1f service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:52.148801 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14508cad-6045-446f-9550-69869d414a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:52.149771 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14508cad-6045-446f-9550-69869d414a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:52.150128 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14508cad-6045-446f-9550-69869d414a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:52.150465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14508cad-6045-446f-9550-69869d414a39 admin admin] PATH_INFO: `/v3/users/ccafe8fda3d544aa8828c089fa29d2b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:52.151790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14508cad-6045-446f-9550-69869d414a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccafe8fda3d544aa8828c089fa29d2b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:52.153901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14508cad-6045-446f-9550-69869d414a39 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:52.205523 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-14508cad-6045-446f-9550-69869d414a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccafe8fda3d544aa8828c089fa29d2b1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.217623 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-14508cad-6045-446f-9550-69869d414a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccafe8fda3d544aa8828c089fa29d2b1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.218345 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-14508cad-6045-446f-9550-69869d414a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccafe8fda3d544aa8828c089fa29d2b1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.218980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-14508cad-6045-446f-9550-69869d414a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccafe8fda3d544aa8828c089fa29d2b1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.226164 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-14508cad-6045-446f-9550-69869d414a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccafe8fda3d544aa8828c089fa29d2b1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.240679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1370/2748] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:52 2022] DELETE /identity/v3/users/ccafe8fda3d544aa8828c089fa29d2b1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:52.245415 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b418227-38d5-4578-9787-2530005ebb45 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:52.245950 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b418227-38d5-4578-9787-2530005ebb45 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:52.246183 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b418227-38d5-4578-9787-2530005ebb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:52.264546 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8b418227-38d5-4578-9787-2530005ebb45 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:52.265861 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8b418227-38d5-4578-9787-2530005ebb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:52.313834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:52.326806 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1379/2749] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:52.336917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14508cad-6045-446f-9550-69869d414a39 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:52.338450 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-14508cad-6045-446f-9550-69869d414a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:52.396651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:52.404282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14508cad-6045-446f-9550-69869d414a39 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:52.409490 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e6b21-d1ad-4415-8593-6cff7ce6185c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:52.410365 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e6b21-d1ad-4415-8593-6cff7ce6185c service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:52.410917 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e6b21-d1ad-4415-8593-6cff7ce6185c service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:52.411429 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e6b21-d1ad-4415-8593-6cff7ce6185c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:52.423047 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e6b21-d1ad-4415-8593-6cff7ce6185c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:52.424592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e6b21-d1ad-4415-8593-6cff7ce6185c service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:52.436250 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1371/2750] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:52.726784 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b418227-38d5-4578-9787-2530005ebb45 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:52.728402 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8b418227-38d5-4578-9787-2530005ebb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:52.746202 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b418227-38d5-4578-9787-2530005ebb45 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:52.752596 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdccde-795f-4431-9931-c8ab0891a178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:52.753489 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdccde-795f-4431-9931-c8ab0891a178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:52.753900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdccde-795f-4431-9931-c8ab0891a178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:52.754254 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdccde-795f-4431-9931-c8ab0891a178 admin admin] PATH_INFO: `/v3/projects/4c37b829554d4d56ab2a145592f51406` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:52.755411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdccde-795f-4431-9931-c8ab0891a178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c37b829554d4d56ab2a145592f51406)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:52.757458 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdccde-795f-4431-9931-c8ab0891a178 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:52.807288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7cbdccde-795f-4431-9931-c8ab0891a178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c37b829554d4d56ab2a145592f51406', 'request_id': 'req-7cbdccde-795f-4431-9931-c8ab0891a178'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.816569 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7cbdccde-795f-4431-9931-c8ab0891a178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c37b829554d4d56ab2a145592f51406', 'request_id': 'req-7cbdccde-795f-4431-9931-c8ab0891a178'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.822417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7cbdccde-795f-4431-9931-c8ab0891a178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c37b829554d4d56ab2a145592f51406', 'request_id': 'req-7cbdccde-795f-4431-9931-c8ab0891a178'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.834039 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7cbdccde-795f-4431-9931-c8ab0891a178 admin admin] The token cache is being invalidate because project 4c37b829554d4d56ab2a145592f51406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:52.834323 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7cbdccde-795f-4431-9931-c8ab0891a178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.834984 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-7cbdccde-795f-4431-9931-c8ab0891a178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.836821 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1380/2751] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:52 2022] DELETE /identity/v3/projects/4c37b829554d4d56ab2a145592f51406 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:52.841645 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e6b21-d1ad-4415-8593-6cff7ce6185c service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:52.852317 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e6b21-d1ad-4415-8593-6cff7ce6185c service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:52.912312 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491d08c-0928-4718-bda6-d9a3e724409a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:52.913177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491d08c-0928-4718-bda6-d9a3e724409a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:52.913461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491d08c-0928-4718-bda6-d9a3e724409a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:52.913739 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491d08c-0928-4718-bda6-d9a3e724409a admin admin] PATH_INFO: `/v3/users/d3b9033f8d544336a1bd53eb00cfe6e1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:52.914930 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491d08c-0928-4718-bda6-d9a3e724409a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b9033f8d544336a1bd53eb00cfe6e1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:52.916904 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491d08c-0928-4718-bda6-d9a3e724409a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:52.975513 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3491d08c-0928-4718-bda6-d9a3e724409a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b9033f8d544336a1bd53eb00cfe6e1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.988282 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3491d08c-0928-4718-bda6-d9a3e724409a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b9033f8d544336a1bd53eb00cfe6e1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.989040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3491d08c-0928-4718-bda6-d9a3e724409a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b9033f8d544336a1bd53eb00cfe6e1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.989649 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3491d08c-0928-4718-bda6-d9a3e724409a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b9033f8d544336a1bd53eb00cfe6e1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.996544 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-3491d08c-0928-4718-bda6-d9a3e724409a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b9033f8d544336a1bd53eb00cfe6e1'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:53.014138 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1372/2752] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:52 2022] DELETE /identity/v3/users/d3b9033f8d544336a1bd53eb00cfe6e1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:53.381033 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdccde-795f-4431-9931-c8ab0891a178 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:53.383070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-7cbdccde-795f-4431-9931-c8ab0891a178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:53.398013 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdccde-795f-4431-9931-c8ab0891a178 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:53.471498 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5f7ef-729c-4302-bd36-2326c9c83abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:53.472410 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5f7ef-729c-4302-bd36-2326c9c83abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:53.472694 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5f7ef-729c-4302-bd36-2326c9c83abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:53.472974 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5f7ef-729c-4302-bd36-2326c9c83abd admin admin] PATH_INFO: `/v3/projects/dc0baea663ce4837ac435761249b6eb2` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:53.474163 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5f7ef-729c-4302-bd36-2326c9c83abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc0baea663ce4837ac435761249b6eb2)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:53.476130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5f7ef-729c-4302-bd36-2326c9c83abd admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:53.526039 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-20c5f7ef-729c-4302-bd36-2326c9c83abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc0baea663ce4837ac435761249b6eb2', 'request_id': 'req-20c5f7ef-729c-4302-bd36-2326c9c83abd'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:53.534680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-20c5f7ef-729c-4302-bd36-2326c9c83abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc0baea663ce4837ac435761249b6eb2', 'request_id': 'req-20c5f7ef-729c-4302-bd36-2326c9c83abd'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:53.540309 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-20c5f7ef-729c-4302-bd36-2326c9c83abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc0baea663ce4837ac435761249b6eb2', 'request_id': 'req-20c5f7ef-729c-4302-bd36-2326c9c83abd'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:53.552130 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-20c5f7ef-729c-4302-bd36-2326c9c83abd admin admin] The token cache is being invalidate because project dc0baea663ce4837ac435761249b6eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:53.552420 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-20c5f7ef-729c-4302-bd36-2326c9c83abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:53.553144 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-20c5f7ef-729c-4302-bd36-2326c9c83abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:53.554815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1381/2753] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:53 2022] DELETE /identity/v3/projects/dc0baea663ce4837ac435761249b6eb2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:53.560092 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc93d4-aa64-415a-bba3-7d7d825fe67a None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:53.560713 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc93d4-aa64-415a-bba3-7d7d825fe67a None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:53.560875 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc93d4-aa64-415a-bba3-7d7d825fe67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:53.583898 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-2efc93d4-aa64-415a-bba3-7d7d825fe67a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:53.585604 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2efc93d4-aa64-415a-bba3-7d7d825fe67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:53.656285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1373/2754] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:39:53.665561 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fed14-66ba-48c1-a28a-8955a68331e4 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:53.665994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fed14-66ba-48c1-a28a-8955a68331e4 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:53.666280 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fed14-66ba-48c1-a28a-8955a68331e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:53.680244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:53.687814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-4b0fed14-66ba-48c1-a28a-8955a68331e4 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:53.690068 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4b0fed14-66ba-48c1-a28a-8955a68331e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:53.699530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1382/2755] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:53.704411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc93d4-aa64-415a-bba3-7d7d825fe67a None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:53.714418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc93d4-aa64-415a-bba3-7d7d825fe67a None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:53.719774 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1760a1-fba5-4285-b3e1-de070027b7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:53.720441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1760a1-fba5-4285-b3e1-de070027b7af admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:53.721060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1760a1-fba5-4285-b3e1-de070027b7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:53.721329 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1760a1-fba5-4285-b3e1-de070027b7af admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:53.722094 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1760a1-fba5-4285-b3e1-de070027b7af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:39:53.722396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1760a1-fba5-4285-b3e1-de070027b7af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:53.724035 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1760a1-fba5-4285-b3e1-de070027b7af admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:53.726693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:53.738180 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1374/2756] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:39:53.742183 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fed14-66ba-48c1-a28a-8955a68331e4 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:53.752341 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fed14-66ba-48c1-a28a-8955a68331e4 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:53.757447 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85eea6-cd49-42ce-a726-03375b333e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:53.758360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85eea6-cd49-42ce-a726-03375b333e8f admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:53.758727 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85eea6-cd49-42ce-a726-03375b333e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:53.759054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85eea6-cd49-42ce-a726-03375b333e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:53.759844 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85eea6-cd49-42ce-a726-03375b333e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:53.761802 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85eea6-cd49-42ce-a726-03375b333e8f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:53.788567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1383/2757] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:53 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:39:53.792176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1760a1-fba5-4285-b3e1-de070027b7af admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:53.802481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1760a1-fba5-4285-b3e1-de070027b7af admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:53.860565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6d825-914d-4dfe-8f34-c788852d81d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:53.861242 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d825-914d-4dfe-8f34-c788852d81d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:53.861521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d825-914d-4dfe-8f34-c788852d81d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:53.861798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d825-914d-4dfe-8f34-c788852d81d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:53.862503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6d825-914d-4dfe-8f34-c788852d81d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:53.864472 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6d825-914d-4dfe-8f34-c788852d81d4 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:53.887081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1375/2758] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:53 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:53.891735 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85eea6-cd49-42ce-a726-03375b333e8f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:53.903025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85eea6-cd49-42ce-a726-03375b333e8f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:53.908669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecaaa02-7eb7-466e-9cac-87ead15ca97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:53.909378 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecaaa02-7eb7-466e-9cac-87ead15ca97b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:53.909666 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecaaa02-7eb7-466e-9cac-87ead15ca97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:53.909949 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecaaa02-7eb7-466e-9cac-87ead15ca97b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:53.910684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecaaa02-7eb7-466e-9cac-87ead15ca97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:53.912347 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecaaa02-7eb7-466e-9cac-87ead15ca97b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:53.927631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1384/2759] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:53.931977 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6d825-914d-4dfe-8f34-c788852d81d4 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:53.951808 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6d825-914d-4dfe-8f34-c788852d81d4 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:53.956856 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea92b5-2eca-4d95-9083-f29ad969ef0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:53.957615 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea92b5-2eca-4d95-9083-f29ad969ef0a admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:53.958133 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea92b5-2eca-4d95-9083-f29ad969ef0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:53.958477 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea92b5-2eca-4d95-9083-f29ad969ef0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:53.959343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea92b5-2eca-4d95-9083-f29ad969ef0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:53.961451 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea92b5-2eca-4d95-9083-f29ad969ef0a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:53.977407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1376/2760] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:53.978628 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecaaa02-7eb7-466e-9cac-87ead15ca97b admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:53.989027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecaaa02-7eb7-466e-9cac-87ead15ca97b admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:53.993578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a19667-a0d8-485c-b402-fec199e01dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:53.994471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a19667-a0d8-485c-b402-fec199e01dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:53.994750 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a19667-a0d8-485c-b402-fec199e01dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:53.995022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a19667-a0d8-485c-b402-fec199e01dfb admin admin] PATH_INFO: `/v3/projects/5e5892a12d0c42469cfd7ea81009156c/users/623692f5a9614d449b03c79eab89fae9/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:54.012228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a19667-a0d8-485c-b402-fec199e01dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5892a12d0c42469cfd7ea81009156c, user_id=623692f5a9614d449b03c79eab89fae9, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:54.015395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a19667-a0d8-485c-b402-fec199e01dfb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:54.030379 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1385/2761] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:53 2022] PUT /identity/v3/projects/5e5892a12d0c42469cfd7ea81009156c/users/623692f5a9614d449b03c79eab89fae9/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:54.040994 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d8e17-5f88-430d-8ddb-1c290937fae5 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:54.041285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d8e17-5f88-430d-8ddb-1c290937fae5 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:54.041562 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d8e17-5f88-430d-8ddb-1c290937fae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:54.072390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-613d8e17-5f88-430d-8ddb-1c290937fae5 None None] MFA Rules not processed for user `623692f5a9614d449b03c79eab89fae9`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:54.074286 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-613d8e17-5f88-430d-8ddb-1c290937fae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:54.142916 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1377/2762] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:54.147644 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a19667-a0d8-485c-b402-fec199e01dfb admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:54.214761 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a19667-a0d8-485c-b402-fec199e01dfb admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:54.220307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35ed5c-9f28-47c9-994e-d27604980549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:54.221330 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35ed5c-9f28-47c9-994e-d27604980549 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:54.221621 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35ed5c-9f28-47c9-994e-d27604980549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:54.221900 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35ed5c-9f28-47c9-994e-d27604980549 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:54.222607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35ed5c-9f28-47c9-994e-d27604980549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:54.224586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35ed5c-9f28-47c9-994e-d27604980549 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:54.253816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1386/2763] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:54 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:54.256727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d8e17-5f88-430d-8ddb-1c290937fae5 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:54.267927 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d8e17-5f88-430d-8ddb-1c290937fae5 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:54.325869 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6eeea-dbad-45de-b363-34c1af6b2fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:54.326577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6eeea-dbad-45de-b363-34c1af6b2fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:54.326901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6eeea-dbad-45de-b363-34c1af6b2fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:54.327238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6eeea-dbad-45de-b363-34c1af6b2fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:54.327962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6eeea-dbad-45de-b363-34c1af6b2fb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:54.329888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6eeea-dbad-45de-b363-34c1af6b2fb1 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:54.338591 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:54.356736 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1378/2764] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:54 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:54.358119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35ed5c-9f28-47c9-994e-d27604980549 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:54.369722 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35ed5c-9f28-47c9-994e-d27604980549 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:54.374819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d0200-2d33-4224-a24b-5dd29e7716de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:54.375516 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d0200-2d33-4224-a24b-5dd29e7716de admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:54.375816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d0200-2d33-4224-a24b-5dd29e7716de admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:54.376093 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d0200-2d33-4224-a24b-5dd29e7716de admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:54.377003 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d0200-2d33-4224-a24b-5dd29e7716de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:54.378654 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d0200-2d33-4224-a24b-5dd29e7716de admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:54.390205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1387/2765] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:54.394243 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6eeea-dbad-45de-b363-34c1af6b2fb1 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:54.405149 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6eeea-dbad-45de-b363-34c1af6b2fb1 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:54.410560 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87fedf-662d-4243-b0f5-5e17c2d41d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:54.411269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87fedf-662d-4243-b0f5-5e17c2d41d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:54.411615 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87fedf-662d-4243-b0f5-5e17c2d41d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:54.411884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87fedf-662d-4243-b0f5-5e17c2d41d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:54.412579 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87fedf-662d-4243-b0f5-5e17c2d41d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:54.414199 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87fedf-662d-4243-b0f5-5e17c2d41d3a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:54.425867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1379/2766] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:54.430683 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d0200-2d33-4224-a24b-5dd29e7716de admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:54.444920 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d0200-2d33-4224-a24b-5dd29e7716de admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:54.454856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7df55f-0dc6-4b58-83ad-38b5794aa410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:54.455839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7df55f-0dc6-4b58-83ad-38b5794aa410 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:54.456222 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7df55f-0dc6-4b58-83ad-38b5794aa410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:54.456327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7df55f-0dc6-4b58-83ad-38b5794aa410 admin admin] PATH_INFO: `/v3/projects/aaa6d3ba629b49378560147f2795981a/users/4001635a664049d4a9d57c7ae750938a/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:54.475819 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7df55f-0dc6-4b58-83ad-38b5794aa410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa6d3ba629b49378560147f2795981a, user_id=4001635a664049d4a9d57c7ae750938a, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:54.478403 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7df55f-0dc6-4b58-83ad-38b5794aa410 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:54.493423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1388/2767] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:54 2022] PUT /identity/v3/projects/aaa6d3ba629b49378560147f2795981a/users/4001635a664049d4a9d57c7ae750938a/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:54.504265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26088b2f-a7df-43dc-ac49-faf91ab125f8 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:54.504644 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26088b2f-a7df-43dc-ac49-faf91ab125f8 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:54.504919 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26088b2f-a7df-43dc-ac49-faf91ab125f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:54.533464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-26088b2f-a7df-43dc-ac49-faf91ab125f8 None None] MFA Rules not processed for user `4001635a664049d4a9d57c7ae750938a`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:54.534689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-26088b2f-a7df-43dc-ac49-faf91ab125f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:54.602959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1380/2768] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:54.607740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7df55f-0dc6-4b58-83ad-38b5794aa410 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:54.670070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:54.682120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7df55f-0dc6-4b58-83ad-38b5794aa410 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:54.689277 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3c89d-134f-4c40-8b7e-8a6481d6bdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:54.689968 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3c89d-134f-4c40-8b7e-8a6481d6bdb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:54.690253 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3c89d-134f-4c40-8b7e-8a6481d6bdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:54.690556 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3c89d-134f-4c40-8b7e-8a6481d6bdb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:54.691245 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3c89d-134f-4c40-8b7e-8a6481d6bdb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:54.693372 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3c89d-134f-4c40-8b7e-8a6481d6bdb5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:54.722288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1389/2769] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:54 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:54.726613 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26088b2f-a7df-43dc-ac49-faf91ab125f8 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:54.738043 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26088b2f-a7df-43dc-ac49-faf91ab125f8 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:54.794384 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a95e89-6411-447c-96c5-1a2f1262a566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:54.795135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a95e89-6411-447c-96c5-1a2f1262a566 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:54.795424 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a95e89-6411-447c-96c5-1a2f1262a566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:54.795724 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a95e89-6411-447c-96c5-1a2f1262a566 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:54.796415 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a95e89-6411-447c-96c5-1a2f1262a566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:54.798493 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a95e89-6411-447c-96c5-1a2f1262a566 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:54.820026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1381/2770] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:54 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:54.824065 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3c89d-134f-4c40-8b7e-8a6481d6bdb5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:54.835021 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3c89d-134f-4c40-8b7e-8a6481d6bdb5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:54.840462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9e8a6-e500-4170-97f5-56bd156f2aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:54.841855 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9e8a6-e500-4170-97f5-56bd156f2aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:54.842141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9e8a6-e500-4170-97f5-56bd156f2aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:54.842446 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9e8a6-e500-4170-97f5-56bd156f2aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:54.843364 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9e8a6-e500-4170-97f5-56bd156f2aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:54.845094 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9e8a6-e500-4170-97f5-56bd156f2aa4 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:54.857743 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1390/2771] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:39:54.862411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a95e89-6411-447c-96c5-1a2f1262a566 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:54.873158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a95e89-6411-447c-96c5-1a2f1262a566 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:54.878687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16194ee-493a-40ad-9d69-fb196227a810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:54.879583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16194ee-493a-40ad-9d69-fb196227a810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:54.879904 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16194ee-493a-40ad-9d69-fb196227a810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:54.880189 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16194ee-493a-40ad-9d69-fb196227a810 admin admin] PATH_INFO: `/v3/projects/a175896aaa084c97afb14e5a39ca7b90/users/01efec23e65d4d5b91eb86451f3c8308/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:54.896322 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16194ee-493a-40ad-9d69-fb196227a810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a175896aaa084c97afb14e5a39ca7b90, user_id=01efec23e65d4d5b91eb86451f3c8308, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:54.898998 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16194ee-493a-40ad-9d69-fb196227a810 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:54.914500 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1382/2772] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:54 2022] PUT /identity/v3/projects/a175896aaa084c97afb14e5a39ca7b90/users/01efec23e65d4d5b91eb86451f3c8308/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:54.918702 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9e8a6-e500-4170-97f5-56bd156f2aa4 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:54.929217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9e8a6-e500-4170-97f5-56bd156f2aa4 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:55.119658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539664a-e735-484b-b750-ca87442d090b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:55.120366 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539664a-e735-484b-b750-ca87442d090b admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:55.120652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539664a-e735-484b-b750-ca87442d090b admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:55.120927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539664a-e735-484b-b750-ca87442d090b admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:55.121669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539664a-e735-484b-b750-ca87442d090b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:55.123331 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539664a-e735-484b-b750-ca87442d090b admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:55.136947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1391/2773] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:55.137959 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16194ee-493a-40ad-9d69-fb196227a810 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:55.148318 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16194ee-493a-40ad-9d69-fb196227a810 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:55.153651 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe529f95-d877-4be6-a89a-a93c4829247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:55.154552 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe529f95-d877-4be6-a89a-a93c4829247a admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:55.154834 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe529f95-d877-4be6-a89a-a93c4829247a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:55.155113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe529f95-d877-4be6-a89a-a93c4829247a admin admin] PATH_INFO: `/v3/projects/a175896aaa084c97afb14e5a39ca7b90/users/01efec23e65d4d5b91eb86451f3c8308/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:55.157144 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe529f95-d877-4be6-a89a-a93c4829247a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a175896aaa084c97afb14e5a39ca7b90, user_id=01efec23e65d4d5b91eb86451f3c8308, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:55.159844 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe529f95-d877-4be6-a89a-a93c4829247a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:55.170984 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1383/2774] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:55 2022] PUT /identity/v3/projects/a175896aaa084c97afb14e5a39ca7b90/users/01efec23e65d4d5b91eb86451f3c8308/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:39:55.240745 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980399a-ba70-48bd-aff5-48d1577d7788 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:55.241022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980399a-ba70-48bd-aff5-48d1577d7788 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:55.241273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980399a-ba70-48bd-aff5-48d1577d7788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:55.269642 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-8980399a-ba70-48bd-aff5-48d1577d7788 None None] MFA Rules not processed for user `01efec23e65d4d5b91eb86451f3c8308`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:55.270873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8980399a-ba70-48bd-aff5-48d1577d7788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:55.349455 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1392/2775] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:39:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:55.360913 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe529f95-d877-4be6-a89a-a93c4829247a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:55.362690 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-fe529f95-d877-4be6-a89a-a93c4829247a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:55.393625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:55.425445 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe529f95-d877-4be6-a89a-a93c4829247a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:55.429132 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0964908-7548-42e8-8810-8c7d32dbdead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:55.429782 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0964908-7548-42e8-8810-8c7d32dbdead service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:55.430069 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0964908-7548-42e8-8810-8c7d32dbdead service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:55.430346 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0964908-7548-42e8-8810-8c7d32dbdead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:55.494413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0964908-7548-42e8-8810-8c7d32dbdead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:55.495832 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0964908-7548-42e8-8810-8c7d32dbdead service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:55.509009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1384/2776] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:57.034917 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980399a-ba70-48bd-aff5-48d1577d7788 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:57.036537 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8980399a-ba70-48bd-aff5-48d1577d7788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:57.049103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980399a-ba70-48bd-aff5-48d1577d7788 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:57.052883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7764e-8a8f-45b8-9b77-6bfe3e7acf1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:57.053889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7764e-8a8f-45b8-9b77-6bfe3e7acf1e service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:57.053889 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7764e-8a8f-45b8-9b77-6bfe3e7acf1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:57.054098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7764e-8a8f-45b8-9b77-6bfe3e7acf1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:57.100307 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:57.114351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7764e-8a8f-45b8-9b77-6bfe3e7acf1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:57.115972 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7764e-8a8f-45b8-9b77-6bfe3e7acf1e service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:57.125297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1393/2777] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:57.702084 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0964908-7548-42e8-8810-8c7d32dbdead service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:57.713803 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0964908-7548-42e8-8810-8c7d32dbdead service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:57.726441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a4fd0-a2c1-43e4-a7e1-cd54af4bdf26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:57.727185 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a4fd0-a2c1-43e4-a7e1-cd54af4bdf26 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:57.727481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a4fd0-a2c1-43e4-a7e1-cd54af4bdf26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:57.727799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a4fd0-a2c1-43e4-a7e1-cd54af4bdf26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:57.738453 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a4fd0-a2c1-43e4-a7e1-cd54af4bdf26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:57.740846 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a4fd0-a2c1-43e4-a7e1-cd54af4bdf26 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:57.755226 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1385/2778] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:00.719085 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c814f5b-48bb-476d-8abe-011ce222ab57 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:00.719647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c814f5b-48bb-476d-8abe-011ce222ab57 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:00.719647 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c814f5b-48bb-476d-8abe-011ce222ab57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:00.738641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6c814f5b-48bb-476d-8abe-011ce222ab57 None None] MFA Rules not processed for user `1be3fcf43fb440f3938b0772e60c06b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:00.739919 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6c814f5b-48bb-476d-8abe-011ce222ab57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:00.799338 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1394/2779] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:40:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:01.676040 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a4fd0-a2c1-43e4-a7e1-cd54af4bdf26 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:01.743484 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a4fd0-a2c1-43e4-a7e1-cd54af4bdf26 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:01.748601 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44860f61-497b-4655-b2e4-4d22b52dce6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:01.749558 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44860f61-497b-4655-b2e4-4d22b52dce6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:01.749846 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44860f61-497b-4655-b2e4-4d22b52dce6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:01.750165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44860f61-497b-4655-b2e4-4d22b52dce6a admin admin] PATH_INFO: `/v3/users/623692f5a9614d449b03c79eab89fae9` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:01.751309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44860f61-497b-4655-b2e4-4d22b52dce6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=623692f5a9614d449b03c79eab89fae9)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:01.753269 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44860f61-497b-4655-b2e4-4d22b52dce6a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:01.803980 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-44860f61-497b-4655-b2e4-4d22b52dce6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '623692f5a9614d449b03c79eab89fae9'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:01.817399 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-44860f61-497b-4655-b2e4-4d22b52dce6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '623692f5a9614d449b03c79eab89fae9'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:01.818158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-44860f61-497b-4655-b2e4-4d22b52dce6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '623692f5a9614d449b03c79eab89fae9'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:01.818961 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-44860f61-497b-4655-b2e4-4d22b52dce6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '623692f5a9614d449b03c79eab89fae9'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:01.821080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:01.827407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-44860f61-497b-4655-b2e4-4d22b52dce6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '623692f5a9614d449b03c79eab89fae9'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:01.841884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1386/2780] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:40:01 2022] DELETE /identity/v3/users/623692f5a9614d449b03c79eab89fae9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:01.846783 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9e48e-788a-4942-b880-c66b1e837b6b None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:01.847279 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9e48e-788a-4942-b880-c66b1e837b6b None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:01.847380 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9e48e-788a-4942-b880-c66b1e837b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:01.865767 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-71f9e48e-788a-4942-b880-c66b1e837b6b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:01.866997 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-71f9e48e-788a-4942-b880-c66b1e837b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:01.928244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1395/2781] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:01.937953 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44860f61-497b-4655-b2e4-4d22b52dce6a admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:01.939462 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-44860f61-497b-4655-b2e4-4d22b52dce6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:02.002343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44860f61-497b-4655-b2e4-4d22b52dce6a admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:02.006753 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74628c20-8ce9-4cc0-bedc-64c127a1d053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:02.007573 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74628c20-8ce9-4cc0-bedc-64c127a1d053 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:02.007928 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74628c20-8ce9-4cc0-bedc-64c127a1d053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:02.008244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74628c20-8ce9-4cc0-bedc-64c127a1d053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:02.020985 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74628c20-8ce9-4cc0-bedc-64c127a1d053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:02.022654 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74628c20-8ce9-4cc0-bedc-64c127a1d053 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:02.034633 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1387/2782] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:02.335368 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9e48e-788a-4942-b880-c66b1e837b6b None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:02.337907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-71f9e48e-788a-4942-b880-c66b1e837b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:02.354668 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9e48e-788a-4942-b880-c66b1e837b6b None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:02.361669 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:02.362744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:02.362848 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:02.363111 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d admin admin] PATH_INFO: `/v3/projects/5e5892a12d0c42469cfd7ea81009156c` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:02.364369 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5892a12d0c42469cfd7ea81009156c)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:02.366256 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:02.429300 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5892a12d0c42469cfd7ea81009156c', 'request_id': 'req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:02.446716 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5892a12d0c42469cfd7ea81009156c', 'request_id': 'req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:02.457426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5892a12d0c42469cfd7ea81009156c', 'request_id': 'req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:02.471863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d admin admin] The token cache is being invalidate because project 5e5892a12d0c42469cfd7ea81009156c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:40:02.472156 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:02.472829 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:02.477540 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1396/2783] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:40:02 2022] DELETE /identity/v3/projects/5e5892a12d0c42469cfd7ea81009156c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:02.478568 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74628c20-8ce9-4cc0-bedc-64c127a1d053 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:02.490494 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74628c20-8ce9-4cc0-bedc-64c127a1d053 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:02.560777 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b331d-3ccc-47a3-8b0a-a62df92037b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:02.561748 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b331d-3ccc-47a3-8b0a-a62df92037b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:02.562026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b331d-3ccc-47a3-8b0a-a62df92037b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:02.562295 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b331d-3ccc-47a3-8b0a-a62df92037b8 admin admin] PATH_INFO: `/v3/users/4001635a664049d4a9d57c7ae750938a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:02.564131 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b331d-3ccc-47a3-8b0a-a62df92037b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4001635a664049d4a9d57c7ae750938a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:02.566046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b331d-3ccc-47a3-8b0a-a62df92037b8 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:02.620239 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d69b331d-3ccc-47a3-8b0a-a62df92037b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4001635a664049d4a9d57c7ae750938a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:02.633703 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d69b331d-3ccc-47a3-8b0a-a62df92037b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4001635a664049d4a9d57c7ae750938a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:02.634503 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d69b331d-3ccc-47a3-8b0a-a62df92037b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4001635a664049d4a9d57c7ae750938a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:02.635143 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d69b331d-3ccc-47a3-8b0a-a62df92037b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4001635a664049d4a9d57c7ae750938a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:02.642968 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-d69b331d-3ccc-47a3-8b0a-a62df92037b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4001635a664049d4a9d57c7ae750938a'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:02.657199 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1388/2784] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:40:02 2022] DELETE /identity/v3/users/4001635a664049d4a9d57c7ae750938a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:40:02.941491 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:02.943580 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:02.957978 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c89d1-5c50-48bf-85ef-79b83c56ba6d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:02.971545 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:03.019220 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:03.020143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:03.020425 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:03.020696 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0 admin admin] PATH_INFO: `/v3/projects/aaa6d3ba629b49378560147f2795981a` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:03.021902 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa6d3ba629b49378560147f2795981a)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:03.023864 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:03.074225 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa6d3ba629b49378560147f2795981a', 'request_id': 'req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:03.082315 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa6d3ba629b49378560147f2795981a', 'request_id': 'req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:03.088129 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa6d3ba629b49378560147f2795981a', 'request_id': 'req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:03.099995 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0 admin admin] The token cache is being invalidate because project aaa6d3ba629b49378560147f2795981a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:40:03.100288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:03.100925 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:03.102469 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1397/2785] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:40:02 2022] DELETE /identity/v3/projects/aaa6d3ba629b49378560147f2795981a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:03.106550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b331d-3ccc-47a3-8b0a-a62df92037b8 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:03.108592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-d69b331d-3ccc-47a3-8b0a-a62df92037b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:03.123703 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b331d-3ccc-47a3-8b0a-a62df92037b8 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:03.128218 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:03.205444 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1b1dd-94c0-41ea-a891-d4306146cd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:03.206464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1b1dd-94c0-41ea-a891-d4306146cd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:03.206829 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1b1dd-94c0-41ea-a891-d4306146cd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:03.207161 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1b1dd-94c0-41ea-a891-d4306146cd09 admin admin] PATH_INFO: `/v3/users/01efec23e65d4d5b91eb86451f3c8308` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:03.208509 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1b1dd-94c0-41ea-a891-d4306146cd09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01efec23e65d4d5b91eb86451f3c8308)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:03.210606 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1b1dd-94c0-41ea-a891-d4306146cd09 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:03.266533 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-59d1b1dd-94c0-41ea-a891-d4306146cd09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01efec23e65d4d5b91eb86451f3c8308'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:03.282705 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-59d1b1dd-94c0-41ea-a891-d4306146cd09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01efec23e65d4d5b91eb86451f3c8308'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:03.283631 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-59d1b1dd-94c0-41ea-a891-d4306146cd09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01efec23e65d4d5b91eb86451f3c8308'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:03.284628 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-59d1b1dd-94c0-41ea-a891-d4306146cd09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01efec23e65d4d5b91eb86451f3c8308'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:03.292443 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-59d1b1dd-94c0-41ea-a891-d4306146cd09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01efec23e65d4d5b91eb86451f3c8308'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:03.308873 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1389/2786] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:40:03 2022] DELETE /identity/v3/users/01efec23e65d4d5b91eb86451f3c8308 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:03.596507 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:03.597951 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:03.611491 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700dcb4-7914-4e0f-bbd2-bb9a56390da0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:03.686590 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eec29d-72b7-46ec-a656-760275f736fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:03.687499 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eec29d-72b7-46ec-a656-760275f736fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:03.687834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eec29d-72b7-46ec-a656-760275f736fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:03.688112 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eec29d-72b7-46ec-a656-760275f736fc admin admin] PATH_INFO: `/v3/projects/a175896aaa084c97afb14e5a39ca7b90` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:03.689501 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eec29d-72b7-46ec-a656-760275f736fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a175896aaa084c97afb14e5a39ca7b90)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:03.692492 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eec29d-72b7-46ec-a656-760275f736fc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:03.756343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:03.758107 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-27eec29d-72b7-46ec-a656-760275f736fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a175896aaa084c97afb14e5a39ca7b90', 'request_id': 'req-27eec29d-72b7-46ec-a656-760275f736fc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:03.768057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-27eec29d-72b7-46ec-a656-760275f736fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a175896aaa084c97afb14e5a39ca7b90', 'request_id': 'req-27eec29d-72b7-46ec-a656-760275f736fc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:03.776562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-27eec29d-72b7-46ec-a656-760275f736fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a175896aaa084c97afb14e5a39ca7b90', 'request_id': 'req-27eec29d-72b7-46ec-a656-760275f736fc'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:03.790362 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-27eec29d-72b7-46ec-a656-760275f736fc admin admin] The token cache is being invalidate because project a175896aaa084c97afb14e5a39ca7b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:40:03.790941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-27eec29d-72b7-46ec-a656-760275f736fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:03.791791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-27eec29d-72b7-46ec-a656-760275f736fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:03.793566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1398/2787] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:40:03 2022] DELETE /identity/v3/projects/a175896aaa084c97afb14e5a39ca7b90 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:03.799449 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3f43c-fda5-4fab-9858-b1348d3c4851 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:03.799777 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3f43c-fda5-4fab-9858-b1348d3c4851 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:03.800060 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3f43c-fda5-4fab-9858-b1348d3c4851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:03.823891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-3de3f43c-fda5-4fab-9858-b1348d3c4851 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:03.825348 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-3de3f43c-fda5-4fab-9858-b1348d3c4851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:03.929027 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d906127-be2e-4510-a10d-c3299c29c7e0 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:03.929317 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d906127-be2e-4510-a10d-c3299c29c7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:03.929530 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d906127-be2e-4510-a10d-c3299c29c7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:03.930511 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1390/2788] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:40:03.952719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3d906127-be2e-4510-a10d-c3299c29c7e0 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:03.953994 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3d906127-be2e-4510-a10d-c3299c29c7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:03.967471 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1399/2789] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:40:03.973009 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3f43c-fda5-4fab-9858-b1348d3c4851 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:03.983657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3f43c-fda5-4fab-9858-b1348d3c4851 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:03.989457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6ae89-e276-47e8-b0ef-1cfbd81e8f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:03.990158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ae89-e276-47e8-b0ef-1cfbd81e8f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:03.990431 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ae89-e276-47e8-b0ef-1cfbd81e8f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:03.990711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ae89-e276-47e8-b0ef-1cfbd81e8f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:03.991461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6ae89-e276-47e8-b0ef-1cfbd81e8f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:40:03.991900 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6ae89-e276-47e8-b0ef-1cfbd81e8f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:03.993441 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6ae89-e276-47e8-b0ef-1cfbd81e8f06 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:04.011653 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1391/2790] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:40:04.015174 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d906127-be2e-4510-a10d-c3299c29c7e0 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:04.025161 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d906127-be2e-4510-a10d-c3299c29c7e0 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:04.030457 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ff4b0-86eb-4645-9f98-97751b9d88a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:04.031147 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ff4b0-86eb-4645-9f98-97751b9d88a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:04.031462 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ff4b0-86eb-4645-9f98-97751b9d88a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:04.031775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ff4b0-86eb-4645-9f98-97751b9d88a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:04.032607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ff4b0-86eb-4645-9f98-97751b9d88a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:04.034559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ff4b0-86eb-4645-9f98-97751b9d88a0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:04.068340 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1400/2791] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:40:04 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:40:04.069500 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6ae89-e276-47e8-b0ef-1cfbd81e8f06 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:04.081457 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6ae89-e276-47e8-b0ef-1cfbd81e8f06 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:04.094413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:04.150356 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290a0d9-2b6d-4b3e-8e29-fe277180f3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:04.151032 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290a0d9-2b6d-4b3e-8e29-fe277180f3fc admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:04.151319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290a0d9-2b6d-4b3e-8e29-fe277180f3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:04.151622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290a0d9-2b6d-4b3e-8e29-fe277180f3fc admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:04.152372 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290a0d9-2b6d-4b3e-8e29-fe277180f3fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:04.154741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290a0d9-2b6d-4b3e-8e29-fe277180f3fc admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:04.177163 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1392/2792] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:40:04 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:40:04.181233 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ff4b0-86eb-4645-9f98-97751b9d88a0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:04.191744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ff4b0-86eb-4645-9f98-97751b9d88a0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:04.196463 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da1489-7683-4e57-96f9-cb3f8e3c977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:04.197139 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da1489-7683-4e57-96f9-cb3f8e3c977a admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:04.197424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da1489-7683-4e57-96f9-cb3f8e3c977a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:04.197703 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da1489-7683-4e57-96f9-cb3f8e3c977a admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:04.198442 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da1489-7683-4e57-96f9-cb3f8e3c977a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:04.200092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da1489-7683-4e57-96f9-cb3f8e3c977a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:04.212325 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1401/2793] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:40:04.216370 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290a0d9-2b6d-4b3e-8e29-fe277180f3fc admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:04.228382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290a0d9-2b6d-4b3e-8e29-fe277180f3fc admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:04.233616 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb417c-71d4-4131-8717-97ff75724d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:04.234349 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb417c-71d4-4131-8717-97ff75724d98 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:04.234684 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb417c-71d4-4131-8717-97ff75724d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:04.234977 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb417c-71d4-4131-8717-97ff75724d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:04.235767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb417c-71d4-4131-8717-97ff75724d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:04.237411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb417c-71d4-4131-8717-97ff75724d98 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:04.250161 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1393/2794] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:40:04.254423 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da1489-7683-4e57-96f9-cb3f8e3c977a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:04.264591 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da1489-7683-4e57-96f9-cb3f8e3c977a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:04.269336 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20939f6-2bb9-46dc-ba57-35742356285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:04.270237 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20939f6-2bb9-46dc-ba57-35742356285d admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:04.270521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20939f6-2bb9-46dc-ba57-35742356285d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:04.270799 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20939f6-2bb9-46dc-ba57-35742356285d admin admin] PATH_INFO: `/v3/projects/2f4bf0ccc82343a58a66da466af3b26a/users/0df14b84b8a74476b88ed8fedf713e79/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:04.286103 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20939f6-2bb9-46dc-ba57-35742356285d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4bf0ccc82343a58a66da466af3b26a, user_id=0df14b84b8a74476b88ed8fedf713e79, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:04.288813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20939f6-2bb9-46dc-ba57-35742356285d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:04.304370 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1402/2795] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:40:04 2022] PUT /identity/v3/projects/2f4bf0ccc82343a58a66da466af3b26a/users/0df14b84b8a74476b88ed8fedf713e79/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:04.315901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385d5d5-2f7e-4ce5-af6f-92c0d9557f0e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:04.316189 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385d5d5-2f7e-4ce5-af6f-92c0d9557f0e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:04.316469 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385d5d5-2f7e-4ce5-af6f-92c0d9557f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:04.346625 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-9385d5d5-2f7e-4ce5-af6f-92c0d9557f0e None None] MFA Rules not processed for user `0df14b84b8a74476b88ed8fedf713e79`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:04.348000 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-9385d5d5-2f7e-4ce5-af6f-92c0d9557f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:04.416890 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1394/2796] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:40:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:04.428367 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20939f6-2bb9-46dc-ba57-35742356285d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:04.430213 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b20939f6-2bb9-46dc-ba57-35742356285d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:04.497175 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20939f6-2bb9-46dc-ba57-35742356285d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:04.501655 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905f932-80b8-46f1-9995-51dd1a4938bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:04.502313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905f932-80b8-46f1-9995-51dd1a4938bb service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:04.502588 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905f932-80b8-46f1-9995-51dd1a4938bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:04.502873 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905f932-80b8-46f1-9995-51dd1a4938bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:04.512133 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905f932-80b8-46f1-9995-51dd1a4938bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:04.513684 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905f932-80b8-46f1-9995-51dd1a4938bb service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:04.523126 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1403/2797] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:40:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:05.887353 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789ab2a-485e-4bf6-8b1a-5f5a5e0644bb None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:05.887976 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789ab2a-485e-4bf6-8b1a-5f5a5e0644bb None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:05.887976 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789ab2a-485e-4bf6-8b1a-5f5a5e0644bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:05.906419 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-e789ab2a-485e-4bf6-8b1a-5f5a5e0644bb None None] MFA Rules not processed for user `0df14b84b8a74476b88ed8fedf713e79`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:05.907712 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e789ab2a-485e-4bf6-8b1a-5f5a5e0644bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:05.915923 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1395/2798] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:40:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:14.518769 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=60,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:15.900758 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:20.960641 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b054-7610-4e23-8a69-afeabc05415f None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:20.961143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b054-7610-4e23-8a69-afeabc05415f None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:20.961240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b054-7610-4e23-8a69-afeabc05415f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:20.989351 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-98a6b054-7610-4e23-8a69-afeabc05415f None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:20.990806 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-98a6b054-7610-4e23-8a69-afeabc05415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:21.057706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1404/2799] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 08:40:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:21.109174 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789ab2a-485e-4bf6-8b1a-5f5a5e0644bb None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:21.110772 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-e789ab2a-485e-4bf6-8b1a-5f5a5e0644bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:21.201638 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789ab2a-485e-4bf6-8b1a-5f5a5e0644bb None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:21.208461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68333c-72a0-4fce-a9c1-7b75bcae6d34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:21.209117 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68333c-72a0-4fce-a9c1-7b75bcae6d34 service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:21.209396 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68333c-72a0-4fce-a9c1-7b75bcae6d34 service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:21.209661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68333c-72a0-4fce-a9c1-7b75bcae6d34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:21.218809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68333c-72a0-4fce-a9c1-7b75bcae6d34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:21.220826 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68333c-72a0-4fce-a9c1-7b75bcae6d34 service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:21.229508 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1396/2800] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:40:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:40:21.802267 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa8fd5-59b0-4b55-9503-a311163accc1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:21.802555 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa8fd5-59b0-4b55-9503-a311163accc1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:21.802832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa8fd5-59b0-4b55-9503-a311163accc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:21.821728 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-2cfa8fd5-59b0-4b55-9503-a311163accc1 None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:21.823030 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-2cfa8fd5-59b0-4b55-9503-a311163accc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:21.830704 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1405/2801] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 21 08:40:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:21.846550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68333c-72a0-4fce-a9c1-7b75bcae6d34 service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:21.857532 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68333c-72a0-4fce-a9c1-7b75bcae6d34 service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:21.864339 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfbc38-68a2-4072-b8b1-3e0b2e63e8e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:21.864986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfbc38-68a2-4072-b8b1-3e0b2e63e8e7 service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:21.865272 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfbc38-68a2-4072-b8b1-3e0b2e63e8e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:21.865551 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfbc38-68a2-4072-b8b1-3e0b2e63e8e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:21.874281 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfbc38-68a2-4072-b8b1-3e0b2e63e8e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:21.876046 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfbc38-68a2-4072-b8b1-3e0b2e63e8e7 service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:21.884737 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1397/2802] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:40:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:40:22.100795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022dbd5-299f-4c5a-843b-7d29c18e3f1c None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:22.101304 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022dbd5-299f-4c5a-843b-7d29c18e3f1c None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:22.101405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022dbd5-299f-4c5a-843b-7d29c18e3f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:22.119535 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-1022dbd5-299f-4c5a-843b-7d29c18e3f1c None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:22.120787 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-1022dbd5-299f-4c5a-843b-7d29c18e3f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:22.128616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1406/2803] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 08:40:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:22.141112 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfbc38-68a2-4072-b8b1-3e0b2e63e8e7 service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:22.157800 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfbc38-68a2-4072-b8b1-3e0b2e63e8e7 service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:22.163858 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59682ead-7189-4a3e-8008-5fa112a5a6d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:22.164528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59682ead-7189-4a3e-8008-5fa112a5a6d4 service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:22.164803 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59682ead-7189-4a3e-8008-5fa112a5a6d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:22.165179 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59682ead-7189-4a3e-8008-5fa112a5a6d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:22.174891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59682ead-7189-4a3e-8008-5fa112a5a6d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:22.176517 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59682ead-7189-4a3e-8008-5fa112a5a6d4 service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:22.186577 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1398/2804] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:40:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:40:22.516719 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100db90c-174c-47be-b602-35a74b453ade None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:22.517274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100db90c-174c-47be-b602-35a74b453ade None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:22.517567 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100db90c-174c-47be-b602-35a74b453ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:22.535497 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-100db90c-174c-47be-b602-35a74b453ade None None] MFA Rules not processed for user `1898d568650f48a08a51b93cbd9359bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:22.536766 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-100db90c-174c-47be-b602-35a74b453ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:22.544086 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1407/2805] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 21 08:40:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:22.556983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59682ead-7189-4a3e-8008-5fa112a5a6d4 service swift] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:22.567948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59682ead-7189-4a3e-8008-5fa112a5a6d4 service swift] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:22.573413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de4337-84e4-4842-8cdd-5a369d6ae34c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d7cfd6610a4df095daea14ecc37b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:22.574059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4337-84e4-4842-8cdd-5a369d6ae34c service swift] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:22.574340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4337-84e4-4842-8cdd-5a369d6ae34c service swift] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:22.574621 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4337-84e4-4842-8cdd-5a369d6ae34c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:22.583390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de4337-84e4-4842-8cdd-5a369d6ae34c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:22.585051 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de4337-84e4-4842-8cdd-5a369d6ae34c service swift] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:22.593571 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1399/2806] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 08:40:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:40:24.753706 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100db90c-174c-47be-b602-35a74b453ade None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:24.820550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100db90c-174c-47be-b602-35a74b453ade None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:24.826386 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170bed0-acb3-46a0-aa62-485d7b581ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:24.827274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170bed0-acb3-46a0-aa62-485d7b581ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:24.827560 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170bed0-acb3-46a0-aa62-485d7b581ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:24.827869 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170bed0-acb3-46a0-aa62-485d7b581ccd admin admin] PATH_INFO: `/v3/users/0df14b84b8a74476b88ed8fedf713e79` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:24.829203 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170bed0-acb3-46a0-aa62-485d7b581ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df14b84b8a74476b88ed8fedf713e79)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:24.831564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170bed0-acb3-46a0-aa62-485d7b581ccd admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:24.882690 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6170bed0-acb3-46a0-aa62-485d7b581ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df14b84b8a74476b88ed8fedf713e79'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:24.883354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6170bed0-acb3-46a0-aa62-485d7b581ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df14b84b8a74476b88ed8fedf713e79'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:24.883986 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6170bed0-acb3-46a0-aa62-485d7b581ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df14b84b8a74476b88ed8fedf713e79'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:24.891283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6170bed0-acb3-46a0-aa62-485d7b581ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df14b84b8a74476b88ed8fedf713e79'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:24.900577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-6170bed0-acb3-46a0-aa62-485d7b581ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df14b84b8a74476b88ed8fedf713e79'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:24.907806 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:24.920120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1408/2807] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:40:24 2022] DELETE /identity/v3/users/0df14b84b8a74476b88ed8fedf713e79 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:24.924824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a18ec7-26ae-4275-90f8-f8c788e3b94e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:24.925391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a18ec7-26ae-4275-90f8-f8c788e3b94e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:24.925391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a18ec7-26ae-4275-90f8-f8c788e3b94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:24.942984 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-71a18ec7-26ae-4275-90f8-f8c788e3b94e None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:24.944230 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-71a18ec7-26ae-4275-90f8-f8c788e3b94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:25.008476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1400/2808] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:40:25.018189 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170bed0-acb3-46a0-aa62-485d7b581ccd admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:25.019961 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6170bed0-acb3-46a0-aa62-485d7b581ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:25.078738 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170bed0-acb3-46a0-aa62-485d7b581ccd admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:25.083092 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa4927-ceed-4bd2-bfdb-5fac1daf162e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:25.083794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa4927-ceed-4bd2-bfdb-5fac1daf162e service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:25.084077 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa4927-ceed-4bd2-bfdb-5fac1daf162e service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:25.084348 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa4927-ceed-4bd2-bfdb-5fac1daf162e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:25.093883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa4927-ceed-4bd2-bfdb-5fac1daf162e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:25.095637 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa4927-ceed-4bd2-bfdb-5fac1daf162e service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:25.105246 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1409/2809] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:25.299486 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a18ec7-26ae-4275-90f8-f8c788e3b94e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:25.301773 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-71a18ec7-26ae-4275-90f8-f8c788e3b94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:25.314778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a18ec7-26ae-4275-90f8-f8c788e3b94e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:25.320390 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d46f30-bc90-498c-b750-a607bedc463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:25.321302 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d46f30-bc90-498c-b750-a607bedc463e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:25.321585 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d46f30-bc90-498c-b750-a607bedc463e admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:25.321863 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d46f30-bc90-498c-b750-a607bedc463e admin admin] PATH_INFO: `/v3/projects/2f4bf0ccc82343a58a66da466af3b26a` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:25.323148 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d46f30-bc90-498c-b750-a607bedc463e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4bf0ccc82343a58a66da466af3b26a)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:25.325120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d46f30-bc90-498c-b750-a607bedc463e admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:25.375287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:25.378636 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b6d46f30-bc90-498c-b750-a607bedc463e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4bf0ccc82343a58a66da466af3b26a', 'request_id': 'req-b6d46f30-bc90-498c-b750-a607bedc463e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:25.385728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b6d46f30-bc90-498c-b750-a607bedc463e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4bf0ccc82343a58a66da466af3b26a', 'request_id': 'req-b6d46f30-bc90-498c-b750-a607bedc463e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:25.394408 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b6d46f30-bc90-498c-b750-a607bedc463e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4bf0ccc82343a58a66da466af3b26a', 'request_id': 'req-b6d46f30-bc90-498c-b750-a607bedc463e'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:25.405247 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b6d46f30-bc90-498c-b750-a607bedc463e admin admin] The token cache is being invalidate because project 2f4bf0ccc82343a58a66da466af3b26a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:40:25.405539 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b6d46f30-bc90-498c-b750-a607bedc463e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:25.406189 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b6d46f30-bc90-498c-b750-a607bedc463e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:25.407800 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1401/2810] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:40:25 2022] DELETE /identity/v3/projects/2f4bf0ccc82343a58a66da466af3b26a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:35.101168 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=30,keystone:DELETE=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:35.402343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:50.950945 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa4927-ceed-4bd2-bfdb-5fac1daf162e service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:50.953187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-4cfa4927-ceed-4bd2-bfdb-5fac1daf162e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:51.013252 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa4927-ceed-4bd2-bfdb-5fac1daf162e service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:51.075119 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c8d22-d662-43e1-8871-ff0c9021c9d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:51.075795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c8d22-d662-43e1-8871-ff0c9021c9d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:51.076078 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c8d22-d662-43e1-8871-ff0c9021c9d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:51.076350 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c8d22-d662-43e1-8871-ff0c9021c9d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:51.078274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fc0c8d22-d662-43e1-8871-ff0c9021c9d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:51.200156 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c8d22-d662-43e1-8871-ff0c9021c9d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:51.201627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c8d22-d662-43e1-8871-ff0c9021c9d6 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:51.223330 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1410/2811] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:40:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:52.677581 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d46f30-bc90-498c-b750-a607bedc463e admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:52.679209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b6d46f30-bc90-498c-b750-a607bedc463e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:52.693266 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d46f30-bc90-498c-b750-a607bedc463e admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:52.697444 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf19153-8091-4712-86e4-983e1ad42930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:52.698063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf19153-8091-4712-86e4-983e1ad42930 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:52.698327 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf19153-8091-4712-86e4-983e1ad42930 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:52.698679 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf19153-8091-4712-86e4-983e1ad42930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:52.700972 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-faf19153-8091-4712-86e4-983e1ad42930 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:52.715081 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf19153-8091-4712-86e4-983e1ad42930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:52.716622 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf19153-8091-4712-86e4-983e1ad42930 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:52.728449 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1402/2812] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:40:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:59.995540 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb21f2a-27e7-4fa2-8eeb-bdc372a68fce None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:59.996082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb21f2a-27e7-4fa2-8eeb-bdc372a68fce None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:59.996231 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb21f2a-27e7-4fa2-8eeb-bdc372a68fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:00.014540 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3cb21f2a-27e7-4fa2-8eeb-bdc372a68fce None None] MFA Rules not processed for user `1be3fcf43fb440f3938b0772e60c06b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:41:00.015866 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3cb21f2a-27e7-4fa2-8eeb-bdc372a68fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:00.061069 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=100 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:00.084724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1411/2813] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:40:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:41:00.410243 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf19153-8091-4712-86e4-983e1ad42930 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:41:00.411908 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-faf19153-8091-4712-86e4-983e1ad42930 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:00.475752 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf19153-8091-4712-86e4-983e1ad42930 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:41:00.479570 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3980ab-b1c3-4bb5-ac03-94960508fdb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:41:00.480494 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3980ab-b1c3-4bb5-ac03-94960508fdb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:41:00.480822 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3980ab-b1c3-4bb5-ac03-94960508fdb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:41:00.481209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3980ab-b1c3-4bb5-ac03-94960508fdb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:00.483153 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-de3980ab-b1c3-4bb5-ac03-94960508fdb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:00.493067 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3980ab-b1c3-4bb5-ac03-94960508fdb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:41:00.494547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3980ab-b1c3-4bb5-ac03-94960508fdb8 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:41:00.502582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1403/2814] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:41:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:41:00.860274 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb21f2a-27e7-4fa2-8eeb-bdc372a68fce None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:41:00.861826 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3cb21f2a-27e7-4fa2-8eeb-bdc372a68fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:00.931868 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb21f2a-27e7-4fa2-8eeb-bdc372a68fce None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:41:00.937046 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec295e0-dd85-4965-a5fc-e424cb2f0359 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1146aa09d30458f9ab3b3bec8f94233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:41:00.937712 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec295e0-dd85-4965-a5fc-e424cb2f0359 service placement] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:41:00.937992 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec295e0-dd85-4965-a5fc-e424cb2f0359 service placement] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:41:00.938268 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec295e0-dd85-4965-a5fc-e424cb2f0359 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:00.940169 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fec295e0-dd85-4965-a5fc-e424cb2f0359 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:00.951912 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec295e0-dd85-4965-a5fc-e424cb2f0359 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:41:00.953612 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec295e0-dd85-4965-a5fc-e424cb2f0359 service placement] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:41:00.965786 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1412/2815] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:41:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:41:02.739698 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3980ab-b1c3-4bb5-ac03-94960508fdb8 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:41:02.741265 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-de3980ab-b1c3-4bb5-ac03-94960508fdb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:02.752756 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3980ab-b1c3-4bb5-ac03-94960508fdb8 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:41:02.756988 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b9e6d-3502-4f19-81c9-c9eb1960aa42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:41:02.757728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b9e6d-3502-4f19-81c9-c9eb1960aa42 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:41:02.758078 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b9e6d-3502-4f19-81c9-c9eb1960aa42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:41:02.758421 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b9e6d-3502-4f19-81c9-c9eb1960aa42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:02.760489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-057b9e6d-3502-4f19-81c9-c9eb1960aa42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:02.771879 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b9e6d-3502-4f19-81c9-c9eb1960aa42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:41:02.773296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b9e6d-3502-4f19-81c9-c9eb1960aa42 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:41:02.782626 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1404/2816] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:41:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:41:10.961240 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=40 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:12.778701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=38 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:00.989510 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec295e0-dd85-4965-a5fc-e424cb2f0359 service placement] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:00.991105 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-fec295e0-dd85-4965-a5fc-e424cb2f0359 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:01.059553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec295e0-dd85-4965-a5fc-e424cb2f0359 service placement] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:01.064100 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852c404-b1c6-49ff-8ce9-989a5d01ff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:01.064973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852c404-b1c6-49ff-8ce9-989a5d01ff4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:01.065250 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852c404-b1c6-49ff-8ce9-989a5d01ff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:01.065521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852c404-b1c6-49ff-8ce9-989a5d01ff4a admin admin] PATH_INFO: `/v3/users/1be3fcf43fb440f3938b0772e60c06b9` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:01.066721 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3852c404-b1c6-49ff-8ce9-989a5d01ff4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be3fcf43fb440f3938b0772e60c06b9)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:01.068711 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3852c404-b1c6-49ff-8ce9-989a5d01ff4a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:01.122947 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3852c404-b1c6-49ff-8ce9-989a5d01ff4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be3fcf43fb440f3938b0772e60c06b9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:01.123778 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3852c404-b1c6-49ff-8ce9-989a5d01ff4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be3fcf43fb440f3938b0772e60c06b9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:01.124395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3852c404-b1c6-49ff-8ce9-989a5d01ff4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be3fcf43fb440f3938b0772e60c06b9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:01.131755 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3852c404-b1c6-49ff-8ce9-989a5d01ff4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be3fcf43fb440f3938b0772e60c06b9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:01.142439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-3852c404-b1c6-49ff-8ce9-989a5d01ff4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be3fcf43fb440f3938b0772e60c06b9'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:01.159565 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1413/2817] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:42:00 2022] DELETE /identity/v3/users/1be3fcf43fb440f3938b0772e60c06b9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:01.346329 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b9e6d-3502-4f19-81c9-c9eb1960aa42 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:01.359873 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b9e6d-3502-4f19-81c9-c9eb1960aa42 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:01.417351 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073d852-c0d5-4492-8bab-85324445d93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:01.418235 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073d852-c0d5-4492-8bab-85324445d93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:01.418550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073d852-c0d5-4492-8bab-85324445d93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:01.418828 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073d852-c0d5-4492-8bab-85324445d93b admin admin] PATH_INFO: `/v3/projects/4e7ac9873d0849449c66e4c19cda94b2` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:01.420048 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073d852-c0d5-4492-8bab-85324445d93b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7ac9873d0849449c66e4c19cda94b2)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:01.422499 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073d852-c0d5-4492-8bab-85324445d93b admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:01.473773 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b073d852-c0d5-4492-8bab-85324445d93b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7ac9873d0849449c66e4c19cda94b2', 'request_id': 'req-b073d852-c0d5-4492-8bab-85324445d93b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:01.480064 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b073d852-c0d5-4492-8bab-85324445d93b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7ac9873d0849449c66e4c19cda94b2', 'request_id': 'req-b073d852-c0d5-4492-8bab-85324445d93b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:01.489889 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b073d852-c0d5-4492-8bab-85324445d93b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7ac9873d0849449c66e4c19cda94b2', 'request_id': 'req-b073d852-c0d5-4492-8bab-85324445d93b'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:01.500565 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b073d852-c0d5-4492-8bab-85324445d93b admin admin] The token cache is being invalidate because project 4e7ac9873d0849449c66e4c19cda94b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:42:01.500854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b073d852-c0d5-4492-8bab-85324445d93b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:01.501547 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-b073d852-c0d5-4492-8bab-85324445d93b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:01.503123 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1405/2818] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:42:01 2022] DELETE /identity/v3/projects/4e7ac9873d0849449c66e4c19cda94b2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:01.508281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a437-4d17-4821-af07-615934f459ea None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:01.508574 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a437-4d17-4821-af07-615934f459ea None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:01.508880 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a437-4d17-4821-af07-615934f459ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:01.528832 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-3777a437-4d17-4821-af07-615934f459ea None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:01.530166 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-3777a437-4d17-4821-af07-615934f459ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:01.597134 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1414/2819] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:01.605110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd632-f0c4-49d3-bf16-6f77a919a91b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:01.605380 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd632-f0c4-49d3-bf16-6f77a919a91b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:01.605662 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd632-f0c4-49d3-bf16-6f77a919a91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:01.625870 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-206bd632-f0c4-49d3-bf16-6f77a919a91b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:01.627129 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-206bd632-f0c4-49d3-bf16-6f77a919a91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:01.635901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1406/2820] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:01.641346 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777a437-4d17-4821-af07-615934f459ea None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:01.651633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777a437-4d17-4821-af07-615934f459ea None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:01.657664 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39856684-5163-4662-a88e-2ce2e97f2db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:01.658321 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39856684-5163-4662-a88e-2ce2e97f2db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:01.658602 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39856684-5163-4662-a88e-2ce2e97f2db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:01.658871 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39856684-5163-4662-a88e-2ce2e97f2db7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:01.659633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39856684-5163-4662-a88e-2ce2e97f2db7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:42:01.659972 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39856684-5163-4662-a88e-2ce2e97f2db7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:01.661582 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39856684-5163-4662-a88e-2ce2e97f2db7 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:01.673877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1415/2821] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:42:01.678342 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd632-f0c4-49d3-bf16-6f77a919a91b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:01.688185 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd632-f0c4-49d3-bf16-6f77a919a91b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:01.693864 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c486ef-5271-4c27-8938-2423b5188218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:01.694519 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c486ef-5271-4c27-8938-2423b5188218 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:01.694803 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c486ef-5271-4c27-8938-2423b5188218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:01.695080 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c486ef-5271-4c27-8938-2423b5188218 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:01.695812 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c486ef-5271-4c27-8938-2423b5188218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:01.697792 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c486ef-5271-4c27-8938-2423b5188218 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:01.736797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1407/2822] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:42:01 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:42:01.741205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39856684-5163-4662-a88e-2ce2e97f2db7 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:01.752066 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39856684-5163-4662-a88e-2ce2e97f2db7 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:01.756236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:01.811553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a4f17-9698-4e0f-b663-0bec396c7650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:01.812266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a4f17-9698-4e0f-b663-0bec396c7650 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:01.812553 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a4f17-9698-4e0f-b663-0bec396c7650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:01.812816 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a4f17-9698-4e0f-b663-0bec396c7650 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:01.813529 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a4f17-9698-4e0f-b663-0bec396c7650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:01.815458 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a4f17-9698-4e0f-b663-0bec396c7650 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:01.836063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1416/2823] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:42:01 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:42:01.840237 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c486ef-5271-4c27-8938-2423b5188218 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:01.853468 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c486ef-5271-4c27-8938-2423b5188218 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:01.859587 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4ceca-d08d-4e56-aec2-6d98012c65ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:01.860308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4ceca-d08d-4e56-aec2-6d98012c65ad admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:01.860586 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4ceca-d08d-4e56-aec2-6d98012c65ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:01.860857 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4ceca-d08d-4e56-aec2-6d98012c65ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:01.861592 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4ceca-d08d-4e56-aec2-6d98012c65ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:01.863194 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4ceca-d08d-4e56-aec2-6d98012c65ad admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:01.873860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1408/2824] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:01.878054 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a4f17-9698-4e0f-b663-0bec396c7650 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:01.888577 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a4f17-9698-4e0f-b663-0bec396c7650 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:01.894060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576d4d4-5a3b-44c8-8b96-18c63da768fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:01.894724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576d4d4-5a3b-44c8-8b96-18c63da768fc admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:01.895008 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576d4d4-5a3b-44c8-8b96-18c63da768fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:01.895283 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576d4d4-5a3b-44c8-8b96-18c63da768fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:01.896052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576d4d4-5a3b-44c8-8b96-18c63da768fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:01.897658 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576d4d4-5a3b-44c8-8b96-18c63da768fc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:01.907811 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1417/2825] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:01.912274 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4ceca-d08d-4e56-aec2-6d98012c65ad admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:01.922433 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4ceca-d08d-4e56-aec2-6d98012c65ad admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:01.927476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690ad1f-1e2e-46b3-b6dd-f69c8bf9c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:01.928377 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690ad1f-1e2e-46b3-b6dd-f69c8bf9c58f admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:01.928624 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690ad1f-1e2e-46b3-b6dd-f69c8bf9c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:01.928929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690ad1f-1e2e-46b3-b6dd-f69c8bf9c58f admin admin] PATH_INFO: `/v3/projects/9005badd188949ffbd0d167758a08640/users/1b6a91adc81e4b378326557b474b64e8/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:01.943902 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690ad1f-1e2e-46b3-b6dd-f69c8bf9c58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9005badd188949ffbd0d167758a08640, user_id=1b6a91adc81e4b378326557b474b64e8, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:01.946597 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690ad1f-1e2e-46b3-b6dd-f69c8bf9c58f admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:01.961331 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1409/2826] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:42:01 2022] PUT /identity/v3/projects/9005badd188949ffbd0d167758a08640/users/1b6a91adc81e4b378326557b474b64e8/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:01.972762 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3278-4227-49b2-89d8-05a56b3df4e9 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:01.973249 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3278-4227-49b2-89d8-05a56b3df4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:01.973545 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3278-4227-49b2-89d8-05a56b3df4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:02.004481 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-b45f3278-4227-49b2-89d8-05a56b3df4e9 None None] MFA Rules not processed for user `1b6a91adc81e4b378326557b474b64e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:02.005814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-b45f3278-4227-49b2-89d8-05a56b3df4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:02.073896 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1418/2827] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:02.078778 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690ad1f-1e2e-46b3-b6dd-f69c8bf9c58f admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:02.100779 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:02.150481 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690ad1f-1e2e-46b3-b6dd-f69c8bf9c58f admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:02.155767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fd974-fc73-4b00-9fbb-81f36c122a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:02.156421 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fd974-fc73-4b00-9fbb-81f36c122a32 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:02.156699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fd974-fc73-4b00-9fbb-81f36c122a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:02.156969 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fd974-fc73-4b00-9fbb-81f36c122a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:02.157668 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fd974-fc73-4b00-9fbb-81f36c122a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:02.159608 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fd974-fc73-4b00-9fbb-81f36c122a32 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:02.188790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1410/2828] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:42:02 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:42:02.195040 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f3278-4227-49b2-89d8-05a56b3df4e9 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:02.214581 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f3278-4227-49b2-89d8-05a56b3df4e9 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:02.276953 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d4c0c-6bcb-4a04-9593-6988ca7f7565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:02.277607 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d4c0c-6bcb-4a04-9593-6988ca7f7565 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:02.277894 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d4c0c-6bcb-4a04-9593-6988ca7f7565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:02.278173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d4c0c-6bcb-4a04-9593-6988ca7f7565 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:02.278857 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d4c0c-6bcb-4a04-9593-6988ca7f7565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:02.280864 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d4c0c-6bcb-4a04-9593-6988ca7f7565 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:02.303114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1419/2829] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:42:02 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:42:02.307416 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fd974-fc73-4b00-9fbb-81f36c122a32 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:02.318687 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fd974-fc73-4b00-9fbb-81f36c122a32 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:02.323728 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eba7a2-50c5-482e-8e76-17c5a502a9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:02.324389 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eba7a2-50c5-482e-8e76-17c5a502a9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:02.324671 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eba7a2-50c5-482e-8e76-17c5a502a9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:02.324948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eba7a2-50c5-482e-8e76-17c5a502a9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:02.325685 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eba7a2-50c5-482e-8e76-17c5a502a9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:02.327365 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eba7a2-50c5-482e-8e76-17c5a502a9f7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:02.338287 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1411/2830] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:02.343288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d4c0c-6bcb-4a04-9593-6988ca7f7565 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:02.350509 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:02.356426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d4c0c-6bcb-4a04-9593-6988ca7f7565 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:02.364792 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f197d-1d70-4dc5-af1f-839b49220b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:02.366269 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f197d-1d70-4dc5-af1f-839b49220b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:02.366696 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f197d-1d70-4dc5-af1f-839b49220b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:02.367038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f197d-1d70-4dc5-af1f-839b49220b7e admin admin] PATH_INFO: `/v3/projects/3441fb4d3ff34d7687e9eada57837016/users/ddd2ae58c4f14c43886b4891f550e891/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:02.384095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f197d-1d70-4dc5-af1f-839b49220b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3441fb4d3ff34d7687e9eada57837016, user_id=ddd2ae58c4f14c43886b4891f550e891, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:02.386730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f197d-1d70-4dc5-af1f-839b49220b7e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:02.401192 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1420/2831] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:42:02 2022] PUT /identity/v3/projects/3441fb4d3ff34d7687e9eada57837016/users/ddd2ae58c4f14c43886b4891f550e891/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:02.405241 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eba7a2-50c5-482e-8e76-17c5a502a9f7 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:02.415892 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eba7a2-50c5-482e-8e76-17c5a502a9f7 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:02.479478 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e30fd-10e7-411f-bdaa-ac5745513772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:02.480413 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e30fd-10e7-411f-bdaa-ac5745513772 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:02.480781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e30fd-10e7-411f-bdaa-ac5745513772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:02.481177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e30fd-10e7-411f-bdaa-ac5745513772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:02.482298 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e30fd-10e7-411f-bdaa-ac5745513772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:02.485188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e30fd-10e7-411f-bdaa-ac5745513772 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:02.505113 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1412/2832] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:02.509563 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f197d-1d70-4dc5-af1f-839b49220b7e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:02.521420 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f197d-1d70-4dc5-af1f-839b49220b7e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:02.527666 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38901c6b-cfdc-4025-ab6c-f39a339e06bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:02.528598 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901c6b-cfdc-4025-ab6c-f39a339e06bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:02.528883 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901c6b-cfdc-4025-ab6c-f39a339e06bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:02.529157 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901c6b-cfdc-4025-ab6c-f39a339e06bc admin admin] PATH_INFO: `/v3/projects/3441fb4d3ff34d7687e9eada57837016/users/ddd2ae58c4f14c43886b4891f550e891/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:02.531627 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38901c6b-cfdc-4025-ab6c-f39a339e06bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3441fb4d3ff34d7687e9eada57837016, user_id=ddd2ae58c4f14c43886b4891f550e891, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:02.534325 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38901c6b-cfdc-4025-ab6c-f39a339e06bc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:02.551381 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1421/2833] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:42:02 2022] PUT /identity/v3/projects/3441fb4d3ff34d7687e9eada57837016/users/ddd2ae58c4f14c43886b4891f550e891/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:02.564184 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53c16e-0eab-4876-a7cd-4f33afef76ed None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:02.564460 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53c16e-0eab-4876-a7cd-4f33afef76ed None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:02.564742 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53c16e-0eab-4876-a7cd-4f33afef76ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:02.594538 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-dc53c16e-0eab-4876-a7cd-4f33afef76ed None None] MFA Rules not processed for user `ddd2ae58c4f14c43886b4891f550e891`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:02.596427 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-dc53c16e-0eab-4876-a7cd-4f33afef76ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:02.674326 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1413/2834] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:02 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:02.685864 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38901c6b-cfdc-4025-ab6c-f39a339e06bc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:02.687633 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-38901c6b-cfdc-4025-ab6c-f39a339e06bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:02.751229 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38901c6b-cfdc-4025-ab6c-f39a339e06bc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:02.755375 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71060bb2-290c-46af-90a4-feb5489aca18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:02.756058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71060bb2-290c-46af-90a4-feb5489aca18 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:02.756339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71060bb2-290c-46af-90a4-feb5489aca18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:02.756616 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71060bb2-290c-46af-90a4-feb5489aca18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:02.766572 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71060bb2-290c-46af-90a4-feb5489aca18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:02.768048 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71060bb2-290c-46af-90a4-feb5489aca18 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:02.777973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1422/2835] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:42:02 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:42:03.209934 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53c16e-0eab-4876-a7cd-4f33afef76ed None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:03.223923 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:03.274682 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53c16e-0eab-4876-a7cd-4f33afef76ed None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:03.280238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284313b7-dc12-4870-8111-6268d69a7673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:03.281114 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284313b7-dc12-4870-8111-6268d69a7673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:03.281393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284313b7-dc12-4870-8111-6268d69a7673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:03.281661 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284313b7-dc12-4870-8111-6268d69a7673 admin admin] PATH_INFO: `/v3/users/1b6a91adc81e4b378326557b474b64e8` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:03.282910 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284313b7-dc12-4870-8111-6268d69a7673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b6a91adc81e4b378326557b474b64e8)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:03.284854 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284313b7-dc12-4870-8111-6268d69a7673 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:03.337395 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-284313b7-dc12-4870-8111-6268d69a7673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b6a91adc81e4b378326557b474b64e8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:03.350412 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-284313b7-dc12-4870-8111-6268d69a7673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b6a91adc81e4b378326557b474b64e8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:03.351106 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-284313b7-dc12-4870-8111-6268d69a7673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b6a91adc81e4b378326557b474b64e8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:03.351769 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-284313b7-dc12-4870-8111-6268d69a7673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b6a91adc81e4b378326557b474b64e8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:03.359043 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-284313b7-dc12-4870-8111-6268d69a7673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b6a91adc81e4b378326557b474b64e8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:03.373693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1414/2836] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:42:03 2022] DELETE /identity/v3/users/1b6a91adc81e4b378326557b474b64e8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:03.379255 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f72de3-3e40-4514-8453-05b355c411b6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:03.379770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f72de3-3e40-4514-8453-05b355c411b6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:03.379906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f72de3-3e40-4514-8453-05b355c411b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:03.400560 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-70f72de3-3e40-4514-8453-05b355c411b6 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:03.401775 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-70f72de3-3e40-4514-8453-05b355c411b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:03.463757 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1423/2837] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:03.474120 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284313b7-dc12-4870-8111-6268d69a7673 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:03.475639 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-284313b7-dc12-4870-8111-6268d69a7673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:03.534118 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284313b7-dc12-4870-8111-6268d69a7673 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:03.537913 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3070283-46be-4f7c-bd3d-d5349779f3c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:03.538556 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3070283-46be-4f7c-bd3d-d5349779f3c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:03.538833 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3070283-46be-4f7c-bd3d-d5349779f3c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:03.539104 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3070283-46be-4f7c-bd3d-d5349779f3c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:03.548352 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3070283-46be-4f7c-bd3d-d5349779f3c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:03.549790 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3070283-46be-4f7c-bd3d-d5349779f3c1 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:03.559104 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1415/2838] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:42:03.850354 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f72de3-3e40-4514-8453-05b355c411b6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:03.852104 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-70f72de3-3e40-4514-8453-05b355c411b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:03.864494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f72de3-3e40-4514-8453-05b355c411b6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:03.869897 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3c056-57b0-4380-95a4-80f374956d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:03.870780 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3c056-57b0-4380-95a4-80f374956d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:03.871057 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3c056-57b0-4380-95a4-80f374956d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:03.871325 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3c056-57b0-4380-95a4-80f374956d6f admin admin] PATH_INFO: `/v3/projects/9005badd188949ffbd0d167758a08640` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:03.872639 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3c056-57b0-4380-95a4-80f374956d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9005badd188949ffbd0d167758a08640)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:03.874791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3c056-57b0-4380-95a4-80f374956d6f admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:03.924411 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-25c3c056-57b0-4380-95a4-80f374956d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9005badd188949ffbd0d167758a08640', 'request_id': 'req-25c3c056-57b0-4380-95a4-80f374956d6f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:03.934220 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-25c3c056-57b0-4380-95a4-80f374956d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9005badd188949ffbd0d167758a08640', 'request_id': 'req-25c3c056-57b0-4380-95a4-80f374956d6f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:03.940319 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-25c3c056-57b0-4380-95a4-80f374956d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9005badd188949ffbd0d167758a08640', 'request_id': 'req-25c3c056-57b0-4380-95a4-80f374956d6f'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:03.941443 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:03.954208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-25c3c056-57b0-4380-95a4-80f374956d6f admin admin] The token cache is being invalidate because project 9005badd188949ffbd0d167758a08640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:42:03.954493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-25c3c056-57b0-4380-95a4-80f374956d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:03.955120 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-25c3c056-57b0-4380-95a4-80f374956d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:03.956907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1424/2839] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:42:03 2022] DELETE /identity/v3/projects/9005badd188949ffbd0d167758a08640 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:03.960763 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3070283-46be-4f7c-bd3d-d5349779f3c1 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:03.971165 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3070283-46be-4f7c-bd3d-d5349779f3c1 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:04.004285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:04.038245 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91800611-a441-4055-8f8a-1ff553cb35a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:04.039158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91800611-a441-4055-8f8a-1ff553cb35a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:04.039435 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91800611-a441-4055-8f8a-1ff553cb35a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:04.039747 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91800611-a441-4055-8f8a-1ff553cb35a0 admin admin] PATH_INFO: `/v3/users/ddd2ae58c4f14c43886b4891f550e891` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:04.041034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91800611-a441-4055-8f8a-1ff553cb35a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd2ae58c4f14c43886b4891f550e891)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:04.042950 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91800611-a441-4055-8f8a-1ff553cb35a0 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:04.093464 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-91800611-a441-4055-8f8a-1ff553cb35a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd2ae58c4f14c43886b4891f550e891'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:04.105573 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-91800611-a441-4055-8f8a-1ff553cb35a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd2ae58c4f14c43886b4891f550e891'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:04.106329 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-91800611-a441-4055-8f8a-1ff553cb35a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd2ae58c4f14c43886b4891f550e891'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:04.107044 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-91800611-a441-4055-8f8a-1ff553cb35a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd2ae58c4f14c43886b4891f550e891'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:04.114957 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-91800611-a441-4055-8f8a-1ff553cb35a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd2ae58c4f14c43886b4891f550e891'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:04.136070 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1416/2840] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:42:03 2022] DELETE /identity/v3/users/ddd2ae58c4f14c43886b4891f550e891 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:04.420238 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3c056-57b0-4380-95a4-80f374956d6f admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:04.421849 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-25c3c056-57b0-4380-95a4-80f374956d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:04.435533 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3c056-57b0-4380-95a4-80f374956d6f admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:04.499493 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101370c-7b57-4a69-9de5-31c34e5d5f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:04.500843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101370c-7b57-4a69-9de5-31c34e5d5f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:04.501391 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101370c-7b57-4a69-9de5-31c34e5d5f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:04.501976 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101370c-7b57-4a69-9de5-31c34e5d5f0a admin admin] PATH_INFO: `/v3/projects/3441fb4d3ff34d7687e9eada57837016` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:04.503624 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101370c-7b57-4a69-9de5-31c34e5d5f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3441fb4d3ff34d7687e9eada57837016)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:04.511930 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101370c-7b57-4a69-9de5-31c34e5d5f0a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:04.562395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a101370c-7b57-4a69-9de5-31c34e5d5f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3441fb4d3ff34d7687e9eada57837016', 'request_id': 'req-a101370c-7b57-4a69-9de5-31c34e5d5f0a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:04.572606 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a101370c-7b57-4a69-9de5-31c34e5d5f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3441fb4d3ff34d7687e9eada57837016', 'request_id': 'req-a101370c-7b57-4a69-9de5-31c34e5d5f0a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:04.580191 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a101370c-7b57-4a69-9de5-31c34e5d5f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3441fb4d3ff34d7687e9eada57837016', 'request_id': 'req-a101370c-7b57-4a69-9de5-31c34e5d5f0a'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:04.592434 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a101370c-7b57-4a69-9de5-31c34e5d5f0a admin admin] The token cache is being invalidate because project 3441fb4d3ff34d7687e9eada57837016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:42:04.592809 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a101370c-7b57-4a69-9de5-31c34e5d5f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:04.593487 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a101370c-7b57-4a69-9de5-31c34e5d5f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:04.595138 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1425/2841] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:42:04 2022] DELETE /identity/v3/projects/3441fb4d3ff34d7687e9eada57837016 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:04.600460 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53749101-ec41-4f77-aa51-7a4d997b55af None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:04.601010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53749101-ec41-4f77-aa51-7a4d997b55af None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:04.601010 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53749101-ec41-4f77-aa51-7a4d997b55af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:04.621127 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-53749101-ec41-4f77-aa51-7a4d997b55af None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:04.622346 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-53749101-ec41-4f77-aa51-7a4d997b55af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:04.692773 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1417/2842] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:04.700846 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786a78a-cec3-4e3b-972c-6daeb6343ba1 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:04.701181 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786a78a-cec3-4e3b-972c-6daeb6343ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:04.701385 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786a78a-cec3-4e3b-972c-6daeb6343ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:04.720803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-e786a78a-cec3-4e3b-972c-6daeb6343ba1 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:04.722021 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-e786a78a-cec3-4e3b-972c-6daeb6343ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:04.730039 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1426/2843] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:04.734550 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53749101-ec41-4f77-aa51-7a4d997b55af None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:04.744768 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53749101-ec41-4f77-aa51-7a4d997b55af None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:04.751160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ba629-1d3c-4623-8d2e-af1aa6a93c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:04.751809 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ba629-1d3c-4623-8d2e-af1aa6a93c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:04.752091 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ba629-1d3c-4623-8d2e-af1aa6a93c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:04.752364 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ba629-1d3c-4623-8d2e-af1aa6a93c49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:04.753098 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ba629-1d3c-4623-8d2e-af1aa6a93c49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:42:04.753404 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ba629-1d3c-4623-8d2e-af1aa6a93c49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:04.755031 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ba629-1d3c-4623-8d2e-af1aa6a93c49 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:04.768110 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1418/2844] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:42:04.772823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786a78a-cec3-4e3b-972c-6daeb6343ba1 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:04.782856 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786a78a-cec3-4e3b-972c-6daeb6343ba1 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:04.789352 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096bbfb-ca71-48be-b9b2-eb5711bbe33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:04.790011 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096bbfb-ca71-48be-b9b2-eb5711bbe33d admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:04.790290 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096bbfb-ca71-48be-b9b2-eb5711bbe33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:04.790566 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096bbfb-ca71-48be-b9b2-eb5711bbe33d admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:04.791255 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096bbfb-ca71-48be-b9b2-eb5711bbe33d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:04.793191 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096bbfb-ca71-48be-b9b2-eb5711bbe33d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:04.821461 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1427/2845] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:42:04 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:42:04.826477 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ba629-1d3c-4623-8d2e-af1aa6a93c49 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:04.842698 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ba629-1d3c-4623-8d2e-af1aa6a93c49 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:04.900385 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:04.921802 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d65289-949b-45bf-9bc1-186debe80a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:04.922493 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d65289-949b-45bf-9bc1-186debe80a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:04.922783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d65289-949b-45bf-9bc1-186debe80a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:04.923066 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d65289-949b-45bf-9bc1-186debe80a62 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:04.923802 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d65289-949b-45bf-9bc1-186debe80a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:04.925738 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d65289-949b-45bf-9bc1-186debe80a62 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:04.947050 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1419/2846] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:42:04 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:42:04.951341 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096bbfb-ca71-48be-b9b2-eb5711bbe33d admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:04.961853 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096bbfb-ca71-48be-b9b2-eb5711bbe33d admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:04.966924 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fee3d5-bf92-4022-801e-d283814b3634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:04.967870 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fee3d5-bf92-4022-801e-d283814b3634 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:04.968164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fee3d5-bf92-4022-801e-d283814b3634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:04.968454 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fee3d5-bf92-4022-801e-d283814b3634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:04.969181 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fee3d5-bf92-4022-801e-d283814b3634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:04.970827 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fee3d5-bf92-4022-801e-d283814b3634 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:04.986561 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1428/2847] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:04.990976 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d65289-949b-45bf-9bc1-186debe80a62 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:05.007749 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d65289-949b-45bf-9bc1-186debe80a62 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:05.015884 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23dca9-4114-4720-a317-14ec2e2d848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:05.016986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23dca9-4114-4720-a317-14ec2e2d848a admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:05.017530 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23dca9-4114-4720-a317-14ec2e2d848a admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:05.018008 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23dca9-4114-4720-a317-14ec2e2d848a admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:05.019160 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23dca9-4114-4720-a317-14ec2e2d848a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:05.021513 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23dca9-4114-4720-a317-14ec2e2d848a admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:05.034948 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1420/2848] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:05.039460 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fee3d5-bf92-4022-801e-d283814b3634 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:05.051801 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fee3d5-bf92-4022-801e-d283814b3634 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:05.057907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f235d-7487-481a-86ee-4e6aedb34725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:05.058834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f235d-7487-481a-86ee-4e6aedb34725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:05.059337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f235d-7487-481a-86ee-4e6aedb34725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:05.059630 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f235d-7487-481a-86ee-4e6aedb34725 admin admin] PATH_INFO: `/v3/projects/b588b23a14034f6292ad737b7a1d8f9c/users/3d1ab86862ad46388f8679687dc8fee6/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:05.080988 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f235d-7487-481a-86ee-4e6aedb34725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b588b23a14034f6292ad737b7a1d8f9c, user_id=3d1ab86862ad46388f8679687dc8fee6, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:05.083782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f235d-7487-481a-86ee-4e6aedb34725 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:05.102838 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1429/2849] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:42:05 2022] PUT /identity/v3/projects/b588b23a14034f6292ad737b7a1d8f9c/users/3d1ab86862ad46388f8679687dc8fee6/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:05.118199 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c2373-95a0-45f4-b8db-81bcfe539a0e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:05.118515 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c2373-95a0-45f4-b8db-81bcfe539a0e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:05.118797 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c2373-95a0-45f4-b8db-81bcfe539a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:05.157933 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-728c2373-95a0-45f4-b8db-81bcfe539a0e None None] MFA Rules not processed for user `3d1ab86862ad46388f8679687dc8fee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:05.159170 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-728c2373-95a0-45f4-b8db-81bcfe539a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:05.240696 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1421/2850] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:05.245506 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f235d-7487-481a-86ee-4e6aedb34725 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:05.269888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:05.335293 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f235d-7487-481a-86ee-4e6aedb34725 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:05.343140 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd6321-0b0a-41a5-8c4b-dad0374909cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:05.344162 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd6321-0b0a-41a5-8c4b-dad0374909cc admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:05.344449 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd6321-0b0a-41a5-8c4b-dad0374909cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:05.344730 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd6321-0b0a-41a5-8c4b-dad0374909cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:05.345448 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd6321-0b0a-41a5-8c4b-dad0374909cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:05.347378 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd6321-0b0a-41a5-8c4b-dad0374909cc admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:05.384985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1430/2851] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:42:05 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:42:05.388144 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c2373-95a0-45f4-b8db-81bcfe539a0e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:05.409108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c2373-95a0-45f4-b8db-81bcfe539a0e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:05.489039 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db322518-8ef0-42bd-98fc-a31d99fbd7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:05.489773 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db322518-8ef0-42bd-98fc-a31d99fbd7fa admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:05.490063 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db322518-8ef0-42bd-98fc-a31d99fbd7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:05.490344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db322518-8ef0-42bd-98fc-a31d99fbd7fa admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:05.491048 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db322518-8ef0-42bd-98fc-a31d99fbd7fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:05.493026 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db322518-8ef0-42bd-98fc-a31d99fbd7fa admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:05.522279 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1422/2852] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:42:05 2022] POST /identity/v3/users => generated 300 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:42:05.527453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd6321-0b0a-41a5-8c4b-dad0374909cc admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:05.545177 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd6321-0b0a-41a5-8c4b-dad0374909cc admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:05.553494 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbede0c-a978-4fc5-9283-7b43a17438fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:05.554561 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbede0c-a978-4fc5-9283-7b43a17438fb admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:05.555023 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbede0c-a978-4fc5-9283-7b43a17438fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:05.555468 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbede0c-a978-4fc5-9283-7b43a17438fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:05.556880 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbede0c-a978-4fc5-9283-7b43a17438fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:05.560041 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbede0c-a978-4fc5-9283-7b43a17438fb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:05.575650 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1431/2853] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:05.581137 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db322518-8ef0-42bd-98fc-a31d99fbd7fa admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:05.593830 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db322518-8ef0-42bd-98fc-a31d99fbd7fa admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:05.601002 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708185c-c345-4e6e-b09f-1364d1e13e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:05.602340 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708185c-c345-4e6e-b09f-1364d1e13e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:05.602639 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708185c-c345-4e6e-b09f-1364d1e13e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:05.602891 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708185c-c345-4e6e-b09f-1364d1e13e12 admin admin] PATH_INFO: `/v3/projects/9329696ab97e4d3e95c2dc6152403afc/users/eec32a72ad66441e9e9ca051b1d99952/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:05.623444 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708185c-c345-4e6e-b09f-1364d1e13e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9329696ab97e4d3e95c2dc6152403afc, user_id=eec32a72ad66441e9e9ca051b1d99952, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:05.627853 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708185c-c345-4e6e-b09f-1364d1e13e12 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:05.650397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1423/2854] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:42:05 2022] PUT /identity/v3/projects/9329696ab97e4d3e95c2dc6152403afc/users/eec32a72ad66441e9e9ca051b1d99952/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:05.655425 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbede0c-a978-4fc5-9283-7b43a17438fb admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:05.669651 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbede0c-a978-4fc5-9283-7b43a17438fb admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:05.756652 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379bc97-0528-464f-b7d4-3551901628bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:05.757325 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379bc97-0528-464f-b7d4-3551901628bb admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:05.757603 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379bc97-0528-464f-b7d4-3551901628bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:05.757877 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379bc97-0528-464f-b7d4-3551901628bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:05.758718 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379bc97-0528-464f-b7d4-3551901628bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:05.760539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379bc97-0528-464f-b7d4-3551901628bb admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:05.776590 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1432/2855] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:05.781721 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708185c-c345-4e6e-b09f-1364d1e13e12 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:05.797432 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708185c-c345-4e6e-b09f-1364d1e13e12 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:05.804016 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f69b48-4563-4a29-88d4-4333b1493819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:05.804924 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f69b48-4563-4a29-88d4-4333b1493819 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:05.805206 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f69b48-4563-4a29-88d4-4333b1493819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:05.805485 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f69b48-4563-4a29-88d4-4333b1493819 admin admin] PATH_INFO: `/v3/projects/9329696ab97e4d3e95c2dc6152403afc/users/eec32a72ad66441e9e9ca051b1d99952/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:05.807842 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f69b48-4563-4a29-88d4-4333b1493819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9329696ab97e4d3e95c2dc6152403afc, user_id=eec32a72ad66441e9e9ca051b1d99952, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:05.810527 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f69b48-4563-4a29-88d4-4333b1493819 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:05.826072 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1424/2856] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:42:05 2022] PUT /identity/v3/projects/9329696ab97e4d3e95c2dc6152403afc/users/eec32a72ad66441e9e9ca051b1d99952/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:05.904573 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c2d46-37c1-4743-b248-6c4b9943fb77 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:05.904839 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c2d46-37c1-4743-b248-6c4b9943fb77 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:05.905127 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c2d46-37c1-4743-b248-6c4b9943fb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:05.937495 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f88c2d46-37c1-4743-b248-6c4b9943fb77 None None] MFA Rules not processed for user `eec32a72ad66441e9e9ca051b1d99952`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:05.938795 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f88c2d46-37c1-4743-b248-6c4b9943fb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:06.014980 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1433/2857] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:42:06.031003 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f69b48-4563-4a29-88d4-4333b1493819 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:06.032885 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-79f69b48-4563-4a29-88d4-4333b1493819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:06.038698 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:06.093176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f69b48-4563-4a29-88d4-4333b1493819 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:06.097355 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90330ce6-3085-4eb5-bd43-ddba0b08350c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:06.098006 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90330ce6-3085-4eb5-bd43-ddba0b08350c service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:06.098285 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90330ce6-3085-4eb5-bd43-ddba0b08350c service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:06.098557 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90330ce6-3085-4eb5-bd43-ddba0b08350c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:06.108048 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90330ce6-3085-4eb5-bd43-ddba0b08350c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:06.109489 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90330ce6-3085-4eb5-bd43-ddba0b08350c service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:06.118904 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1425/2858] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:42:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:42:06.184844 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c2d46-37c1-4743-b248-6c4b9943fb77 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:06.202467 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:06.248299 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c2d46-37c1-4743-b248-6c4b9943fb77 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:06.253831 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fde590-96f7-4170-99f8-79f036642949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:06.254715 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fde590-96f7-4170-99f8-79f036642949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:06.254999 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fde590-96f7-4170-99f8-79f036642949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:06.255276 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fde590-96f7-4170-99f8-79f036642949 admin admin] PATH_INFO: `/v3/users/3d1ab86862ad46388f8679687dc8fee6` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:06.256608 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fde590-96f7-4170-99f8-79f036642949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d1ab86862ad46388f8679687dc8fee6)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:06.258526 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fde590-96f7-4170-99f8-79f036642949 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:06.313977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f2fde590-96f7-4170-99f8-79f036642949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d1ab86862ad46388f8679687dc8fee6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:06.314749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f2fde590-96f7-4170-99f8-79f036642949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d1ab86862ad46388f8679687dc8fee6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:06.315636 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f2fde590-96f7-4170-99f8-79f036642949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d1ab86862ad46388f8679687dc8fee6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:06.326843 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f2fde590-96f7-4170-99f8-79f036642949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d1ab86862ad46388f8679687dc8fee6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:06.335010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-f2fde590-96f7-4170-99f8-79f036642949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d1ab86862ad46388f8679687dc8fee6'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:06.353955 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1434/2859] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:42:06 2022] DELETE /identity/v3/users/3d1ab86862ad46388f8679687dc8fee6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:06.358639 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc1bdd-9ca6-4bb6-a052-97b3c9ffb20b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:06.358932 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc1bdd-9ca6-4bb6-a052-97b3c9ffb20b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:06.359213 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc1bdd-9ca6-4bb6-a052-97b3c9ffb20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:06.376058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-1edc1bdd-9ca6-4bb6-a052-97b3c9ffb20b None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:06.377258 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1edc1bdd-9ca6-4bb6-a052-97b3c9ffb20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:06.436781 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1426/2860] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:06.448273 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fde590-96f7-4170-99f8-79f036642949 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:06.449768 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f2fde590-96f7-4170-99f8-79f036642949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:06.508236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fde590-96f7-4170-99f8-79f036642949 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:06.512052 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd263107-70e6-4054-b1e6-4b43a24ec90c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:06.512702 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd263107-70e6-4054-b1e6-4b43a24ec90c service neutron] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:06.512985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd263107-70e6-4054-b1e6-4b43a24ec90c service neutron] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:06.513264 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd263107-70e6-4054-b1e6-4b43a24ec90c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:06.524266 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd263107-70e6-4054-b1e6-4b43a24ec90c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:06.525708 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd263107-70e6-4054-b1e6-4b43a24ec90c service neutron] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:06.536053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1435/2861] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:42:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:42:06.821354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc1bdd-9ca6-4bb6-a052-97b3c9ffb20b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:06.823021 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-1edc1bdd-9ca6-4bb6-a052-97b3c9ffb20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:06.835556 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc1bdd-9ca6-4bb6-a052-97b3c9ffb20b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:06.841423 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5269f6-0e52-4a6a-b8be-5edfdd477017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:06.842411 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5269f6-0e52-4a6a-b8be-5edfdd477017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:06.842693 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5269f6-0e52-4a6a-b8be-5edfdd477017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:06.843034 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5269f6-0e52-4a6a-b8be-5edfdd477017 admin admin] PATH_INFO: `/v3/projects/b588b23a14034f6292ad737b7a1d8f9c` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:06.844319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5269f6-0e52-4a6a-b8be-5edfdd477017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b588b23a14034f6292ad737b7a1d8f9c)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:06.846229 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5269f6-0e52-4a6a-b8be-5edfdd477017 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:06.899827 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2b5269f6-0e52-4a6a-b8be-5edfdd477017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b588b23a14034f6292ad737b7a1d8f9c', 'request_id': 'req-2b5269f6-0e52-4a6a-b8be-5edfdd477017'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:06.907304 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2b5269f6-0e52-4a6a-b8be-5edfdd477017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b588b23a14034f6292ad737b7a1d8f9c', 'request_id': 'req-2b5269f6-0e52-4a6a-b8be-5edfdd477017'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:06.917185 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2b5269f6-0e52-4a6a-b8be-5edfdd477017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b588b23a14034f6292ad737b7a1d8f9c', 'request_id': 'req-2b5269f6-0e52-4a6a-b8be-5edfdd477017'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:06.928683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2b5269f6-0e52-4a6a-b8be-5edfdd477017 admin admin] The token cache is being invalidate because project b588b23a14034f6292ad737b7a1d8f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:42:06.928977 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2b5269f6-0e52-4a6a-b8be-5edfdd477017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:06.929611 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2b5269f6-0e52-4a6a-b8be-5edfdd477017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:06.931176 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1427/2862] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:42:06 2022] DELETE /identity/v3/projects/b588b23a14034f6292ad737b7a1d8f9c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:06.935281 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd263107-70e6-4054-b1e6-4b43a24ec90c service neutron] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:06.945146 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd263107-70e6-4054-b1e6-4b43a24ec90c service neutron] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:06.980444 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:07.007680 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7d5b7-ab1d-47a9-9a81-c9cd890843c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:07.008562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7d5b7-ab1d-47a9-9a81-c9cd890843c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:07.008845 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7d5b7-ab1d-47a9-9a81-c9cd890843c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:07.009124 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7d5b7-ab1d-47a9-9a81-c9cd890843c2 admin admin] PATH_INFO: `/v3/users/eec32a72ad66441e9e9ca051b1d99952` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:07.010426 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7d5b7-ab1d-47a9-9a81-c9cd890843c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eec32a72ad66441e9e9ca051b1d99952)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:07.012505 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7d5b7-ab1d-47a9-9a81-c9cd890843c2 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:07.061562 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dfc7d5b7-ab1d-47a9-9a81-c9cd890843c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eec32a72ad66441e9e9ca051b1d99952'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:07.062198 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dfc7d5b7-ab1d-47a9-9a81-c9cd890843c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eec32a72ad66441e9e9ca051b1d99952'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:07.062791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dfc7d5b7-ab1d-47a9-9a81-c9cd890843c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eec32a72ad66441e9e9ca051b1d99952'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:07.069703 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dfc7d5b7-ab1d-47a9-9a81-c9cd890843c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eec32a72ad66441e9e9ca051b1d99952'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:07.078541 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-dfc7d5b7-ab1d-47a9-9a81-c9cd890843c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eec32a72ad66441e9e9ca051b1d99952'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:07.096172 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1436/2863] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:42:06 2022] DELETE /identity/v3/users/eec32a72ad66441e9e9ca051b1d99952 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:07.381311 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5269f6-0e52-4a6a-b8be-5edfdd477017 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:07.382995 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-2b5269f6-0e52-4a6a-b8be-5edfdd477017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:07.397963 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5269f6-0e52-4a6a-b8be-5edfdd477017 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:07.430373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:07.464877 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc96615-7590-49a7-8f79-643c68d55872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:07.466064 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc96615-7590-49a7-8f79-643c68d55872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:07.466347 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc96615-7590-49a7-8f79-643c68d55872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:07.466620 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc96615-7590-49a7-8f79-643c68d55872 admin admin] PATH_INFO: `/v3/projects/9329696ab97e4d3e95c2dc6152403afc` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:07.468131 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc96615-7590-49a7-8f79-643c68d55872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9329696ab97e4d3e95c2dc6152403afc)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:07.470105 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc96615-7590-49a7-8f79-643c68d55872 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:07.519929 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2cc96615-7590-49a7-8f79-643c68d55872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9329696ab97e4d3e95c2dc6152403afc', 'request_id': 'req-2cc96615-7590-49a7-8f79-643c68d55872'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:07.526448 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2cc96615-7590-49a7-8f79-643c68d55872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9329696ab97e4d3e95c2dc6152403afc', 'request_id': 'req-2cc96615-7590-49a7-8f79-643c68d55872'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:07.537670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2cc96615-7590-49a7-8f79-643c68d55872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9329696ab97e4d3e95c2dc6152403afc', 'request_id': 'req-2cc96615-7590-49a7-8f79-643c68d55872'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:07.549767 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2cc96615-7590-49a7-8f79-643c68d55872 admin admin] The token cache is being invalidate because project 9329696ab97e4d3e95c2dc6152403afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:42:07.550054 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2cc96615-7590-49a7-8f79-643c68d55872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:07.550746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2cc96615-7590-49a7-8f79-643c68d55872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:07.552391 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1428/2864] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:42:07 2022] DELETE /identity/v3/projects/9329696ab97e4d3e95c2dc6152403afc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:07.557320 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bea442-75cc-4259-85ff-212e3e59e3b2 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:07.557806 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bea442-75cc-4259-85ff-212e3e59e3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:07.557906 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bea442-75cc-4259-85ff-212e3e59e3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:07.576968 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-28bea442-75cc-4259-85ff-212e3e59e3b2 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:07.578208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-28bea442-75cc-4259-85ff-212e3e59e3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:07.648142 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1437/2865] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:07.656177 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbffa8a-7ff2-4be1-ac73-618fe8630931 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:07.656465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbffa8a-7ff2-4be1-ac73-618fe8630931 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:07.656770 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbffa8a-7ff2-4be1-ac73-618fe8630931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:07.676701 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-4bbffa8a-7ff2-4be1-ac73-618fe8630931 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:07.677904 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-4bbffa8a-7ff2-4be1-ac73-618fe8630931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:07.686252 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1429/2866] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:07.690604 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bea442-75cc-4259-85ff-212e3e59e3b2 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:07.700878 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bea442-75cc-4259-85ff-212e3e59e3b2 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:07.706588 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52c3a9-2273-4d58-bbcc-e4bad0b9680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:07.707187 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52c3a9-2273-4d58-bbcc-e4bad0b9680a admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:07.707476 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52c3a9-2273-4d58-bbcc-e4bad0b9680a admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:07.707773 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52c3a9-2273-4d58-bbcc-e4bad0b9680a admin admin] PATH_INFO: `/v3/domains` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:07.708517 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52c3a9-2273-4d58-bbcc-e4bad0b9680a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:42:07.708834 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52c3a9-2273-4d58-bbcc-e4bad0b9680a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:07.710441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52c3a9-2273-4d58-bbcc-e4bad0b9680a admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:07.723288 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1438/2867] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:42:07.727734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbffa8a-7ff2-4be1-ac73-618fe8630931 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:07.737173 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbffa8a-7ff2-4be1-ac73-618fe8630931 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:07.742326 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bfdce-73a0-4033-8bf0-6a7486383044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:07.742964 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bfdce-73a0-4033-8bf0-6a7486383044 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:07.743244 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bfdce-73a0-4033-8bf0-6a7486383044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:07.743529 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bfdce-73a0-4033-8bf0-6a7486383044 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:07.744253 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bfdce-73a0-4033-8bf0-6a7486383044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:07.746148 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bfdce-73a0-4033-8bf0-6a7486383044 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:07.776059 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1430/2868] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:42:07 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:42:07.780893 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52c3a9-2273-4d58-bbcc-e4bad0b9680a admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:07.790885 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52c3a9-2273-4d58-bbcc-e4bad0b9680a admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:07.833782 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:07.851217 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79951d3e-de2e-4660-bd9b-2096829073df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:07.851958 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79951d3e-de2e-4660-bd9b-2096829073df admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:07.852243 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79951d3e-de2e-4660-bd9b-2096829073df admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:07.852519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79951d3e-de2e-4660-bd9b-2096829073df admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:07.853205 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79951d3e-de2e-4660-bd9b-2096829073df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:07.855164 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79951d3e-de2e-4660-bd9b-2096829073df admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:07.879531 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1439/2869] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:42:07 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:42:07.885344 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bfdce-73a0-4033-8bf0-6a7486383044 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:07.896784 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bfdce-73a0-4033-8bf0-6a7486383044 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:07.901865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee067a0f-83a8-45b4-9798-2efa4e78a645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:07.902518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee067a0f-83a8-45b4-9798-2efa4e78a645 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:07.902798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee067a0f-83a8-45b4-9798-2efa4e78a645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:07.903069 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee067a0f-83a8-45b4-9798-2efa4e78a645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:07.903822 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee067a0f-83a8-45b4-9798-2efa4e78a645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:07.905470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee067a0f-83a8-45b4-9798-2efa4e78a645 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:07.916221 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1431/2870] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:07.920343 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79951d3e-de2e-4660-bd9b-2096829073df admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:07.930360 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79951d3e-de2e-4660-bd9b-2096829073df admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:07.935114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652e96e-3c6d-4033-8db6-296648642af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:07.935821 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652e96e-3c6d-4033-8db6-296648642af9 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:07.936248 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652e96e-3c6d-4033-8db6-296648642af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:07.936458 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652e96e-3c6d-4033-8db6-296648642af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:07.937216 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652e96e-3c6d-4033-8db6-296648642af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:07.938803 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652e96e-3c6d-4033-8db6-296648642af9 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:07.948794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1440/2871] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:07.953582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee067a0f-83a8-45b4-9798-2efa4e78a645 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:07.970791 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee067a0f-83a8-45b4-9798-2efa4e78a645 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:07.978283 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fe5a5-e9d3-47d9-a1f3-862de828e231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:07.979158 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fe5a5-e9d3-47d9-a1f3-862de828e231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:07.979434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fe5a5-e9d3-47d9-a1f3-862de828e231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:07.979734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fe5a5-e9d3-47d9-a1f3-862de828e231 admin admin] PATH_INFO: `/v3/projects/5a4265632a2147fe9b8226b462c36228/users/f0ca511c00554e69bc857cbdb0d10ca8/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:07.994750 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fe5a5-e9d3-47d9-a1f3-862de828e231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4265632a2147fe9b8226b462c36228, user_id=f0ca511c00554e69bc857cbdb0d10ca8, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:07.997427 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fe5a5-e9d3-47d9-a1f3-862de828e231 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:08.012691 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1432/2872] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:42:07 2022] PUT /identity/v3/projects/5a4265632a2147fe9b8226b462c36228/users/f0ca511c00554e69bc857cbdb0d10ca8/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:08.024041 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105cc43-7336-4f89-ae45-0925cf68e0c5 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:08.024396 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105cc43-7336-4f89-ae45-0925cf68e0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:08.024760 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105cc43-7336-4f89-ae45-0925cf68e0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:08.059813 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-6105cc43-7336-4f89-ae45-0925cf68e0c5 None None] MFA Rules not processed for user `f0ca511c00554e69bc857cbdb0d10ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:08.061353 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-6105cc43-7336-4f89-ae45-0925cf68e0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:08.127797 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1441/2873] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:08.134882 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fe5a5-e9d3-47d9-a1f3-862de828e231 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:08.198888 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:08.205099 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fe5a5-e9d3-47d9-a1f3-862de828e231 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:08.211000 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9ad48-a387-456e-b1ce-a7fb97b08981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:08.211711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9ad48-a387-456e-b1ce-a7fb97b08981 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:08.212011 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9ad48-a387-456e-b1ce-a7fb97b08981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:08.212301 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9ad48-a387-456e-b1ce-a7fb97b08981 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:08.213055 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9ad48-a387-456e-b1ce-a7fb97b08981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:08.215668 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9ad48-a387-456e-b1ce-a7fb97b08981 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:08.245005 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1433/2874] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:42:08 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:42:08.249383 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105cc43-7336-4f89-ae45-0925cf68e0c5 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:08.261053 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105cc43-7336-4f89-ae45-0925cf68e0c5 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:08.321091 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee085a-be0f-49fa-9f57-5d74e3db11a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:08.321770 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee085a-be0f-49fa-9f57-5d74e3db11a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:08.322058 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee085a-be0f-49fa-9f57-5d74e3db11a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:08.322337 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee085a-be0f-49fa-9f57-5d74e3db11a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:08.323028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee085a-be0f-49fa-9f57-5d74e3db11a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:08.325028 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee085a-be0f-49fa-9f57-5d74e3db11a1 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:08.350585 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1442/2875] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:42:08 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:42:08.355909 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9ad48-a387-456e-b1ce-a7fb97b08981 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:08.366723 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9ad48-a387-456e-b1ce-a7fb97b08981 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:08.372093 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee9b5d-449d-49c9-8ebb-00e7d2bb15cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:08.372743 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee9b5d-449d-49c9-8ebb-00e7d2bb15cf admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:08.373107 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee9b5d-449d-49c9-8ebb-00e7d2bb15cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:08.373465 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee9b5d-449d-49c9-8ebb-00e7d2bb15cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:08.374471 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee9b5d-449d-49c9-8ebb-00e7d2bb15cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:08.376152 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee9b5d-449d-49c9-8ebb-00e7d2bb15cf admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:08.387317 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1434/2876] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:08.391453 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee085a-be0f-49fa-9f57-5d74e3db11a1 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:08.402313 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee085a-be0f-49fa-9f57-5d74e3db11a1 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:08.407907 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7cc9a-d17a-48db-b034-936061cc8124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:08.408605 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7cc9a-d17a-48db-b034-936061cc8124 admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:08.408888 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7cc9a-d17a-48db-b034-936061cc8124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:08.409165 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7cc9a-d17a-48db-b034-936061cc8124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:08.409893 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7cc9a-d17a-48db-b034-936061cc8124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:08.411510 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7cc9a-d17a-48db-b034-936061cc8124 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:08.421791 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1443/2877] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:08.426590 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee9b5d-449d-49c9-8ebb-00e7d2bb15cf admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:08.437986 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee9b5d-449d-49c9-8ebb-00e7d2bb15cf admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:08.444070 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594a521-644b-411a-a295-8afa95e8f9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:08.445108 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594a521-644b-411a-a295-8afa95e8f9ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:08.445434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594a521-644b-411a-a295-8afa95e8f9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:08.445706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594a521-644b-411a-a295-8afa95e8f9ab admin admin] PATH_INFO: `/v3/projects/65052ff6297244539df0d0ede8214aa1/users/3f3d614f1c344d2bb155324929593722/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:08.462267 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594a521-644b-411a-a295-8afa95e8f9ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=65052ff6297244539df0d0ede8214aa1, user_id=3f3d614f1c344d2bb155324929593722, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:08.464971 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594a521-644b-411a-a295-8afa95e8f9ab admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:08.480930 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1435/2878] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:42:08 2022] PUT /identity/v3/projects/65052ff6297244539df0d0ede8214aa1/users/3f3d614f1c344d2bb155324929593722/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:08.492436 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb5259-f953-49cf-b3be-56c3386c1b40 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:08.492726 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb5259-f953-49cf-b3be-56c3386c1b40 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:08.493010 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb5259-f953-49cf-b3be-56c3386c1b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:08.521043 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-82cb5259-f953-49cf-b3be-56c3386c1b40 None None] MFA Rules not processed for user `3f3d614f1c344d2bb155324929593722`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:08.522207 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-82cb5259-f953-49cf-b3be-56c3386c1b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:08.544734 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:08.609172 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1444/2879] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:08.613899 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594a521-644b-411a-a295-8afa95e8f9ab admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:08.679368 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594a521-644b-411a-a295-8afa95e8f9ab admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:08.684360 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a4b4e-cf5e-4ab8-8471-8d60b33ece10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:08.685021 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a4b4e-cf5e-4ab8-8471-8d60b33ece10 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:08.685308 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a4b4e-cf5e-4ab8-8471-8d60b33ece10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:08.685702 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a4b4e-cf5e-4ab8-8471-8d60b33ece10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:08.686734 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a4b4e-cf5e-4ab8-8471-8d60b33ece10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:08.688697 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a4b4e-cf5e-4ab8-8471-8d60b33ece10 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:08.718901 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1436/2880] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:42:08 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:42:08.722822 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb5259-f953-49cf-b3be-56c3386c1b40 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:08.733905 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb5259-f953-49cf-b3be-56c3386c1b40 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:08.793716 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd39d3-9ca1-495b-8853-ab9ea2e853d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:08.794306 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd39d3-9ca1-495b-8853-ab9ea2e853d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:08.794594 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd39d3-9ca1-495b-8853-ab9ea2e853d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:08.794872 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd39d3-9ca1-495b-8853-ab9ea2e853d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:08.795941 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd39d3-9ca1-495b-8853-ab9ea2e853d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:08.797880 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd39d3-9ca1-495b-8853-ab9ea2e853d0 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:08.819072 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1445/2881] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:42:08 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:42:08.823670 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a4b4e-cf5e-4ab8-8471-8d60b33ece10 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:08.834946 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a4b4e-cf5e-4ab8-8471-8d60b33ece10 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:08.840422 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39780f1e-cd75-4e2e-80bc-05ec68827eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:08.841093 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39780f1e-cd75-4e2e-80bc-05ec68827eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:08.841382 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39780f1e-cd75-4e2e-80bc-05ec68827eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:08.841658 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39780f1e-cd75-4e2e-80bc-05ec68827eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:08.842434 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39780f1e-cd75-4e2e-80bc-05ec68827eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:08.844675 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39780f1e-cd75-4e2e-80bc-05ec68827eaf admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:08.862142 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1437/2882] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:08.867025 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd39d3-9ca1-495b-8853-ab9ea2e853d0 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:08.879539 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd39d3-9ca1-495b-8853-ab9ea2e853d0 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:08.885631 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6c71b-65aa-4624-8eb1-7e01448423f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:08.886543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6c71b-65aa-4624-8eb1-7e01448423f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:08.886821 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6c71b-65aa-4624-8eb1-7e01448423f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:08.887095 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6c71b-65aa-4624-8eb1-7e01448423f5 admin admin] PATH_INFO: `/v3/projects/768c3aa29e654d9b9c923b156d179301/users/9c743ee045fe4f46ad3cf91a8f8a4c56/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:08.902667 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6c71b-65aa-4624-8eb1-7e01448423f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=768c3aa29e654d9b9c923b156d179301, user_id=9c743ee045fe4f46ad3cf91a8f8a4c56, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:08.905417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6c71b-65aa-4624-8eb1-7e01448423f5 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:08.920527 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1446/2883] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:42:08 2022] PUT /identity/v3/projects/768c3aa29e654d9b9c923b156d179301/users/9c743ee045fe4f46ad3cf91a8f8a4c56/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:08.924738 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39780f1e-cd75-4e2e-80bc-05ec68827eaf admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:08.936090 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39780f1e-cd75-4e2e-80bc-05ec68827eaf admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:08.992371 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6746f-6a27-407e-bfd1-7759246e78e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:08.993032 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6746f-6a27-407e-bfd1-7759246e78e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:08.993309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6746f-6a27-407e-bfd1-7759246e78e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:08.993583 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6746f-6a27-407e-bfd1-7759246e78e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:08.994309 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6746f-6a27-407e-bfd1-7759246e78e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:08.995927 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6746f-6a27-407e-bfd1-7759246e78e7 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:09.005723 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1438/2884] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:09.010170 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6c71b-65aa-4624-8eb1-7e01448423f5 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:09.021439 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6c71b-65aa-4624-8eb1-7e01448423f5 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:09.026985 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a30d4e-527d-4f72-950d-9559cdcea523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:09.027927 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a30d4e-527d-4f72-950d-9559cdcea523 admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:09.028244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a30d4e-527d-4f72-950d-9559cdcea523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:09.028521 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a30d4e-527d-4f72-950d-9559cdcea523 admin admin] PATH_INFO: `/v3/projects/768c3aa29e654d9b9c923b156d179301/users/9c743ee045fe4f46ad3cf91a8f8a4c56/roles/b3e17a05bffe488aac679e4a234d09eb` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:09.030863 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a30d4e-527d-4f72-950d-9559cdcea523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=768c3aa29e654d9b9c923b156d179301, user_id=9c743ee045fe4f46ad3cf91a8f8a4c56, role_id=b3e17a05bffe488aac679e4a234d09eb)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:09.033554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a30d4e-527d-4f72-950d-9559cdcea523 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:09.044459 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1447/2885] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:42:09 2022] PUT /identity/v3/projects/768c3aa29e654d9b9c923b156d179301/users/9c743ee045fe4f46ad3cf91a8f8a4c56/roles/b3e17a05bffe488aac679e4a234d09eb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:09.054819 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda376f-8bd7-41f0-a79a-b0c28b1f3e9e None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:09.055109 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda376f-8bd7-41f0-a79a-b0c28b1f3e9e None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:09.055393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda376f-8bd7-41f0-a79a-b0c28b1f3e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:09.085056 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-0dda376f-8bd7-41f0-a79a-b0c28b1f3e9e None None] MFA Rules not processed for user `9c743ee045fe4f46ad3cf91a8f8a4c56`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:09.086319 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0dda376f-8bd7-41f0-a79a-b0c28b1f3e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:09.091249 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:09.160349 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1439/2886] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:42:09.171686 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a30d4e-527d-4f72-950d-9559cdcea523 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:09.173514 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-94a30d4e-527d-4f72-950d-9559cdcea523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:09.235977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a30d4e-527d-4f72-950d-9559cdcea523 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:09.239749 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133092d-104b-43e1-b336-be3c91c7f9ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:09.240405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133092d-104b-43e1-b336-be3c91c7f9ac service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:09.240687 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133092d-104b-43e1-b336-be3c91c7f9ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:09.240962 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133092d-104b-43e1-b336-be3c91c7f9ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:09.250543 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133092d-104b-43e1-b336-be3c91c7f9ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:09.252038 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133092d-104b-43e1-b336-be3c91c7f9ac service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:09.261319 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1448/2887] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:42:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:42:09.810354 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda376f-8bd7-41f0-a79a-b0c28b1f3e9e None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:09.812122 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-0dda376f-8bd7-41f0-a79a-b0c28b1f3e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:09.825083 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda376f-8bd7-41f0-a79a-b0c28b1f3e9e None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:09.829299 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1277729-1e6d-472b-a846-77ab758e17d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:09.829954 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1277729-1e6d-472b-a846-77ab758e17d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:09.830234 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1277729-1e6d-472b-a846-77ab758e17d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:09.830652 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1277729-1e6d-472b-a846-77ab758e17d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:09.892271 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1277729-1e6d-472b-a846-77ab758e17d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:09.893736 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1277729-1e6d-472b-a846-77ab758e17d5 service cinder] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:09.903366 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1440/2888] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:42:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:42:13.999917 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133092d-104b-43e1-b336-be3c91c7f9ac service cinder] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:14.009236 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133092d-104b-43e1-b336-be3c91c7f9ac service cinder] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:14.013167 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa7cee-8ce4-49ca-a1e1-db3590008c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:14.013741 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa7cee-8ce4-49ca-a1e1-db3590008c90 service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:14.014024 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa7cee-8ce4-49ca-a1e1-db3590008c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:14.014297 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa7cee-8ce4-49ca-a1e1-db3590008c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:14.027150 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:14.075081 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa7cee-8ce4-49ca-a1e1-db3590008c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:14.076564 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa7cee-8ce4-49ca-a1e1-db3590008c90 service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:14.086097 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1449/2889] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:42:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:42:16.266706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1277729-1e6d-472b-a846-77ab758e17d5 service cinder] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:16.340135 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1277729-1e6d-472b-a846-77ab758e17d5 service cinder] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:16.346918 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe4e8a-2453-4d05-8123-6c47ad206f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:16.347824 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe4e8a-2453-4d05-8123-6c47ad206f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:16.348109 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe4e8a-2453-4d05-8123-6c47ad206f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:16.348398 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe4e8a-2453-4d05-8123-6c47ad206f00 admin admin] PATH_INFO: `/v3/users/f0ca511c00554e69bc857cbdb0d10ca8` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:16.349659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe4e8a-2453-4d05-8123-6c47ad206f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ca511c00554e69bc857cbdb0d10ca8)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:16.351589 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe4e8a-2453-4d05-8123-6c47ad206f00 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:16.396689 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:16.402423 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-49fe4e8a-2453-4d05-8123-6c47ad206f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ca511c00554e69bc857cbdb0d10ca8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:16.416061 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-49fe4e8a-2453-4d05-8123-6c47ad206f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ca511c00554e69bc857cbdb0d10ca8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:16.416753 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-49fe4e8a-2453-4d05-8123-6c47ad206f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ca511c00554e69bc857cbdb0d10ca8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:16.417379 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-49fe4e8a-2453-4d05-8123-6c47ad206f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ca511c00554e69bc857cbdb0d10ca8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:16.424880 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-49fe4e8a-2453-4d05-8123-6c47ad206f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ca511c00554e69bc857cbdb0d10ca8'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:16.438785 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1441/2890] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:42:16 2022] DELETE /identity/v3/users/f0ca511c00554e69bc857cbdb0d10ca8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:16.443388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c6293-9ad5-4255-8241-d577280c602a None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:16.443909 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c6293-9ad5-4255-8241-d577280c602a None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:16.444037 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c6293-9ad5-4255-8241-d577280c602a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:16.462022 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-612c6293-9ad5-4255-8241-d577280c602a None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:16.463175 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-612c6293-9ad5-4255-8241-d577280c602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:16.525073 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1450/2891] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:16.537238 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe4e8a-2453-4d05-8123-6c47ad206f00 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:16.539659 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-49fe4e8a-2453-4d05-8123-6c47ad206f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:16.612292 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe4e8a-2453-4d05-8123-6c47ad206f00 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:16.618286 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884605c1-65ca-4146-980a-840416b6761d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:16.618924 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884605c1-65ca-4146-980a-840416b6761d service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:16.619296 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884605c1-65ca-4146-980a-840416b6761d service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:16.619677 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884605c1-65ca-4146-980a-840416b6761d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:16.630556 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884605c1-65ca-4146-980a-840416b6761d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:16.632037 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884605c1-65ca-4146-980a-840416b6761d service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:16.642780 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1442/2892] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:42:16.942257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c6293-9ad5-4255-8241-d577280c602a None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:16.943740 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-612c6293-9ad5-4255-8241-d577280c602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:16.958502 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c6293-9ad5-4255-8241-d577280c602a None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:16.964141 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:16.965670 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:16.966071 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:16.966176 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3 admin admin] PATH_INFO: `/v3/projects/5a4265632a2147fe9b8226b462c36228` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:16.967519 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4265632a2147fe9b8226b462c36228)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:16.970029 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:17.021919 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4265632a2147fe9b8226b462c36228', 'request_id': 'req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.030744 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4265632a2147fe9b8226b462c36228', 'request_id': 'req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.036828 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4265632a2147fe9b8226b462c36228', 'request_id': 'req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.049006 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3 admin admin] The token cache is being invalidate because project 5a4265632a2147fe9b8226b462c36228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:42:17.049321 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.050090 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.051815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1451/2893] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:42:16 2022] DELETE /identity/v3/projects/5a4265632a2147fe9b8226b462c36228 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:17.056363 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884605c1-65ca-4146-980a-840416b6761d service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:17.066673 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884605c1-65ca-4146-980a-840416b6761d service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:17.126071 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdcfd2-87d2-4d6f-9fdd-6568cf0510bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:17.126966 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdcfd2-87d2-4d6f-9fdd-6568cf0510bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:17.127246 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdcfd2-87d2-4d6f-9fdd-6568cf0510bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:17.127521 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdcfd2-87d2-4d6f-9fdd-6568cf0510bb admin admin] PATH_INFO: `/v3/users/3f3d614f1c344d2bb155324929593722` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:17.128754 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdcfd2-87d2-4d6f-9fdd-6568cf0510bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3d614f1c344d2bb155324929593722)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:17.130746 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdcfd2-87d2-4d6f-9fdd-6568cf0510bb admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:17.178865 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80fdcfd2-87d2-4d6f-9fdd-6568cf0510bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3d614f1c344d2bb155324929593722'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.189741 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:17.191224 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80fdcfd2-87d2-4d6f-9fdd-6568cf0510bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3d614f1c344d2bb155324929593722'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.192058 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80fdcfd2-87d2-4d6f-9fdd-6568cf0510bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3d614f1c344d2bb155324929593722'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.192800 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80fdcfd2-87d2-4d6f-9fdd-6568cf0510bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3d614f1c344d2bb155324929593722'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.201273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-80fdcfd2-87d2-4d6f-9fdd-6568cf0510bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3d614f1c344d2bb155324929593722'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.215817 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1443/2894] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:42:17 2022] DELETE /identity/v3/users/3f3d614f1c344d2bb155324929593722 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:42:17.507554 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:17.509194 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:17.522815 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fdc4b-da11-4a3f-b660-cdfe0df70fb3 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:17.558713 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:17.590059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef2445-354a-49e5-9f5f-5f32e1f0df12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:17.591325 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef2445-354a-49e5-9f5f-5f32e1f0df12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:17.591632 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef2445-354a-49e5-9f5f-5f32e1f0df12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:17.591931 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef2445-354a-49e5-9f5f-5f32e1f0df12 admin admin] PATH_INFO: `/v3/projects/65052ff6297244539df0d0ede8214aa1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:17.594012 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef2445-354a-49e5-9f5f-5f32e1f0df12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65052ff6297244539df0d0ede8214aa1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:17.596392 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef2445-354a-49e5-9f5f-5f32e1f0df12 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:17.646478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94ef2445-354a-49e5-9f5f-5f32e1f0df12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65052ff6297244539df0d0ede8214aa1', 'request_id': 'req-94ef2445-354a-49e5-9f5f-5f32e1f0df12'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.655705 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94ef2445-354a-49e5-9f5f-5f32e1f0df12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65052ff6297244539df0d0ede8214aa1', 'request_id': 'req-94ef2445-354a-49e5-9f5f-5f32e1f0df12'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.662525 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94ef2445-354a-49e5-9f5f-5f32e1f0df12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65052ff6297244539df0d0ede8214aa1', 'request_id': 'req-94ef2445-354a-49e5-9f5f-5f32e1f0df12'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.674441 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94ef2445-354a-49e5-9f5f-5f32e1f0df12 admin admin] The token cache is being invalidate because project 65052ff6297244539df0d0ede8214aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:42:17.674724 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94ef2445-354a-49e5-9f5f-5f32e1f0df12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.675424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-94ef2445-354a-49e5-9f5f-5f32e1f0df12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.677114 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1452/2895] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:42:17 2022] DELETE /identity/v3/projects/65052ff6297244539df0d0ede8214aa1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:17.681190 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdcfd2-87d2-4d6f-9fdd-6568cf0510bb admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:17.682706 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-80fdcfd2-87d2-4d6f-9fdd-6568cf0510bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:17.696214 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdcfd2-87d2-4d6f-9fdd-6568cf0510bb admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:17.777019 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00c0b7-4c3c-4965-a38c-3be174741d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:17.777900 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00c0b7-4c3c-4965-a38c-3be174741d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:17.778186 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00c0b7-4c3c-4965-a38c-3be174741d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:17.778460 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00c0b7-4c3c-4965-a38c-3be174741d26 admin admin] PATH_INFO: `/v3/users/9c743ee045fe4f46ad3cf91a8f8a4c56` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:17.779719 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00c0b7-4c3c-4965-a38c-3be174741d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c743ee045fe4f46ad3cf91a8f8a4c56)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:17.781715 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00c0b7-4c3c-4965-a38c-3be174741d26 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:17.831816 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2f00c0b7-4c3c-4965-a38c-3be174741d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c743ee045fe4f46ad3cf91a8f8a4c56'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.846676 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2f00c0b7-4c3c-4965-a38c-3be174741d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c743ee045fe4f46ad3cf91a8f8a4c56'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.847393 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2f00c0b7-4c3c-4965-a38c-3be174741d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c743ee045fe4f46ad3cf91a8f8a4c56'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.848024 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2f00c0b7-4c3c-4965-a38c-3be174741d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c743ee045fe4f46ad3cf91a8f8a4c56'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.855373 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-2f00c0b7-4c3c-4965-a38c-3be174741d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c743ee045fe4f46ad3cf91a8f8a4c56'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:17.871376 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1444/2896] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:42:17 2022] DELETE /identity/v3/users/9c743ee045fe4f46ad3cf91a8f8a4c56 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:42:18.175424 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef2445-354a-49e5-9f5f-5f32e1f0df12 admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:18.177009 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-94ef2445-354a-49e5-9f5f-5f32e1f0df12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:18.190367 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef2445-354a-49e5-9f5f-5f32e1f0df12 admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:18.248477 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da0ebf-321e-4afe-ace8-97393257bf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:18.249388 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da0ebf-321e-4afe-ace8-97393257bf20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:18.249675 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da0ebf-321e-4afe-ace8-97393257bf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:18.249963 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da0ebf-321e-4afe-ace8-97393257bf20 admin admin] PATH_INFO: `/v3/projects/768c3aa29e654d9b9c923b156d179301` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:18.251550 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da0ebf-321e-4afe-ace8-97393257bf20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=768c3aa29e654d9b9c923b156d179301)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:18.253571 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da0ebf-321e-4afe-ace8-97393257bf20 admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:18.304437 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a4da0ebf-321e-4afe-ace8-97393257bf20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768c3aa29e654d9b9c923b156d179301', 'request_id': 'req-a4da0ebf-321e-4afe-ace8-97393257bf20'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:18.313923 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a4da0ebf-321e-4afe-ace8-97393257bf20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768c3aa29e654d9b9c923b156d179301', 'request_id': 'req-a4da0ebf-321e-4afe-ace8-97393257bf20'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:18.320257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a4da0ebf-321e-4afe-ace8-97393257bf20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768c3aa29e654d9b9c923b156d179301', 'request_id': 'req-a4da0ebf-321e-4afe-ace8-97393257bf20'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:18.327478 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:18.333216 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a4da0ebf-321e-4afe-ace8-97393257bf20 admin admin] The token cache is being invalidate because project 768c3aa29e654d9b9c923b156d179301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:42:18.333784 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a4da0ebf-321e-4afe-ace8-97393257bf20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:18.335173 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-a4da0ebf-321e-4afe-ace8-97393257bf20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:18.337245 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1453/2897] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:42:18 2022] DELETE /identity/v3/projects/768c3aa29e654d9b9c923b156d179301 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:18.344450 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f61d6-31ee-4737-b21f-9b395b6ec658 None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:18.344683 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f61d6-31ee-4737-b21f-9b395b6ec658 None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:18.344965 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f61d6-31ee-4737-b21f-9b395b6ec658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:18.364711 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-204f61d6-31ee-4737-b21f-9b395b6ec658 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:18.365983 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-204f61d6-31ee-4737-b21f-9b395b6ec658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:18.428619 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:18.441506 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1445/2898] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:18.448634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dbd08-6c4e-46a6-b73b-4a8b2027cad6 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:18.448943 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dbd08-6c4e-46a6-b73b-4a8b2027cad6 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:18.449228 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dbd08-6c4e-46a6-b73b-4a8b2027cad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:18.469047 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-f57dbd08-6c4e-46a6-b73b-4a8b2027cad6 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:18.470244 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-f57dbd08-6c4e-46a6-b73b-4a8b2027cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:18.479977 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1454/2899] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:18.484662 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f61d6-31ee-4737-b21f-9b395b6ec658 None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:18.495718 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f61d6-31ee-4737-b21f-9b395b6ec658 None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:18.502427 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b52c6b-870b-4296-85ed-35a297ed29b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:18.503070 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b52c6b-870b-4296-85ed-35a297ed29b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:18.503369 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b52c6b-870b-4296-85ed-35a297ed29b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:18.503634 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b52c6b-870b-4296-85ed-35a297ed29b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:18.504407 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b52c6b-870b-4296-85ed-35a297ed29b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:42:18.504715 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b52c6b-870b-4296-85ed-35a297ed29b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:18.506329 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b52c6b-870b-4296-85ed-35a297ed29b5 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:18.525582 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1446/2900] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 08:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:42:18.532171 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dbd08-6c4e-46a6-b73b-4a8b2027cad6 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:18.542686 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dbd08-6c4e-46a6-b73b-4a8b2027cad6 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:18.549059 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe2674-4f14-4a0a-bb2d-8785d48d74ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:18.549714 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe2674-4f14-4a0a-bb2d-8785d48d74ed admin admin] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:18.549993 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe2674-4f14-4a0a-bb2d-8785d48d74ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:18.550265 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe2674-4f14-4a0a-bb2d-8785d48d74ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:18.550952 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe2674-4f14-4a0a-bb2d-8785d48d74ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:18.552886 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe2674-4f14-4a0a-bb2d-8785d48d74ed admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:18.586417 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1455/2901] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 08:42:18 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:42:18.593016 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b52c6b-870b-4296-85ed-35a297ed29b5 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:18.605119 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b52c6b-870b-4296-85ed-35a297ed29b5 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:18.674194 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f123a0-0ee6-4a06-b088-a9efe5472124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:18.675125 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f123a0-0ee6-4a06-b088-a9efe5472124 admin admin] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:18.675406 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f123a0-0ee6-4a06-b088-a9efe5472124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:18.675720 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f123a0-0ee6-4a06-b088-a9efe5472124 admin admin] PATH_INFO: `/v3/users` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:18.676418 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f123a0-0ee6-4a06-b088-a9efe5472124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:18.678361 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f123a0-0ee6-4a06-b088-a9efe5472124 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:18.699867 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1447/2902] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 08:42:18 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:42:18.705079 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe2674-4f14-4a0a-bb2d-8785d48d74ed admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:18.721695 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe2674-4f14-4a0a-bb2d-8785d48d74ed admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:18.730098 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933eeb2c-0324-414e-a262-9e1c825ba3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:18.731327 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eeb2c-0324-414e-a262-9e1c825ba3ea admin admin] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:18.731814 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eeb2c-0324-414e-a262-9e1c825ba3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:18.732122 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eeb2c-0324-414e-a262-9e1c825ba3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:18.733189 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933eeb2c-0324-414e-a262-9e1c825ba3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:18.735634 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933eeb2c-0324-414e-a262-9e1c825ba3ea admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:18.746981 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1456/2903] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:18.751405 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f123a0-0ee6-4a06-b088-a9efe5472124 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:18.765232 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f123a0-0ee6-4a06-b088-a9efe5472124 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:18.771488 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cb574-1758-4374-b738-9572ae33e849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:18.772183 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cb574-1758-4374-b738-9572ae33e849 admin admin] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:18.772470 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cb574-1758-4374-b738-9572ae33e849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:18.772748 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cb574-1758-4374-b738-9572ae33e849 admin admin] PATH_INFO: `/v3/roles` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:18.773495 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cb574-1758-4374-b738-9572ae33e849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:18.775100 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cb574-1758-4374-b738-9572ae33e849 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:18.786343 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1448/2904] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 08:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:42:18.791414 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933eeb2c-0324-414e-a262-9e1c825ba3ea admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:18.804442 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933eeb2c-0324-414e-a262-9e1c825ba3ea admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:18.810111 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8e466-2041-4597-8b64-9d48985d253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:18.810987 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8e466-2041-4597-8b64-9d48985d253e admin admin] REQUEST_METHOD: `PUT` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:18.811262 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8e466-2041-4597-8b64-9d48985d253e admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:18.811533 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8e466-2041-4597-8b64-9d48985d253e admin admin] PATH_INFO: `/v3/projects/85e1123951b74d19aa61bf444c8a37e2/users/241625be830a4bd3b80bc83fc9cc0666/roles/3fb4236a239b47e3ac59e14b3db524b1` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:18.827265 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8e466-2041-4597-8b64-9d48985d253e admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e1123951b74d19aa61bf444c8a37e2, user_id=241625be830a4bd3b80bc83fc9cc0666, role_id=3fb4236a239b47e3ac59e14b3db524b1)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:18.830060 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8e466-2041-4597-8b64-9d48985d253e admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:18.845208 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1457/2905] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 08:42:18 2022] PUT /identity/v3/projects/85e1123951b74d19aa61bf444c8a37e2/users/241625be830a4bd3b80bc83fc9cc0666/roles/3fb4236a239b47e3ac59e14b3db524b1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:18.857528 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde4a81-f8fb-400a-9857-d634b273250b None None] REQUEST_METHOD: `POST` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:18.857783 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde4a81-f8fb-400a-9857-d634b273250b None None] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:18.858188 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde4a81-f8fb-400a-9857-d634b273250b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:18.888397 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.auth.core [None req-7dde4a81-f8fb-400a-9857-d634b273250b None None] MFA Rules not processed for user `241625be830a4bd3b80bc83fc9cc0666`. Rule list: `[]` (Enabled: `True`). {{(pid=80236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:18.889657 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-7dde4a81-f8fb-400a-9857-d634b273250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:18.957316 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1449/2906] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:18.973108 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8e466-2041-4597-8b64-9d48985d253e admin admin] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:18.976421 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-0fd8e466-2041-4597-8b64-9d48985d253e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:19.039394 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8e466-2041-4597-8b64-9d48985d253e admin admin] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:19.043702 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd990484-ed79-4ab7-ab3c-53fe77c7272c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd620e5fcb9c4b82865d1d0c508ce8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:19.044362 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd990484-ed79-4ab7-ab3c-53fe77c7272c service cinder] REQUEST_METHOD: `GET` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:19.044653 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd990484-ed79-4ab7-ab3c-53fe77c7272c service cinder] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:19.044931 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd990484-ed79-4ab7-ab3c-53fe77c7272c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:19.055089 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd990484-ed79-4ab7-ab3c-53fe77c7272c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:19.056586 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd990484-ed79-4ab7-ab3c-53fe77c7272c service cinder] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:19.066143 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1458/2907] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:42:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:42:22.143660 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde4a81-f8fb-400a-9857-d634b273250b None None] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:22.208699 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:22.215273 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde4a81-f8fb-400a-9857-d634b273250b None None] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:22.221163 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910201cf-ae68-4539-b4de-8951ba3be820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:22.222044 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910201cf-ae68-4539-b4de-8951ba3be820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:22.222345 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910201cf-ae68-4539-b4de-8951ba3be820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:22.222599 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910201cf-ae68-4539-b4de-8951ba3be820 admin admin] PATH_INFO: `/v3/users/241625be830a4bd3b80bc83fc9cc0666` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:22.223841 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910201cf-ae68-4539-b4de-8951ba3be820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=241625be830a4bd3b80bc83fc9cc0666)` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:22.225777 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910201cf-ae68-4539-b4de-8951ba3be820 admin admin] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:22.276813 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-910201cf-ae68-4539-b4de-8951ba3be820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '241625be830a4bd3b80bc83fc9cc0666'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:22.288524 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-910201cf-ae68-4539-b4de-8951ba3be820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '241625be830a4bd3b80bc83fc9cc0666'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:22.289209 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-910201cf-ae68-4539-b4de-8951ba3be820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '241625be830a4bd3b80bc83fc9cc0666'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:22.289836 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-910201cf-ae68-4539-b4de-8951ba3be820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '241625be830a4bd3b80bc83fc9cc0666'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:22.296554 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.notifications [None req-910201cf-ae68-4539-b4de-8951ba3be820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '241625be830a4bd3b80bc83fc9cc0666'} {{(pid=80236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:22.310270 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1450/2908] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 08:42:22 2022] DELETE /identity/v3/users/241625be830a4bd3b80bc83fc9cc0666 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:22.315275 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e7628-85e4-4951-85e3-5615da784f30 None None] REQUEST_METHOD: `POST` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:22.315868 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e7628-85e4-4951-85e3-5615da784f30 None None] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:22.315973 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e7628-85e4-4951-85e3-5615da784f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:22.335794 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.auth.core [None req-a46e7628-85e4-4951-85e3-5615da784f30 None None] MFA Rules not processed for user `23d4803e5e4a4ff6aed2456c309e3051`. Rule list: `[]` (Enabled: `True`). {{(pid=80237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:22.337082 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a46e7628-85e4-4951-85e3-5615da784f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:22.403998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1459/2909] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 08:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:22.416962 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910201cf-ae68-4539-b4de-8951ba3be820 admin admin] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:22.419466 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-910201cf-ae68-4539-b4de-8951ba3be820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:22.609377 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910201cf-ae68-4539-b4de-8951ba3be820 admin admin] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:22.613585 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71018bd-dbe0-4f51-b7b2-68a6e865d253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d737a8a33da490db5d59ffed92bee60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:22.614236 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71018bd-dbe0-4f51-b7b2-68a6e865d253 service neutron] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:22.614518 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71018bd-dbe0-4f51-b7b2-68a6e865d253 service neutron] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:22.614799 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71018bd-dbe0-4f51-b7b2-68a6e865d253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:22.624860 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71018bd-dbe0-4f51-b7b2-68a6e865d253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:22.626727 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71018bd-dbe0-4f51-b7b2-68a6e865d253 service neutron] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:22.636388 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1451/2910] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:42:22.931779 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e7628-85e4-4951-85e3-5615da784f30 None None] Authenticating user token {{(pid=80237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:22.933257 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.fernet_utils [None req-a46e7628-85e4-4951-85e3-5615da784f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:22.945578 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e7628-85e4-4951-85e3-5615da784f30 None None] Validating token access rules against request {{(pid=80237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:22.951070 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aca9b1-f237-4b76-a6b0-f4b66e51ee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d4803e5e4a4ff6aed2456c309e3051', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dac71dc397d4676b170c1cf9092d9e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:22.951979 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aca9b1-f237-4b76-a6b0-f4b66e51ee8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:22.952263 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aca9b1-f237-4b76-a6b0-f4b66e51ee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:22.952536 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aca9b1-f237-4b76-a6b0-f4b66e51ee8d admin admin] PATH_INFO: `/v3/projects/85e1123951b74d19aa61bf444c8a37e2` {{(pid=80237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:22.953746 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aca9b1-f237-4b76-a6b0-f4b66e51ee8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=85e1123951b74d19aa61bf444c8a37e2)` {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:22.955898 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aca9b1-f237-4b76-a6b0-f4b66e51ee8d admin admin] RBAC: Authorization granted {{(pid=80237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:22.996998 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:23.011405 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-01aca9b1-f237-4b76-a6b0-f4b66e51ee8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85e1123951b74d19aa61bf444c8a37e2', 'request_id': 'req-01aca9b1-f237-4b76-a6b0-f4b66e51ee8d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:23.020395 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-01aca9b1-f237-4b76-a6b0-f4b66e51ee8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85e1123951b74d19aa61bf444c8a37e2', 'request_id': 'req-01aca9b1-f237-4b76-a6b0-f4b66e51ee8d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:23.026063 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-01aca9b1-f237-4b76-a6b0-f4b66e51ee8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85e1123951b74d19aa61bf444c8a37e2', 'request_id': 'req-01aca9b1-f237-4b76-a6b0-f4b66e51ee8d'} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:23.038049 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-01aca9b1-f237-4b76-a6b0-f4b66e51ee8d admin admin] The token cache is being invalidate because project 85e1123951b74d19aa61bf444c8a37e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:42:23.038339 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-01aca9b1-f237-4b76-a6b0-f4b66e51ee8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:23.038976 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG keystone.notifications [None req-01aca9b1-f237-4b76-a6b0-f4b66e51ee8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:42:23.040559 dv-cinder-850320-1-smb devstack@keystone.service[80237]: [pid: 80237|app: 0|req: 1460/2911] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 08:42:22 2022] DELETE /identity/v3/projects/85e1123951b74d19aa61bf444c8a37e2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:42:32.632442 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:33.034823 dv-cinder-850320-1-smb devstack@keystone.service[80237]: DEBUG dbcounter [-] [80237] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:37.301846 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71018bd-dbe0-4f51-b7b2-68a6e865d253 service neutron] Authenticating user token {{(pid=80236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:37.303461 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-a71018bd-dbe0-4f51-b7b2-68a6e865d253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:37.377579 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71018bd-dbe0-4f51-b7b2-68a6e865d253 service neutron] Validating token access rules against request {{(pid=80236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:37.439818 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8903f5c-f4c0-41ae-a9ef-d573e55b9b6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1146aa09d30458f9ab3b3bec8f94233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784795960efb40e5811f778fff6fceb1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:37.440476 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8903f5c-f4c0-41ae-a9ef-d573e55b9b6f service placement] REQUEST_METHOD: `GET` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:37.440761 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8903f5c-f4c0-41ae-a9ef-d573e55b9b6f service placement] SCRIPT_NAME: `/identity` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:37.441029 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8903f5c-f4c0-41ae-a9ef-d573e55b9b6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:37.442993 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.fernet_utils [None req-b8903f5c-f4c0-41ae-a9ef-d573e55b9b6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:37.454798 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8903f5c-f4c0-41ae-a9ef-d573e55b9b6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:37.456430 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8903f5c-f4c0-41ae-a9ef-d573e55b9b6f service placement] RBAC: Authorization granted {{(pid=80236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:37.466858 dv-cinder-850320-1-smb devstack@keystone.service[80236]: [pid: 80236|app: 0|req: 1452/2912] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:44:47.462548 dv-cinder-850320-1-smb devstack@keystone.service[80236]: DEBUG dbcounter [-] [80236] Writing DB stats keystone:SELECT=58 {{(pid=80236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}